Assistive shopping tool for the visually impaired

Nashrom, Fatin Najihah Ruzani and Mohd Ramli, Huda Adibah and Saidin, Norazlina and Abdul Rahman, Farah Diyana (2023) Assistive shopping tool for the visually impaired. In: 2023 9th International Conference on Computer and Communication Engineering (ICCCE), 15-16 August 2023, Kuala Lumpur, Malaysia.

	PDF - Published Version Restricted to Registered users only Download (601kB) | Request a copy
	PDF - Published Version Restricted to Registered users only Download (274kB) | Request a copy

Abstract

Daily chores, such as physical shopping, are often a challenge for the visually impaired, unlike for somebody with normal vision. Although several existing shopping tools can assist the visually impaired to shop independently, most of them are limited to navigation, not portable, difficult to use, and expensive. These tools do not convey the information printed on the product to the users. Therefore, this paper presents the development of an assistive shopping tool that integrates Optical Character Recognition (OCR) and provides speech output to assist the visually impaired to do physical shopping independently. This tool is an assimilation of several processes that make use of hardware components namely mobile camera, Raspberry Pi module, earphones, breadboard, and software components that are Raspberry Pi OS, Tesseract, OpenCV, and Festival to allow portability, ease of use and less expensive. Validation processes were performed, and the accuracy of the developed shopping tool was evaluated under different scenarios to best reflect the actual shopping. The developed shopping tool can reach up to 75% to 99% accuracy and the voice output of the recognized text has a high audio quality.

Item Type:	Proceeding Paper (Slide Presentation)
Uncontrolled Keywords:	Optical Character Recognition (OCR), text extraction, shopping tool, visually impaired, text recognition
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering Kulliyyah of Engineering > Department of Electrical and Computer Engineering
Depositing User:	Sr Huda Adibah Mohd Ramli
Date Deposited:	25 Sep 2023 15:37
Last Modified:	02 Feb 2024 09:18
URI:	http://irep.iium.edu.my/id/eprint/107072

Actions (login required)

View Item