IIUM Repository

Assistive shopping tool for the visually impaired

Nashrom, Fatin Najihah Ruzani and Mohd Ramli, Huda Adibah and Saidin, Norazlina and Abdul Rahman, Farah Diyana (2023) Assistive shopping tool for the visually impaired. In: 2023 9th International Conference on Computer and Communication Engineering (ICCCE), 15-16 August 2023, Kuala Lumpur, Malaysia.

[img] PDF - Published Version
Restricted to Registered users only

Download (601kB) | Request a copy


Daily chores, such as physical shopping, are often a challenge for the visually impaired, unlike for somebody with normal vision. Although several existing shopping tools can assist the visually impaired to shop independently, most of them are limited to navigation, not portable, difficult to use, and expensive. These tools do not convey the information printed on the product to the users. Therefore, this paper presents the development of an assistive shopping tool that integrates Optical Character Recognition (OCR) and provides speech output to assist the visually impaired to do physical shopping independently. This tool is an assimilation of several processes that make use of hardware components namely mobile camera, Raspberry Pi module, earphones, breadboard, and software components that are Raspberry Pi OS, Tesseract, OpenCV, and Festival to allow portability, ease of use and less expensive. Validation processes were performed, and the accuracy of the developed shopping tool was evaluated under different scenarios to best reflect the actual shopping. The developed shopping tool can reach up to 75% to 99% accuracy and the voice output of the recognized text has a high audio quality.

Item Type: Conference or Workshop Item (Slide Presentation)
Uncontrolled Keywords: Optical Character Recognition (OCR), text extraction, shopping tool, visually impaired, text recognition
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button): Kulliyyah of Engineering > Department of Electrical and Computer Engineering
Kulliyyah of Engineering
Depositing User: Sr Huda Adibah Mohd Ramli
Date Deposited: 25 Sep 2023 15:37
Last Modified: 25 Sep 2023 15:37
URI: http://irep.iium.edu.my/id/eprint/107072

Actions (login required)

View Item View Item


Downloads per month over past year