An enhanced handwriting recognition tool for the visually impaired

Huzaimi, Muhammad Zikry and Mohd Ramli, Huda Adibah and Saidin, Norazlina (2024) An enhanced handwriting recognition tool for the visually impaired. In: 2024 9th International Conference on Mechatronics Engineering (ICOM), 13-14 August 2024, Kulliyyah of Engineering, IIUM.

	PDF - Published Version Restricted to Registered users only Download (610kB) | Request a copy
Preview	PDF - Supplemental Material Download (167kB) | Preview

Abstract

Handwritten text serves as an essential means of conveying ideas and messages. It is often characterized by diverse handwriting styles, variations in character shapes, as well as the presence of overlapping strokes and characters. However, for visually impaired individuals, this poses significant hurdles as existing recognition tools may not reliably provide accurate information. To address this, an enhanced handwriting recognition tool powered by Optical Character Recognition (OCR) is proposed. This tool integrates a Raspberry Pi microcontroller and a camera module for image capture, along with a text-to speech engine to empower the visually impaired. Moreover, the tool employs Artificial Neural Network (ANN) and a hybrid Artificial Neural Network + Hidden Markov Model (ANN+HMM) classification methods to enhance recognition performances. In addition to the functionality test, a series of accuracy and recall rate tests for different handwriting styles was conducted to assess the tool's performance. The results demonstrated the superiority of the hybrid ANN+HMM model over the standalone ANN, achieving an impressive 46.3% improvement in accuracy and a perfect 100% recall rate, particularly for cursive handwriting. This groundbreaking innovation contributes to fostering a more inclusive and accessible world for all.

Item Type:	Proceeding Paper (Slide Presentation)
Uncontrolled Keywords:	Handwriting recognition tool; Hidden Markov Model (HMM); Artificial Neural Network (ANN); Optical Character Recognition (OCR); Raspberry Pi.
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Electrical and Computer Engineering Kulliyyah of Engineering
Depositing User:	Sr Huda Adibah Mohd Ramli
Date Deposited:	07 Nov 2024 15:27
Last Modified:	07 Nov 2024 15:27
URI:	http://irep.iium.edu.my/id/eprint/115621

Actions (login required)

View Item