Awang Abu Bakar, Normi Sham and Yusof, Siti Zulaikha and Irfan, Muhammad Syabil (2025) LUNA: Bridging communication with sign language translation. International Journal on Perceptive and Cognitive Computing (IJPCC), 11 (2). pp. 14-21. E-ISSN 2462-229X
|
PDF
Download (480kB) | Preview |
Abstract
This paper presents Learn, Unite, Network and Assist (LUNA) App, an assistive Internet of Things (IoT) system designed to facilitate two-way communication between individuals with hearing and speech impairments and the general public. The LUNA system integrates a smart glove embedded with flex sensors and an MPU6050 accelerometer to recognize hand gestures and translate them into real-time text displayed via a mobile application developed using Flutter. Beyond gesture recognition, LUNA includes a sign language learning module, GPS-based emergency location tracking, and video call functionality via WebRTC, enabling enhanced communication and user safety. Developed using the Scrum methodology, the system combines ESP32 microcontroller-based hardware with Firebase for real-time data handling. Experimental results demonstrate that LUNA achieves high accuracy and responsiveness, with gesture recognition response times ranging from 850 to 1200 milliseconds. This project represents a step toward inclusive communication by promoting mutual understanding and interaction between the disabled and non-disabled communities.
| Item Type: | Article (Journal) |
|---|---|
| Additional Information: | 3509/122773 |
| Uncontrolled Keywords: | Sign language, smart glove, IoT, gesture recognition, inclusive technology |
| Subjects: | T Technology > T Technology (General) T Technology > T Technology (General) > T10.5 Communication of technical information |
| Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button): | Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology > Department of Computer Science |
| Depositing User: | Dr. Normi Sham Awang Abu Bakar |
| Date Deposited: | 15 Aug 2025 16:23 |
| Last Modified: | 15 Aug 2025 16:51 |
| URI: | http://irep.iium.edu.my/id/eprint/122773 |
Actions (login required)
 |
View Item |
Download Statistics
Download Statistics