Design and implementation of a gesture-controlled smart room using computer vision

Sediono, Wahju and Susilawati, Helfy and Shahlan, Nurul A’aisyah (2025) Design and implementation of a gesture-controlled smart room using computer vision. In: 2025 10th International Conference on Information and Communication Technology for the Muslim World (ICT4M), 26-27 November 2025, Kuala Lumpur.

PDF - Published Version Restricted to Repository staff only Download (1MB) | Request a copy

Abstract

This paper presents the design and implementation of a gesture-controlled smart room system that leverages computer vision to enhance home automation and user interaction. The system enables users to control key appliances, specifically an LED light, an electric fan, and a motorized curtain, using predefined hand gestures. This approach addresses limitations of conventional manual or remote-based controls that may be inaccessible or inconvenient. The core of the system integrates MediaPipe and OpenCV for real-time hand gesture recognition, translating the detected gestures into serial commands transmitted to an Arduino UNO microcontroller that drives the actuators. Experimental validation confirmed reliable and responsive operation, with all appliances reacting correctly to their corresponding gesture inputs under optimal lighting conditions. Hardware characterization revealed nonlinear PWM behavior, in which the LED bulb began illumination at approximately 65% duty cycle, while the fan motor started rotation at around 60% PWM, emphasizing the need for actuator calibration. The system successfully demonstrated stable, continuous, and contactless appliance control, highlighting its feasibility for intuitive and hygienic smart environment applications, particularly beneficial in accessibility- and hygienesensitive contexts.

Item Type:	Proceeding Paper (Invited Papers)
Uncontrolled Keywords:	gesture recognition, smart home automation, computer vision, human-computer interaction, contactless control
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Mechatronics Engineering Kulliyyah of Engineering
Depositing User:	Dr.-Ing. Wahju Sediono
Date Deposited:	27 Feb 2026 10:28
Last Modified:	27 Feb 2026 10:28
Queue Number:	2026-02-Q2296
URI:	http://irep.iium.edu.my/id/eprint/127617

Actions (login required)

View Item