Real-Time Voice-Controlled Game Interaction using Convolutional Neural Networks

Waqar, Dania Maryam and Gunawan, Teddy Surya and Kartiwi, Mira and Ahmad, Robiah (2021) Real-Time Voice-Controlled Game Interaction using Convolutional Neural Networks. In: 2021 IEEE 7th International Conference on Smart Instrumentation, Measurement and Applications, Bandung, Indonesia.

	PDF Restricted to Registered users only Download (807kB) | Request a copy
	PDF (SCOPUS) - Supplemental Material Restricted to Registered users only Download (378kB) | Request a copy

Abstract

Speech recognition has gained growing popularity due to its wide applications in almost every field, ranging from wake-word recognition, emotion recognition, command recognition, and interactive game. Recently, there is a growing interest in using voice in the gaming industry. Voice-controlled interaction made gaming much more accessible to a wider audience. However, the use of voice to control games requires real-time processing to avoid unwanted delay. This paper proposes speech command recognition using Convolutional Neural Networks (CNN) to control the popular snake game. First, the limited dataset for Up, Down, Left, Right speech commands was prepared for training, validation, and testing. Second, an optimum MFCC and CNN-based speech command recognition were proposed to recognize the four speech command. Results showed that our proposed algorithm could achieve high recognition accuracy of 96.5% and was able to detect all four commands. Finally, the proposed algorithm is integrated with a Python-based snake game.

Item Type:	Conference or Workshop Item (Invited Papers)
Uncontrolled Keywords:	speech command recognition, interactive game, CNN, snake game.
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Electrical and Computer Engineering Kulliyyah of Information and Communication Technology > Department of Information System Kulliyyah of Information and Communication Technology > Department of Information System
Depositing User:	Prof. Dr. Teddy Surya Gunawan
Date Deposited:	14 Sep 2021 11:14
Last Modified:	07 Oct 2021 08:37
URI:	http://irep.iium.edu.my/id/eprint/92226

Actions (login required)

View Item