Augmentative and alternative communication method based on tongue clicking for mute disabilities

Azmi, Muhammad Amirul Amin and Nik Hashim, Nik Nur Wahidah and Md. Yusof, Hazlina (2019) Augmentative and alternative communication method based on tongue clicking for mute disabilities. IIUM Engineering Journal, 20 (1). pp. 119-128. ISSN 1511-788X E-ISSN 2289-7860

	PDF - Published Version Restricted to Registered users only Download (568kB) | Request a copy
Preview	PDF (SCOPUS) Download (261kB) | Preview
Preview	PDF (wOS) - Supplemental Material Download (231kB) | Preview

Abstract

This paper presents a pilot study for a novel application of converting tongue clicking sound to words for people with the inability to speak. 15 features of speech that are related to speech timing patterns, amplitude modulation, zero crossing and peak detection were extracted. The experiments were conducted with three different patterns using binary Support Vector Machine (SVM) classification with 10 recordings as training data and 10 recordings as development data. Peak size outperformed all features with 85% classification rate for pattern P1-P3 whereas multiple features produced 100% classification rate for P1-P2 and P2-P3. A GUI based system was developed to validate the trained classifier. Multiclass SVM were constructed based on the best features obtained from binary SVM classification outcome, namely peak size and skewness amplitude modulation, and then tested on 15 recordings. The GUI based multiclass SVM obtained a satisfying performance of 67% correct classification of the test data set.

Item Type:	Article (Journal)
Additional Information:	7157/72545
Uncontrolled Keywords:	Mute, Speech, Alternative Communication, Classification, Features
Subjects:	T Technology > T Technology (General)
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering Kulliyyah of Engineering > Department of Mechatronics Engineering
Depositing User:	Dr Nik Nur Wahidah Nik Hashim
Date Deposited:	12 Jun 2019 15:26
Last Modified:	07 Aug 2019 15:15
URI:	http://irep.iium.edu.my/id/eprint/72545

Actions (login required)

View Item