On the use of voice activity detection in speech emotion recognition

Alghifari, Muhammad Fahreza and Gunawan, Teddy Surya and Wan Nordin, Mimi Aminah and Ahmad Qadri, Syed Asif and Kartiwi, Mira and Janin, Zuriati (2019) On the use of voice activity detection in speech emotion recognition. Bulletin of Electrical Engineering and Informatics, 8 (4). pp. 1324-1332. ISSN 2302-9285 E-ISSN 2302-9285

	PDF (pdf) - Published Version Restricted to Registered users only Download (903kB) | Request a copy
Preview	PDF (scopus) Download (304kB) | Preview

Abstract

Emotion recognition through speech has many potential applications, however the challenge comes from achieving a high emotion recognition while using limited resources or interference such as noise. In this paper we have explored the possibility of improving speech emotion recognition by utilizing the voice activity detection (VAD) concept. The emotional voice data from the Berlin Emotion Database (EMO-DB) and a custom-made database LQ Audio Dataset are firstly preprocessed by VAD before feature extraction. The features are then passed to the deep neural network for classification. In this paper, we have chosen MFCC to be the sole determinant feature. From the results obtained using VAD and without, we have found that the VAD improved the recognition rate of 5 emotions (happy, angry, sad, fear, and neutral) by 3.7% when recognizing clean signals, while the effect of using VAD when training a network with both clean and noisy signals improved our previous results by 50%.

Item Type:	Article (Journal)
Additional Information:	5588/73890
Uncontrolled Keywords:	Deep neural network, speech emotion recognition, voice activity detection
Subjects:	T Technology > T Technology (General) T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Electrical and Computer Engineering Kulliyyah of Engineering Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology > Department of Information System Kulliyyah of Information and Communication Technology > Department of Information System
Depositing User:	Prof. Dr. Teddy Surya Gunawan
Date Deposited:	08 Aug 2019 15:46
Last Modified:	26 Feb 2020 16:19
URI:	http://irep.iium.edu.my/id/eprint/73890

Actions (login required)

View Item