Emotion and mood recognition in response to video

Dwi Handayani, Dini Oktarina and Abdul Rahman, Abdul Wahab and Yaacob, Hamwira Sakti (2015) Emotion and mood recognition in response to video. Journal of Mobile Multimedia, 11 (3&4). pp. 296-312. ISSN 1550-4646

PDF - Published Version Restricted to Repository staff only Download (3MB) | Request a copy

Abstract

This paper presents a subject-dependent homogenous emotion recognition method using electroencephalogram (EEG) signals in response to video contents, and a correlation between emotions and moods of subjects in resting state. In the recent years, there has been a trend towards recognizing emotions invoked from watching videos. Thus, in this study, two video clips with explicit emotional contents from movies and online resources were used, and the EEG results were recorded from four subjects as they watched these clips. The best accuracies of 60.71% for valence and 63.73% for arousal were obtained using a Mel-frequency cepstral coefficients (MFCC) and multilayer perceptron (MLP). The results show that MFCC and MLP techniques are applicable in emotion recognition. The result shows that the mood can be recognized from opened eyes or closed eyes experiment of a subject. Furthermore, the results demonstrated that a positive video content can stimulate a subject into being in positive emotional state even when the subject was in bad mood. The emotional state in response to watching a video was shown to be correlated with Self-Assessment Manikin analysis.

Item Type:	Article (Journal)
Additional Information:	6145/48698
Uncontrolled Keywords:	Affective computing, mood, emotion recognition, video clip, EEG
Subjects:	B Philosophy. Psychology. Religion > BF Psychology > BF511 Affection. Feeling. Emotion T Technology > T Technology (General)
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology > Department of Computer Science
Depositing User:	Dr Hamwira Yaacob
Date Deposited:	19 Feb 2016 16:59
Last Modified:	07 Jun 2016 00:19
URI:	http://irep.iium.edu.my/id/eprint/48698

Actions (login required)

View Item