Development of video-based emotion recognition system using transfer learning

Gunawan, Teddy Surya and Muktaruddin, Muhammad Nuruddin and Kartiwi, Mira and Ahmad, Yasser Asrul and Rosahdi, Tina Dewi and Ulfiah, Ulfiah (2022) Development of video-based emotion recognition system using transfer learning. In: 2022 IEEE 8th International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA), 26-28 September 2022, Melaka.

	PDF - Published Version Restricted to Registered users only Download (311kB)
Preview	PDF Download (77kB) | Preview

Abstract

Due to the complexity of its system and the numerous advantages of its implementation, video emotion identification is a popular area of study today. There have been multiple ways implemented. In this project, emotion recognition in videos will be performed using deep learning. The model will include initialization, feature extraction, emotion categorization, and prediction. LeNet and AlexNet, two distinct neural networks, are used to extract features and classify emotions. There will be some parameter tuning to determine if it enhances the employed architecture’s performance, including optimizers and batch size. Each architecture for deep learning will generate a final forecast of four fundamental emotions: disgust, happiness, sadness, and surprise. AlexNet’s performance is enhanced by the SGD optimizer, whereas RMSprop improves LeNet’s performance. Results showed that AlexNet with SGD optimizer provides 93.00% recognition accuracy.

Item Type:	Conference or Workshop Item (Invited Papers)
Additional Information:	Collaborative work international with UIN Sunan Gunung Djati, Indonesia.
Uncontrolled Keywords:	emotion recognition, transfer learning, AlexNet, LeNet, accuracy
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Electrical and Computer Engineering Kulliyyah of Information and Communication Technology > Department of Information System Kulliyyah of Information and Communication Technology > Department of Information System
Depositing User:	Prof. Dr. Teddy Surya Gunawan
Date Deposited:	23 Dec 2022 16:26
Last Modified:	23 Dec 2022 16:26
URI:	http://irep.iium.edu.my/id/eprint/101865

Actions (login required)

View Item