Development of Image-Based Emotion Recognition using Convolutional Neural Networks

Latif, Atiya and Gunawan, Teddy Surya and Kartiwi, Mira and Arifin, Fatchul and Mansor, Hasmah (2021) Development of Image-Based Emotion Recognition using Convolutional Neural Networks. In: 2021 IEEE 7th International Conference on Smart Instrumentation, Measurement and Applications, Bandung, Indonesia.

	PDF Restricted to Registered users only Download (701kB) | Request a copy
	PDF (SCOPUS) - Supplemental Material Restricted to Registered users only Download (399kB) | Request a copy

Abstract

In recent years, artificial intelligence has been utilized in many applications. One of the prominent applications is detecting emotion from an image, which can help an intelligent automatic response system respond appropriately based on the user’s emotion. This paper presented the development of emotion recognition using Convolutional Neural Networks (CNN) on image input. First, the extended Cohn-Kanade image emotion database was selected with five defined emotions: happy, sad, anger, fear, surprise, and neutral. Second, face detection and facial landmarks extraction was applied to the input image. Then, the AlexNet model is used as the selected deep learning architecture for transfer learning. Results showed that around 98.2% recognition accuracy could be achieved. Furthermore, precision, recall, and F1-score were evaluated, and it showed the effectiveness of our proposed algorithm.

Item Type:	Conference or Workshop Item (Invited Papers)
Uncontrolled Keywords:	Emotion Recognition, Convolutional Neural Networks (CNN), Transfer Learning, Face Detection
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Electrical and Computer Engineering Kulliyyah of Information and Communication Technology > Department of Information System Kulliyyah of Information and Communication Technology > Department of Information System
Depositing User:	Prof. Dr. Teddy Surya Gunawan
Date Deposited:	14 Sep 2021 11:50
Last Modified:	07 Oct 2021 08:25
URI:	http://irep.iium.edu.my/id/eprint/92218

Actions (login required)

View Item