IIUM Repository

Evaluation of simultaneous identity, age and gender recognition for crowd face monitoring

Abir, Intiaz Mohammad and Mohd Zaki, Hasan Firdaus and Mohd Ibrahim, Azhar (2023) Evaluation of simultaneous identity, age and gender recognition for crowd face monitoring. ASEAN Engineering Journal, 13 (1). pp. 11-20. E-ISSN 2586-9159

[img] PDF (Article) - Published Version
Restricted to Registered users only

Download (3MB) | Request a copy
PDF (Scopus) - Supplemental Material
Download (677kB) | Preview


Nowadays, facial recognition combined with age estimation and gender prediction has been deeply involved with the factors associated with crowd monitoring. This is considered to be a major and complex job for humans. This paper proposes a unified facial recognition system based on already available deep learning and machine learning models (i.e., FaceNet, ResNet, Support Vector Machine, AgeNet and GenderNet) that automatically and simultaneously performs person identification, age estimation and gender prediction. Then the system is evaluated on a newly proposed multi-face, realistic and challenging test dataset. The current face recognition technology primarily focuses on static datasets of known identities and does not focus on novel identities. This approach is not suitable for continuous crowd monitoring. In our proposed system, whenever novel identities are found during inference, the system will save those novel identities with an appropriate label for each unique identity and the system will be updated periodically in order to correctly recognise those identities in the future inference iterations. However, extracting the facial features of the whole dataset whenever a new identity is detected is not an efficient solution. To address this issue, we propose an incremental feature extraction based training method which aims to reduce the computational load of feature extraction. When tested on the proposed test dataset, our proposed system correctly recognizes pre-trained identities, estimates age, and predicts gender with an average accuracy of 49%, 66.5% and 93.54% respectively. We conclude that the evaluated pre-trained models can be sensitive and not robust to uncontrolled environment (e.g., abrupt lighting conditions).

Item Type: Article (Journal)
Uncontrolled Keywords: Age Estimation, Crowd Monitoring, Deep Learning, Facial Recognition, Gender Prediction
Subjects: Q Science > Q Science (General) > Q300 Cybernetics
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button): Kulliyyah of Engineering
Kulliyyah of Engineering > Department of Mechatronics Engineering
Depositing User: Dr. Hasan Firdaus Mohd Zaki
Date Deposited: 13 Mar 2023 10:40
Last Modified: 19 Jun 2023 09:00
URI: http://irep.iium.edu.my/id/eprint/103891

Actions (login required)

View Item View Item


Downloads per month over past year