Employing explainability on facial landmarks for autism spectrum disorder diagnosis using deep CNN

Alam, Mohammad Shafiul and Rashid, Muhammad Mahbubur and Ali, Mohammad Yeakub and Yvette, Susiapan (2024) Employing explainability on facial landmarks for autism spectrum disorder diagnosis using deep CNN. In: 5th International Conference on Sustainable Innovation in Engineering and Technology 2023, SIET 2023, 16 August 2023, Kuala Lumpur, Malaysia.

	PDF - Published Version Restricted to Repository staff only Download (986kB) | Request a copy
Preview	PDF - Supplemental Material Download (225kB) | Preview

Abstract

This paper presents a pioneering investigation into the utilization of deep Convolutional Neural Networks (CNNs) for the diagnosis of Autism Spectrum Disorder (ASD), with a specific emphasis on the integration of explainability techniques. While existing research has primarily focused on 2D facial images for ASD diagnosis, this study expands its scope to encompass both 2D and 3D modalities. Notably, the ResNet50V2 model demonstrates a remarkable accuracy of 94.66 ± 1.24 for 2D facial image ASD diagnosis, while the Xception model achieves an accuracy of 85.33 ± 3.09 for 3D images. By incorporating interpretability techniques such as Grad-CAM, the study aims to illuminate the decision-making processes of CNNs, thus enhancing the transparency of diagnostic outcomes. Intriguing patterns in model behavior emerge across various modalities. Both the Xception and ResNet50V2 models exhibit distinct focal points when processing 2D and 3D images, revealing their specific sensitivities to distinct facial features. Nonetheless, challenges persist, as indicated by instances of mispredictions. These discrepancies may arise from the intricate interplay of facial expressions, lighting conditions, and head poses, exacerbated by the interpretability variability of Grad-CAM heatmaps. This study's insights hold potential for refining diagnostic methodologies. Advancements lie in adapting model architectures to account for the intricacies of 2D and 3D modalities, enriching training data to encompass diverse expressions and poses, and addressing the interpretability limitations of heatmaps.

Item Type:	Proceeding Paper (Slide Presentation)
Subjects:	T Technology > T Technology (General) > T173.5 Technology and Islam
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering > Department of Mechatronics Engineering Kulliyyah of Engineering
Depositing User:	Dr Muhammad Rashid
Date Deposited:	04 Nov 2024 14:17
Last Modified:	04 Nov 2024 14:17
URI:	http://irep.iium.edu.my/id/eprint/115451

Actions (login required)

View Item