Developing a multi-modal dataset for deep learning-based neural networks in autism spectrum disorder diagnosis

Rashid, Muhammad Mahbubur and Alam, Mohammad Shafiul and Ali, Mohammad Yeakub and Yvette, Susiapan (2024) Developing a multi-modal dataset for deep learning-based neural networks in autism spectrum disorder diagnosis. In: Proceedings of 5th International Conference on Sustainable Innovation in Engineering and Technology 2023, Kuala Lumpur, Malaysia.

	PDF - Published Version Restricted to Repository staff only Download (854kB) | Request a copy
Preview	PDF - Supplemental Material Download (180kB) | Preview

Abstract

This study introduces a novel multi-modal dataset that has been meticulously curated to significantly improve diagnostic capabilities for Autism Spectrum Disorder (ASD). The dataset is intended to exploit the inherent diagnostic potential of facial images by emphasizing their systematic analysis. It is comprised of video excerpts from the Self- Stimulatory Behavior Dataset (SSBD) demonstrating behaviors such as hand flapping, head banging, and spinning, as well as 50 videos from ASD therapists and specialized educational institutions. In order to establish a comparative baseline, 100 videos from traditional educational contexts were collected for the Normal control group. Face Recognition (FR) pipeline with MTCNN is used for facial recognition, followed by precision-driven cropping, alignment, and scaling stages, resulting in RGB (2D) facial representations. Moreover, the incorporation of 3DDFA-V2 facilitates the transformation of 2D RGB images into a comprehensive 3D dataset by means of depth maps. The dataset contains 173 individuals aged 1 to 11 years in the Normal control group and 123 individuals, including 93 males and 30 females, in the ASD group. The data was divided into training and testing sets, with 1068 training samples and 100 testing samples, respectively. Open access to this dataset for researchers, medical professionals, and technologists will foster collaborative efforts in the evelopment of automated ASD diagnostic methods, leveraging multi-modal data and deep learning to improve diagnostic precision and efficiency

Item Type:	Proceeding Paper (Slide Presentation)
Subjects:	T Technology > TS Manufactures > TS200 Metal manufactures. Metalworking
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering Kulliyyah of Engineering > Department of Mechatronics Engineering
Depositing User:	Dr Muhammad Rashid
Date Deposited:	30 Oct 2024 09:10
Last Modified:	30 Oct 2024 09:17
URI:	http://irep.iium.edu.my/id/eprint/115388

Actions (login required)

View Item