IIUM Repository

Implementation of wavelet analysis on thermal images for affective states recognition of children with autism spectrum disorder

Rusli, Nazreen and Sidek, Shahrul Na'im and Md Yusof, Hazlina and Ishak, Nor Izzati and Khalid, Madihah and Dzulkarnain, Ahmad Aidil Arafat (2020) Implementation of wavelet analysis on thermal images for affective states recognition of children with autism spectrum disorder. IEEE Access, 8. pp. 120818-120834. E-ISSN 2169-3536

PDF (full text) - Published Version
Download (2MB) | Preview
PDF (scopus) - Supplemental Material
Download (481kB) | Preview


Children with Autism Spectrum Disorder are identified as a group of people who has difficulties in socio-emotional interaction. Most of them lack the proper context in producing social response through facial expression and speech. Since emotion is the key for effective social interaction, it is justifiably vital for them to comprehend the correct emotion expressions and recognitions. Emotion is a type of affective states and can be detected through physical reaction and physiological signals. In general, recognition of affective states from physical reaction such as facial expression and speech for autistic children is often unpredictable. Hence, an alternative method of identifying the affective states through physiological signals is proposed. Though considered non-invasive, most of the current recognition methods require sensors to be patched on to the skin body to measure the signals. This would most likely cause discomfort to the children and mask their 'true' affective states. The study proposed the use of thermal imaging modality as a passive medium to analyze the physiological signals associated with the affective states nonobtrusively. The study hypothesized that, the impact of cutaneous temperature changes due to the pulsating blood flow in the blood vessels at the frontal face area measured from the modality could have a direct impact to the different affective states of autistic children. A structured experimental setup was designed to measure thermal imaging data generated from different affective state expressions induced using different sets of audio-video stimuli. A wavelet-based technique for pattern detection in time series was deployed to spot the changes measured from the region of interest. In the study, the affective state model for typical developing children aged between 5 and 9 years old was used as the baseline to evaluate the performance of the affective state classifier for autistic children. The results from the classifier showed the efficacy of the technique and accorded good performance of classification accuracy at 88% in identifying the affective states of autistic children. The results were momentous in distinguishing basic affective states and the information could provide a more effective response towards improving social-emotion interaction amongst the autistic children.

Item Type: Article (Journal)
Additional Information: 3028/82561
Uncontrolled Keywords: Autism, affective states, facial skin temperatures, thermoregulation, thermal images, wavelet.
Subjects: L Education > L Education (General)
T Technology > T Technology (General)
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button): Kulliyyah of Education
Kulliyyah of Education > Department of Curriculum & Instruction
Kulliyyah of Allied Health Sciences
Kulliyyah of Allied Health Sciences > Department of Audiology and Speech-Language Pathology
Kulliyyah of Engineering
Kulliyyah of Engineering > Department of Mechatronics Engineering
Depositing User: Dr. Shahrul Naim Sidek
Date Deposited: 04 Sep 2020 10:57
Last Modified: 12 Apr 2022 08:42
URI: http://irep.iium.edu.my/id/eprint/82561

Actions (login required)

View Item View Item


Downloads per month over past year