Listening effort between auditory-only, visual-only, and auditory-visual speech perception in normal hearing listeners as measured using pupillometry

Jamaluddin, Saiful Adli and Khairol Azmi, Nur Asyiqin and Che Azemin, Mohd Zulfaezal and Ali Hanafiah, Nurlin and O‘Beirne, Greg (2021) Listening effort between auditory-only, visual-only, and auditory-visual speech perception in normal hearing listeners as measured using pupillometry. International Journal of Allied Health Science, 5 (3). p. 2252. E-ISSN 2600-8491

Preview

PDF - Published Version Download (57kB) | Preview

Abstract

Background: Listening effort is the purposeful allocation of the mental resources used to overcome difficulties when listening to speech in a noisy environment. Increased cognitive load may result in decreased speech perception performance and mental fatigue. Pupillometry can be applied to investigate listening effort where changes in pupil diameter can be measured as a function of cognitive load. This study aims to establish the baseline of listening effort in normal hearing young listeners in three modalities of speech perception which are auditory-only (A-only), visualonly (V-only), and auditory-visual (AV). Methodology: In total, 10 participants aged between 22 and 25 years old with normal hearing were recruited in this study. The peak pupil dilation (PPD) and peak latency were recorded throughout speech perception trials which were presented monaurally in three different modalities: auditory-only, visual-only, and auditory-visual speech perception at three different signal-to- noise ratios (SNR). Results: The PPD were largest in A-only modality at low SNRs. In contrast, no effect of PPD were observed in AV and V-only across SNRs. The peak PPD latency across SNRs in AV were inconsistent with previous studies. The finding suggests that the PPD increased significantly with decreasing SNR in A-only modalities. Conclusion: The finding of this study showed PPD, and peak latency systematically increases as SNR decreases in A-only modality, revealing more cognitive effort is exerted at acoustically demanding conditions. Additional data may help to further explore the relationship between listening effort and speechreading.

Item Type:	Article (Meeting Abstract)
Uncontrolled Keywords:	listening effort, pupillometry, speech perception
Subjects:	Q Science > QP Physiology R Medicine > RF Otorhinolaryngology
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Allied Health Sciences Kulliyyah of Allied Health Sciences > Department of Audiology and Speech-Language Pathology Kulliyyah of Allied Health Sciences > Department of Optometry and Visual Science
Depositing User:	DR. SAIFUL ADLI JAMALUDDIN
Date Deposited:	25 Aug 2021 10:50
Last Modified:	25 Aug 2021 10:51
URI:	http://irep.iium.edu.my/id/eprint/91722

Actions (login required)

View Item