Islam Md Nahidul, Sulaiman Norizam, Farid Fahmid Al, Uddin Jia, Alyami Salem A, Rashid Mamunur, P P Abdul Majeed Anwar, Moni Mohammad Ali
Faculty of Electrical and Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Pahang, Malaysia.
Faculty of Computing and Informatics, Multimedia University, Malaysia.
PeerJ Comput Sci. 2021 Sep 29;7:e638. doi: 10.7717/peerj-cs.638. eCollection 2021.
Hearing deficiency is the world's most common sensation of impairment and impedes human communication and learning. Early and precise hearing diagnosis using electroencephalogram (EEG) is referred to as the optimum strategy to deal with this issue. Among a wide range of EEG control signals, the most relevant modality for hearing loss diagnosis is auditory evoked potential (AEP) which is produced in the brain's cortex area through an auditory stimulus. This study aims to develop a robust intelligent auditory sensation system utilizing a pre-train deep learning framework by analyzing and evaluating the functional reliability of the hearing based on the AEP response. First, the raw AEP data is transformed into time-frequency images through the wavelet transformation. Then, lower-level functionality is eliminated using a pre-trained network. Here, an improved-VGG16 architecture has been designed based on removing some convolutional layers and adding new layers in the fully connected block. Subsequently, the higher levels of the neural network architecture are fine-tuned using the labelled time-frequency images. Finally, the proposed method's performance has been validated by a reputed publicly available AEP dataset, recorded from sixteen subjects when they have heard specific auditory stimuli in the left or right ear. The proposed method outperforms the state-of-art studies by improving the classification accuracy to 96.87% (from 57.375%), which indicates that the proposed improved-VGG16 architecture can significantly deal with AEP response in early hearing loss diagnosis.
听力缺陷是世界上最常见的感觉障碍,会妨碍人际交流和学习。使用脑电图(EEG)进行早期精确的听力诊断被认为是解决这一问题的最佳策略。在众多的EEG控制信号中,与听力损失诊断最相关的模态是听觉诱发电位(AEP),它是通过听觉刺激在大脑皮层区域产生的。本研究旨在通过基于AEP反应分析和评估听力的功能可靠性,利用预训练的深度学习框架开发一个强大的智能听觉感知系统。首先,通过小波变换将原始AEP数据转换为时频图像。然后,使用预训练网络消除低级功能。在此,基于去除一些卷积层并在全连接块中添加新层,设计了一种改进的VGG16架构。随后,使用标记的时频图像对神经网络架构的更高层进行微调。最后,通过一个著名的公开可用AEP数据集验证了所提方法的性能,该数据集记录了16名受试者在左耳或右耳听到特定听觉刺激时的情况。所提方法将分类准确率从57.375%提高到96.87%,优于现有研究,这表明所提的改进VGG16架构在早期听力损失诊断中能够显著处理AEP反应。