Zhang Lian, Wade Joshua, Bian Dayi, Fan Jing, Swanson Amy, Weitlauf Amy, Warren Zachary, Sarkar Nilanjan
Department of Electrical Engineering and Computer Science Department, Vanderbilt University, Nashville, TN, USA.
Vanderbilt Kennedy Center, Treatment and Research Institute for Autism Spectrum Disorders, Vanderbilt University, Nashville, TN, USA.
IEEE Trans Affect Comput. 2017 Apr-Jun;8(2):176-189. doi: 10.1109/TAFFC.2016.2582490. Epub 2017 May 23.
Autism Spectrum Disorder (ASD) is a highly prevalent neurodevelopmental disorder with enormous individual and social cost. In this paper, a novel virtual reality (VR)-based driving system was introduced to teach driving skills to adolescents with ASD. This driving system is capable of gathering eye gaze, electroencephalography, and peripheral physiology data in addition to driving performance data. The objective of this paper is to fuse multimodal information to measure cognitive load during driving such that driving tasks can be individualized for optimal skill learning. Individualization of ASD intervention is an important criterion due to the spectrum nature of the disorder. Twenty adolescents with ASD participated in our study and the data collected were used for systematic feature extraction and classification of cognitive loads based on five well-known machine learning methods. Subsequently, three information fusion schemes-feature level fusion, decision level fusion and hybrid level fusion-were explored. Results indicate that multimodal information fusion can be used to measure cognitive load with high accuracy. Such a mechanism is essential since it will allow individualization of driving skill training based on cognitive load, which will facilitate acceptance of this driving system for clinical use and eventual commercialization.
自闭症谱系障碍(ASD)是一种高度普遍的神经发育障碍,会给个人和社会带来巨大代价。本文介绍了一种基于虚拟现实(VR)的新型驾驶系统,用于向患有ASD的青少年传授驾驶技能。该驾驶系统除了能够收集驾驶性能数据外,还能收集注视、脑电图和外周生理数据。本文的目的是融合多模态信息以测量驾驶过程中的认知负荷,从而使驾驶任务能够个性化,以实现最佳技能学习。由于该障碍的谱系性质,ASD干预的个性化是一个重要标准。20名患有ASD的青少年参与了我们的研究,所收集的数据用于基于五种著名机器学习方法进行系统的特征提取和认知负荷分类。随后,探索了三种信息融合方案——特征级融合、决策级融合和混合级融合。结果表明,多模态信息融合可用于高精度测量认知负荷。这样一种机制至关重要,因为它将允许基于认知负荷对驾驶技能训练进行个性化,这将有助于该驾驶系统被临床接受并最终实现商业化。
IEEE Trans Affect Comput. 2017
IEEE Trans Biomed Eng. 2017-4-12
Annu Int Conf IEEE Eng Med Biol Soc. 2015-8
Behav Sci (Basel). 2024-1-23
Medicina (B Aires). 2024-3
IEEE Trans Neural Syst Rehabil Eng. 2012-9-27
Cell Rep Med. 2025-2-18
J Autism Dev Disord. 2025-6
Behav Sci (Basel). 2024-1-23
Front Neurosci. 2021-5-24
Entropy (Basel). 2020-5-12
Entropy (Basel). 2019-4-28
Curr Opin Neurol. 2013-4
IEEE Trans Neural Syst Rehabil Eng. 2011-8
J Neurosci Methods. 2011-7-27
IEEE Trans Neural Syst Rehabil Eng. 2011-6-23
IEEE Trans Neural Syst Rehabil Eng. 2011-5-23
Psychol Sci. 2009-10-14