Bovery Matthieu, Dawson Geraldine, Hashemi Jordan, Sapiro Guillermo
EEA Department, ENS Paris-Saclay, Cachan, FRANCE. He performed this work while visiting Duke University.
Department of Psychiatry and Behavioral Sciences, Duke Center for Autism and Brain Development, and the Duke Institute for Brain Sciences, Durham, NC.
IEEE Trans Affect Comput. 2021 Jul-Sep;12(3):722-731. doi: 10.1109/taffc.2018.2890610. Epub 2019 Jan 1.
Autism spectrum disorder (ASD) is associated with deficits in the processing of social information and difficulties in social interaction, and individuals with ASD exhibit atypical attention and gaze. Traditionally, gaze studies have relied upon precise and constrained means of monitoring attention using expensive equipment in laboratories. In this work we develop a low-cost off-the-shelf alternative for measuring attention that can be used in natural settings. The head and iris positions of 104 16-31 months children, an age range appropriate for ASD screening and diagnosis, 22 of them diagnosed with ASD, were recorded using the front facing camera in an iPad while they watched on the device screen a movie displaying dynamic stimuli, social stimuli on the left and nonsocial stimuli on the right. The head and iris position were then automatically analyzed via computer vision algorithms to detect the direction of attention. Children in the ASD group paid less attention to the movie, showed less attention to the social as compared to the nonsocial stimuli, and often fixated their attention to one side of the screen. The proposed method provides a low-cost means of monitoring attention to properly designed stimuli, demonstrating that the integration of stimuli design and automatic response analysis results in the opportunity to use off-the-shelf cameras to assess behavioral biomarkers.
自闭症谱系障碍(ASD)与社会信息处理缺陷及社交互动困难相关,患有ASD的个体表现出非典型的注意力和注视模式。传统上,注视研究依赖于在实验室中使用昂贵设备来精确且受限地监测注意力。在这项研究中,我们开发了一种低成本的现成替代方法来测量注意力,该方法可用于自然环境。我们使用iPad前置摄像头记录了104名16至31个月大儿童(这个年龄段适合进行ASD筛查和诊断,其中22名被诊断为患有ASD)的头部和虹膜位置,这些儿童在设备屏幕上观看一部播放动态刺激的影片,影片左侧为社交刺激,右侧为非社交刺激。然后通过计算机视觉算法自动分析头部和虹膜位置,以检测注意力方向。与非社交刺激相比,ASD组儿童对影片的关注度较低,对社交刺激的关注度也较低,并且经常将注意力集中在屏幕的一侧。所提出的方法提供了一种低成本手段来监测对精心设计刺激的注意力,表明刺激设计与自动反应分析相结合为利用现成摄像头评估行为生物标志物创造了机会。