Translational Vision Lab, Department of Psychology, Northeastern University, Boston, MA, USA.
The Laboratory for Visual Neuroplasticity, Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, 20 Staniford Street, Boston, MA, 02114, USA.
Sci Rep. 2024 Feb 6;14(1):3074. doi: 10.1038/s41598-024-53642-8.
We investigated the relative influence of image salience and image semantics during the visual search of naturalistic scenes, comparing performance in individuals with cerebral visual impairment (CVI) and controls with neurotypical development. Participants searched for a prompted target presented as either an image or text cue. Success rate and reaction time were collected, and gaze behavior was recorded with an eye tracker. A receiver operating characteristic (ROC) analysis compared the distribution of individual gaze landings based on predictions of image salience (using Graph-Based Visual Saliency) and image semantics (using Global Vectors for Word Representations combined with Linguistic Analysis of Semantic Salience) models. CVI participants were less likely and were slower in finding the target. Their visual search behavior was also associated with a larger visual search area and greater number of fixations. ROC scores were also lower in CVI compared to controls for both model predictions. Furthermore, search strategies in the CVI group were not affected by cue type, although search times and accuracy showed a significant correlation with verbal IQ scores for text-cued searches. These results suggest that visual search patterns in CVI are driven mainly by image salience and provide further characterization of higher-order processing deficits observed in this population.
我们研究了自然场景视觉搜索中图像显著性和图像语义的相对影响,比较了具有脑视觉障碍 (CVI) 的个体和具有神经典型发育的对照组的表现。参与者搜索提示目标,目标以图像或文本提示的形式呈现。收集成功率和反应时间,并使用眼动追踪器记录注视行为。接收者操作特征 (ROC) 分析比较了基于图像显著性预测 (使用基于图的视觉显著性) 和图像语义预测 (使用词向量全局表示与语义显著性的语言分析相结合) 的个体注视着陆分布。CVI 参与者找到目标的可能性较小,速度也较慢。他们的视觉搜索行为也与更大的视觉搜索区域和更多的注视次数有关。与对照组相比,CVI 的 ROC 分数在两种模型预测中均较低。此外,CVI 组的搜索策略不受提示类型的影响,尽管对于文本提示搜索,搜索时间和准确性与言语智商分数呈显著相关。这些结果表明,CVI 中的视觉搜索模式主要由图像显著性驱动,并进一步描述了该人群中观察到的高阶处理缺陷。