The Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 91904, Israel.
Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot 7610001, Israel.
Proc Natl Acad Sci U S A. 2022 May 17;119(20):e2117184119. doi: 10.1073/pnas.2117184119. Epub 2022 May 12.
Gaze understanding—a suggested precursor for understanding others’ intentions—requires recovery of gaze direction from the observed person's head and eye position. This challenging computation is naturally acquired at infancy without explicit external guidance, but can it be learned later if vision is extremely poor throughout early childhood? We addressed this question by studying gaze following in Ethiopian patients with early bilateral congenital cataracts diagnosed and treated by us only at late childhood. This sight restoration provided a unique opportunity to directly address basic issues on the roles of “nature” and “nurture” in development, as it caused a selective perturbation to the natural process, eliminating some gaze-direction cues while leaving others still available. Following surgery, the patients’ visual acuity typically improved substantially, allowing discrimination of pupil position in the eye. Yet, the patients failed to show eye gaze-following effects and fixated less than controls on the eyes—two spontaneous behaviors typically seen in controls. Our model for unsupervised learning of gaze direction explains how head-based gaze following can develop under severe image blur, resembling preoperative conditions. It also suggests why, despite acquiring sufficient resolution to extract eye position, automatic eye gaze following is not established after surgery due to lack of detailed early visual experience. We suggest that visual skills acquired in infancy in an unsupervised manner will be difficult or impossible to acquire when internal guidance is no longer available, even when sufficient image resolution for the task is restored. This creates fundamental barriers to spontaneous vision recovery following prolonged deprivation in early age.
凝视理解——理解他人意图的一个建议性前提——需要从被观察人的头部和眼睛位置恢复注视方向。这种具有挑战性的计算在婴儿期是自然获得的,无需外部的明确指导,但如果整个幼儿期视力极差,以后是否可以学习呢?我们通过研究我们在晚期儿童时期诊断和治疗的埃塞俄比亚双侧先天性白内障患者的目光追随来解决这个问题。这种视力恢复提供了一个独特的机会,可以直接解决关于“天性”和“教养”在发展中的作用的基本问题,因为它选择性地干扰了自然过程,消除了一些注视方向的线索,同时仍然保留了其他线索。手术后,患者的视力通常会显著提高,能够分辨眼睛中的瞳孔位置。然而,与对照组相比,患者未能表现出目光追随效应,并且注视眼睛的时间也少于对照组——这是对照组中常见的两种自发行为。我们用于无监督学习注视方向的模型解释了在严重的图像模糊下,如何在头为基础的注视跟随下发展。它还表明了为什么尽管获得了足够的分辨率来提取眼睛位置,但由于缺乏早期详细的视觉经验,手术后自动的眼睛注视跟随并没有建立。我们认为,即使任务的图像分辨率得到恢复,当内部指导不再可用时,婴儿期以无监督方式获得的视觉技能也将难以或不可能获得,即使任务的图像分辨率得到恢复。这为早期长期剥夺后自发视力恢复制造了根本性的障碍。