Revsine Cambria, Gonzalez-Castillo Javier, Merriam Elisha P, Bandettini Peter A, Ramírez Fernando M
Laboratory of Brain and Cognition, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland 20892.
Department of Psychology, University of Chicago, Chicago, Illinois 60637.
J Neurosci. 2024 Apr 24;44(17):e0296232024. doi: 10.1523/JNEUROSCI.0296-23.2024.
Recognizing faces regardless of their viewpoint is critical for social interactions. Traditional theories hold that view-selective early visual representations gradually become tolerant to viewpoint changes along the ventral visual hierarchy. Newer theories, based on single-neuron monkey electrophysiological recordings, suggest a three-stage architecture including an intermediate face-selective patch abruptly achieving invariance to mirror-symmetric face views. Human studies combining neuroimaging and multivariate pattern analysis (MVPA) have provided convergent evidence of view selectivity in early visual areas. However, contradictory conclusions have been reached concerning the existence in humans of a mirror-symmetric representation like that observed in macaques. We believe these contradictions arise from low-level stimulus confounds and data analysis choices. To probe for low-level confounds, we analyzed images from two face databases. Analyses of image luminance and contrast revealed biases across face views described by even polynomials-i.e., mirror-symmetric. To explain major trends across neuroimaging studies, we constructed a network model incorporating three constraints: cortical magnification, convergent feedforward projections, and interhemispheric connections. Given the identified low-level biases, we show that a gradual increase of interhemispheric connections across network-layers is sufficient to replicate view-tuning in early processing stages and mirror-symmetry in later stages. Data analysis decisions-pattern dissimilarity measure and data recentering-accounted for the inconsistent observation of mirror-symmetry across prior studies. Pattern analyses of human fMRI data (of either sex) revealed biases compatible with our model. The model provides a unifying explanation of MVPA studies of viewpoint selectivity and suggests observations of mirror-symmetry originate from ineffectively normalized signal imbalances across different face views.
无论面部的视角如何都能识别它们,这对社交互动至关重要。传统理论认为,视角选择性的早期视觉表征会沿着腹侧视觉层级逐渐变得对视角变化具有耐受性。基于单神经元猴子电生理记录的更新理论提出了一种三阶段架构,其中包括一个中间的面部选择性区域,它能突然实现对镜像对称面部视角的不变性。结合神经成像和多变量模式分析(MVPA)的人类研究为早期视觉区域的视角选择性提供了趋同的证据。然而,关于人类是否存在像猕猴中观察到的镜像对称表征,已经得出了相互矛盾的结论。我们认为这些矛盾源于低层次的刺激混淆和数据分析选择。为了探究低层次的混淆因素,我们分析了来自两个面部数据库的图像。对图像亮度和对比度的分析揭示了由偶次多项式描述的面部视角偏差,即镜像对称偏差。为了解释神经成像研究中的主要趋势,我们构建了一个包含三个约束条件的网络模型:皮质放大率、汇聚的前馈投射和半球间连接。鉴于已确定的低层次偏差,我们表明跨网络层的半球间连接逐渐增加足以在早期处理阶段复制视角调整,并在后期阶段复制镜像对称。数据分析决策——模式差异度量和数据重新居中——解释了先前研究中对镜像对称观察结果不一致的原因。对人类功能性磁共振成像数据(无论性别)的模式分析揭示了与我们模型相符的偏差。该模型为MVPA关于视角选择性的研究提供了一个统一的解释,并表明对镜像对称的观察结果源于不同面部视角间未有效归一化的信号不平衡。