Chen Catherine, Dupré la Tour Tom, Gallant Jack L, Klein Dan, Deniz Fatma
Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA.
Helen Wills Neuroscience Institute, University of California, Berkeley, USA.
bioRxiv. 2023 Dec 11:2023.01.06.522601. doi: 10.1101/2023.01.06.522601.
Language comprehension involves integrating low-level sensory inputs into a hierarchy of increasingly high-level features. Prior work studied brain representations of different levels of the language hierarchy, but has not determined whether these brain representations are shared between written and spoken language. To address this issue, we analyzed fMRI BOLD data recorded while participants read and listened to the same narratives in each modality. Levels of the language hierarchy were operationalized as , where each timescale refers to a set of spectral components of a language stimulus. Voxelwise encoding models were used to determine where different timescales are represented across the cerebral cortex, for each modality separately. These models reveal that between the two modalities timescale representations are organized similarly across the cortical surface. Our results suggest that, after low-level sensory processing, language integration proceeds similarly regardless of stimulus modality.
语言理解涉及将低级感官输入整合到一个层次越来越高的特征层级中。先前的研究探讨了语言层级不同水平的大脑表征，但尚未确定这些大脑表征在书面语言和口头语言之间是否共享。为了解决这个问题，我们分析了参与者在每种模态下阅读和聆听相同叙述时记录的功能磁共振成像血氧水平依赖（fMRI BOLD）数据。语言层级水平被定义为 ，其中每个时间尺度指的是语言刺激的一组频谱成分。逐体素编码模型被用于分别确定每种模态下不同时间尺度在大脑皮层中的表征位置。这些模型表明，在两种模态之间，时间尺度表征在整个皮层表面的组织方式相似。我们的结果表明，在低级感官处理之后，无论刺激模态如何，语言整合的过程都是相似的。
