Liuzzi Antonietta Gabriella, Meersmans Karen, Storms Gerrit, De Deyne Simon, Dupont Patrick, Vandenberghe Rik
Laboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, Belgium.
Laboratory of Experimental Psychology, KU Leuven, Leuven, Belgium.
Neurobiol Lang (Camb). 2023 Apr 11;4(2):257-279. doi: 10.1162/nol_a_00095. eCollection 2023.
Word valence is one of the principal dimensions in the organization of word meaning. Co-occurrence-based similarities calculated by predictive natural language processing models are relatively poor at representing affective content, but very powerful in their own way. Here, we determined how these two canonical but distinct ways of representing word meaning relate to each other in the human brain both functionally and neuroanatomically. We re-analysed an fMRI study of word valence. A co-occurrence-based model was used and the correlation with the similarity of brain activity patterns was compared to that of affective similarities. The correlation between affective and co-occurrence-based similarities was low ( = 0.065), confirming that affect was captured poorly by co-occurrence modelling. In a whole-brain representational similarity analysis, word embedding similarities correlated significantly with the similarity between activity patterns in a region confined to the superior temporal sulcus to the left, and to a lesser degree to the right. Affective word similarities correlated with the similarity in activity patterns in this same region, confirming previous findings. The affective similarity effect extended more widely beyond the superior temporal cortex than the effect of co-occurrence-based similarities did. The effect of co-occurrence-based similarities remained unaltered after partialling out the effect of affective similarities (and vice versa). To conclude, different aspects of word meaning, derived from affective judgements or from word co-occurrences, are represented in superior temporal language cortex in a neuroanatomically overlapping but functionally independent manner.
词效价是词义组织的主要维度之一。通过预测性自然语言处理模型计算的基于共现的相似度在表示情感内容方面相对较差,但在其自身方式上非常强大。在这里,我们确定了这两种典型但不同的词义表示方式在人类大脑中在功能和神经解剖学上是如何相互关联的。我们重新分析了一项关于词效价的功能磁共振成像研究。使用了基于共现的模型,并将其与大脑活动模式相似度的相关性与情感相似度的相关性进行了比较。情感相似度与基于共现的相似度之间的相关性较低(=0.065),这证实了共现建模对情感的捕捉较差。在全脑表征相似性分析中,词嵌入相似度与左颞上沟局限区域内活动模式之间的相似度显著相关,在较小程度上与右颞上沟区域的活动模式相似度相关。情感词相似度与同一区域内活动模式的相似度相关,证实了先前的研究结果。情感相似性效应比基于共现的相似性效应在颞上叶皮质之外扩展得更广。在排除情感相似性效应后,基于共现的相似性效应保持不变(反之亦然)。总之,源自情感判断或词共现的词义的不同方面在颞上语言皮质中以神经解剖学上重叠但功能上独立的方式得到表征。