Wu Meng-Huan, Anderson Andrew J, Jacobs Robert A, Raizada Rajeev D S
Department of Brain & Cognitive Sciences, University of Rochester, Rochester, New York, USA.
Department of Neuroscience, University of Rochester, Rochester, New York, USA.
Neurobiol Lang (Camb). 2022 Feb 10;3(1):1-17. doi: 10.1162/nol_a_00045. eCollection 2022.
Analogical reasoning, for example, inferring that is to as is to , plays a fundamental role in human cognition. However, whether brain activity patterns of individual words are encoded in a way that could facilitate analogical reasoning is unclear. Recent advances in computational linguistics have shown that information about analogical problems can be accessed by simple addition and subtraction of word embeddings (e.g., = + - ). Critically, this property emerges in artificial neural networks that were not trained to produce analogies but instead were trained to produce general-purpose semantic representations. Here, we test whether such emergent property can be observed in representations in human brains, as well as in artificial neural networks. fMRI activation patterns were recorded while participants viewed isolated words but did not perform analogical reasoning tasks. Analogy relations were constructed from word pairs that were categorically or thematically related, and we tested whether the predicted fMRI pattern calculated with simple arithmetic was more correlated with the pattern of the target word than other words. We observed that the predicted fMRI patterns contain information about not only the identity of the target word but also its category and theme (e.g., teaching-related). In summary, this study demonstrated that information about analogy questions can be reliably accessed with the addition and subtraction of fMRI patterns, and that, similar to word embeddings, this property holds for task-general patterns elicited when participants were not explicitly told to perform analogical reasoning.
例如,类比推理(即推断“对于” 就如同“对于” 一样)在人类认知中起着基础性作用。然而,单个单词的大脑活动模式是否以一种有助于类比推理的方式进行编码尚不清楚。计算语言学的最新进展表明,类比问题的信息可以通过单词嵌入的简单加减法来获取(例如, = + - )。关键的是,这种特性出现在未经训练以产生类比而是训练以产生通用语义表征的人工神经网络中。在此,我们测试这种涌现特性是否能在人类大脑的表征以及人工神经网络中被观察到。在参与者观看孤立单词但不执行类比推理任务时记录功能磁共振成像(fMRI)激活模式。类比关系由分类或主题相关的单词对构建而成,并且我们测试用简单算术计算出的预测fMRI模式与目标单词的模式相比是否与其他单词的模式更相关。我们观察到,预测的fMRI模式不仅包含有关目标单词身份的信息,还包含其类别和主题(例如,与教学相关)的信息。总之,本研究表明,关于类比问题的信息可以通过fMRI模式的加减法可靠地获取,并且与单词嵌入类似,当参与者未被明确告知执行类比推理时,这种特性适用于所引发的任务通用模式。