Center for Brain Disorders and Cognitive Sciences, Shenzhen University, Shenzhen 518060, China; Center for Language and Brain, Shenzhen Institute of Neuroscience, Shenzhen 518060, China.
Department of Chinese and Bilingual Studies, Faculty of Humanities, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China.
Brain Lang. 2021 Apr;215:104922. doi: 10.1016/j.bandl.2021.104922. Epub 2021 Feb 5.
The approach of cross-language brain decoding is to use models of brain decoding from one language to decode stimuli of another language. It has the potential to provide new insights into how our brain represents multiple languages. While it is possible to decode semantic information across different languages from neuroimaging data, the approach's overall success remains to be tested and depends on a number of factors such as cross-language similarity, age of acquisition/proficiency levels, and depth of language processing. We expect to see continued progress in this domain, from a traditional focus on words and concrete concepts toward the use of naturalistic experimental tasks involving higher-level language processing (e.g., discourse processing). The approach can also be applied to understand how cross-modal, cross-cultural, and other nonlinguistic factors may influence neural representations of different languages. This article provides an overview of cross-language brain decoding with suggestions for future research directions.
跨语言大脑解码的方法是使用一种语言的大脑解码模型来对另一种语言的刺激进行解码。它有可能为我们大脑如何表示多种语言提供新的见解。虽然从神经影像学数据中解码不同语言的语义信息是可能的,但该方法的整体成功仍有待检验,并且取决于许多因素,例如跨语言的相似性、习得/熟练程度、语言处理的深度等。我们预计在这个领域会继续取得进展,从传统的专注于单词和具体概念,转向使用涉及更高层次语言处理的自然实验任务(例如,语篇处理)。该方法还可用于了解跨模态、跨文化和其他非语言因素如何可能影响不同语言的神经表示。本文对跨语言大脑解码进行了概述,并为未来的研究方向提出了建议。