Liang Yachan, Goudbeek Martijn, Konopka Agnieszka, Choi Jiyoun, Broersma Mirjam
Centre for Language Studies, Radboud University Nijmegen, The Netherlands.
Department of Communication and Cognition, Tilburg University, The Netherlands.
Lang Speech. 2025 Apr 24:238309251318730. doi: 10.1177/00238309251318730.
This study investigates cross-cultural vocal emotion recognition in a corpus with an affectively and linguistically balanced design. It has two main goals, one theoretical and the other methodological. First, it aims to explore the recognition of emotions in two typologically different languages, Dutch and Korean, within and across cultures. Second, it aims to contribute to the methodological development of the study of cross-cultural vocal emotion recognition by presenting a new corpus for Dutch and Korean emotional speech (the Demo/Koremo corpus), containing portrayals of eight emotions differing in arousal, valence, and basicness (joy, pride, tenderness, relief, anger, fear, sadness, irritation) produced by Dutch and Korean actors, and communicated in a single pseudo phrase which was viable in both languages. Dutch and Korean participants listened to recordings of all emotions produced by the Dutch and Korean actors and indicated for each one which emotion they thought it expressed. Both groups of listeners recognized emotions significantly above chance in both languages, but more accurately in their native language, in line with the Dialect Theory of emotion. Low-arousal emotions, negative emotions, and basic emotions were recognized more accurately than their counterparts. While some of these results replicate earlier findings, others-the effect of arousal and the within-cultural effect of valence and basicness-had not been previously investigated. This study provides new insights in cross-cultural vocal emotion recognition and contributes to the methodological toolkit of intercultural emotion recognition research.
本研究在一个情感和语言平衡设计的语料库中调查跨文化的语音情感识别。它有两个主要目标，一个是理论目标，另一个是方法目标。首先，它旨在探索在两种类型学上不同的语言（荷兰语和韩语）中，文化内部和跨文化的情感识别。其次，它旨在通过呈现一个荷兰语和韩语情感语音的新语料库（Demo/Koremo语料库），为跨文化语音情感识别研究的方法发展做出贡献，该语料库包含荷兰语和韩语演员所表现的八种在唤醒度、效价和基本性方面不同的情感（喜悦、自豪、温柔、宽慰、愤怒、恐惧、悲伤、恼怒），并通过一个在两种语言中都可行的单一伪短语来表达。荷兰语和韩语参与者收听了荷兰语和韩语演员所表现的所有情感的录音，并指出他们认为每种录音表达了哪种情感。两组听众在两种语言中识别情感的准确率都显著高于随机水平，但在母语中识别得更准确，这与情感的方言理论一致。低唤醒度情感、负面情感和基本情感比其他情感识别得更准确。虽然这些结果中的一些重复了早期的发现，但其他结果——唤醒度的影响以及效价和基本性的文化内部影响——以前尚未得到研究。本研究为跨文化语音情感识别提供了新的见解，并为跨文化情感识别研究的方法工具做出了贡献。
