Ong Jia Hoong, Leung Florence Yik Nam, Liu Fang
School of Psychology and Clinical Language Sciences, University of Reading, Harry Pitt Building, Earley Gate, Reading, RG6 6AL UK.
Department of Psychology, School of Social Sciences, Nottingham Trent University, Nottingham, UK.
Lang Resour Eval. 2025;59(1):27-49. doi: 10.1007/s10579-023-09698-5. Epub 2023 Nov 20.
Most audio-visual (AV) emotion databases consist of clips that do not reflect real-life emotion processing (e.g., professional actors in bright studio-like environment), contain only spoken clips, and none have sung clips that express complex emotions. Here, we introduce a new AV database, the Reading Everyday Emotion Database (REED), which directly addresses those gaps. We recorded the faces of everyday adults with a diverse range of acting experience expressing 13 emotions-neutral, the six basic emotions (angry, disgusted, fearful, happy, sad, surprised), and six complex emotions (embarrassed, hopeful, jealous, proud, sarcastic, stressed)-in two auditory domains (spoken and sung) using everyday recording devices (e.g., laptops, mobile phones, etc.). The recordings were validated by an independent group of raters. We found that: intensity ratings of the recordings were positively associated with recognition accuracy; and the basic emotions, as well as the Neutral and Sarcastic emotions, were recognised more accurately than the other complex emotions. Emotion recognition accuracy also differed by utterance. Exploratory analysis revealed that recordings of those with drama experience were better recognised than those without. Overall, this database will benefit those who need AV clips with natural variations in both emotion expressions and recording environment.
The online version contains supplementary material available at 10.1007/s10579-023-09698-5.
大多数视听（AV）情感数据库由不能反映现实生活中情感处理的片段组成（例如，在类似明亮演播室环境中的专业演员），仅包含口语片段，且没有一个包含表达复杂情感的歌唱片段。在此，我们引入了一个新的视听数据库——日常阅读情感数据库（REED），它直接填补了这些空白。我们使用日常录音设备（如笔记本电脑、手机等），在两个听觉领域（口语和歌唱）记录了具有不同表演经验的日常成年人表达13种情感——中性、六种基本情感（愤怒、厌恶、恐惧、快乐、悲伤、惊讶）和六种复杂情感（尴尬、希望、嫉妒、骄傲、讽刺、压力）时的面部表情。这些记录由一组独立的评分者进行了验证。我们发现：记录的强度评分与识别准确率呈正相关；基本情感以及中性和讽刺情感比其他复杂情感识别得更准确。情感识别准确率也因话语而异。探索性分析表明，有戏剧经验者的记录比没有戏剧经验者的记录识别效果更好。总体而言，该数据库将使那些需要在情感表达和录音环境方面具有自然变化的视听片段的人受益。
在线版本包含可在10.1007/s10579-023-09698-5获取的补充材料。
