Massachusetts Institute of Technology, MIT Media Lab, Cambridge, MA, USA.
Massachusetts Institute of Technology, Lincoln Laboratory, Lexington, MA, USA.
Sci Data. 2023 Aug 5;10(1):523. doi: 10.1038/s41597-023-02405-7.
Nonverbal vocalizations, such as sighs, grunts, and yells, are informative expressions within typical verbal speech. Likewise, individuals who produce 0-10 spoken words or word approximations ("minimally speaking" individuals) convey rich affective and communicative information through nonverbal vocalizations even without verbal speech. Yet, despite their rich content, little to no data exists on the vocal expressions of this population. Here, we present ReCANVo: Real-World Communicative and Affective Nonverbal Vocalizations - a novel dataset of non-speech vocalizations labeled by function from minimally speaking individuals. The ReCANVo database contains over 7000 vocalizations spanning communicative and affective functions from eight minimally speaking individuals, along with communication profiles for each participant. Vocalizations were recorded in real-world settings and labeled in real-time by a close family member who knew the communicator well and had access to contextual information while labeling. ReCANVo is a novel database of nonverbal vocalizations from minimally speaking individuals, the largest available dataset of nonverbal vocalizations, and one of the only affective speech datasets collected amidst daily life across contexts.
非言语发声，如叹气、嘟囔和叫喊，是典型言语中的信息表达。同样，那些只能说出 0-10 个单词或近似单词的人（“最小言语”个体），即使没有言语，也能通过非言语发声传达丰富的情感和交际信息。然而，尽管这些发声内容丰富，但针对这一人群的发声表达，几乎没有数据。在这里，我们提出了 ReCANVo：真实世界交际和情感非言语发声——这是一个来自最小言语个体的、按功能标注的非言语发声新数据集。ReCANVo 数据库包含了来自八个最小言语个体的超过 7000 种交际和情感功能的发声，以及每个参与者的交际情况简介。发声是在真实环境中录制的，并由一位非常了解交际者的亲密家庭成员实时标注，在标注的同时还可以获取上下文信息。ReCANVo 是一个最小言语个体的非言语发声新数据库，是目前最大的非言语发声数据集之一，也是唯一一个在日常生活背景下收集的情感言语数据集之一。
