O'Connell Samantha R, Papadopoulos Julianne M, Inouye Daniel, van der Donk Brandon J, Gan Helena, Goldsworthy Raymond L
Keck School of Medicine of USC,The Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, California 90033.
Keck School of Medicine of USC,The Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, California 90033.
Hear Res. 2025 Mar;458:109196. doi: 10.1016/j.heares.2025.109196. Epub 2025 Jan 27.
Cochlear implants provide the profoundly deaf excellent speech comprehension; however, perception and appreciation of music remains a challenge. Previous work suggests that cochlear implant users, compared to normal-hearing listeners, have diminished perception of certain musically evoked emotions due to deficits in hearing pitch-related musical elements. The purpose of this study was to investigate how well cochlear implants users use pitch-based information to identify the emotional intent of music.
Twenty-six cochlear implant users and 24 peers with no known hearing loss completed a set of online auditory measures. Participants were asked to rate the valence and arousal of 10 happy, 10 sad, 10 scary, and 10 peaceful melodies as categorized by Vieillard et al. (2008). Melodies that were previously categorized as peaceful and sad were then altered from major to minor modes (peaceful to peaceful-modified) and from minor to major (sad to sad-modified), respectively. Additionally, the tempo of these melodies was controlled at 60 beats per minute. Participants then valence and arousal of these 10 sad, 10 sad-modified, 10 peaceful, and 10 peaceful-modified melodies. Participants completed a series pitch perception tasks including major and minor melody and arpeggio discrimination and melodic contour identification. During data analysis, correlations between valence and arousal ratings, major and minor melody and arpeggio discrimination scores, and melodic contour identification scores were assessed.
When listening to the unmodified melodies from Viellaird et al. (2008), both cochlear implant users and those with no known hearing loss rated happy melodies more distinctly in valence and arousal than sad, peaceful, and scary melodies. Cochlear implant users rated the valence of sad and peaceful melodies more similarly compared to those with no known hearing loss. When listening to the modified melodies, cochlear implant users rated original and modified sad and peaceful melodies similarly on the dimensions of valence and arousal. This contrasts with results found in those with no known hearing loss who utilized mode changes to rate melodies in major modes higher in valence than melodies in minor modes. For major and minor melody and arpeggio discrimination, those with no known hearing loss performed close to or at ceiling while cochlear implant users mostly performed in the chance range. Finally, for melodic contour identification, many cochlear implant users performed significantly worse than those with no known hearing loss.
This study further reveals the challenges that cochlear implant patients face in using modal cues to perceive the emotional intent of music. While cochlear implant users are able to utilize tempo cues to derive the emotional intent of melodies to an extent, they struggle once these cues are taken away. Therefore, the data presented here provides a foundation upon which to explore how pitch-based training may improve cochlear implant users' perception of musical mode. Given the ubiquity of using mode to communicate musical emotional intent, pitch-based training may in turn lead to enhanced music appreciation among cochlear implant users.
人工耳蜗能为极重度聋患者提供出色的言语理解能力;然而,对音乐的感知和欣赏仍是一项挑战。先前的研究表明,与听力正常的聆听者相比,人工耳蜗使用者由于在感知与音高相关的音乐元素方面存在缺陷,对某些音乐引发的情感感知有所减弱。本研究的目的是调查人工耳蜗使用者利用基于音高的信息来识别音乐情感意图的能力如何。
26名人工耳蜗使用者和24名无已知听力损失的同龄人完成了一组在线听觉测试。参与者被要求对Vieillard等人(2008年)分类的10首欢快、10首悲伤、10首恐怖和10首平静的旋律的效价和唤醒程度进行评分。先前分类为平静和悲伤的旋律随后分别从大调改为小调(平静改为平静 - 修改版)以及从小调改为大调(悲伤改为悲伤 - 修改版)。此外,这些旋律的节奏被控制在每分钟60拍。参与者随后对这10首悲伤、10首悲伤 - 修改版、10首平静和10首平静 - 修改版旋律的效价和唤醒程度进行评分。参与者完成了一系列音高感知任务,包括大小调旋律和琶音辨别以及旋律轮廓识别。在数据分析过程中,评估了效价和唤醒程度评分、大小调旋律和琶音辨别分数以及旋律轮廓识别分数之间的相关性。
在聆听Viellaird等人(2008年)的未修改旋律时,人工耳蜗使用者和无已知听力损失的人都认为欢快旋律在效价和唤醒程度方面比悲伤、平静和恐怖旋律的区分更明显。与无已知听力损失的人相比,人工耳蜗使用者对悲伤和平静旋律的效价评分更为相似。在聆听修改后的旋律时,人工耳蜗使用者在效价和唤醒程度维度上对原始和修改后的悲伤和平静旋律的评分相似。这与无已知听力损失的人的结果形成对比,他们利用调式变化将大调模式的旋律在效价上的评分高于小调模式的旋律。对于大小调旋律和琶音辨别,无已知听力损失的人表现接近或达到上限,而人工耳蜗使用者大多处于随机水平。最后,对于旋律轮廓识别,许多人工耳蜗使用者的表现明显比无已知听力损失的人差。
本研究进一步揭示了人工耳蜗患者在利用调式线索感知音乐情感意图方面面临的挑战。虽然人工耳蜗使用者能够在一定程度上利用节奏线索来推导旋律的情感意图,但一旦这些线索被去除,他们就会遇到困难。因此,这里呈现的数据为探索基于音高的训练如何改善人工耳蜗使用者对音乐调式的感知提供了基础。鉴于使用调式来传达音乐情感意图的普遍性,基于音高的训练可能反过来提高人工耳蜗使用者的音乐欣赏能力。