Landsberger David M, Vermeire Katrien, Stupak Natalia, Lavender Annette, Neukam Jonathan, Van de Heyning Paul, Svirsky Mario A
Department of Otolaryngology, New York University School of Medicine, New York, NY, USA.
Department of Communication Sciences & Disorders, Long Island University Brooklyn, Brooklyn, NY, USA.
Ear Hear. 2020 May/Jun;41(3):476-490. doi: 10.1097/AUD.0000000000000771.
Cochlear implants (CIs) restore speech perception in quiet but they also eliminate or distort many acoustic cues that are important for music enjoyment. Unfortunately, quantifying music enjoyment by CI users has been difficult because comparisons must rely on their recollection of music before they lost their hearing. Here, we aimed to assess music enjoyment in CI users using a readily interpretable reference based on acoustic hearing. The comparison was done by testing "single-sided deafness" (SSD) patients who have normal hearing (NH) in one ear and a CI in the other ear. The study also aimed to assess binaural musical enjoyment, with the reference being the experience of hearing with a single NH ear. Three experiments assessed the effect of adding different kinds of input to the second ear: electrical, vocoded, or unmodified.
In experiment 1, music enjoyment in SSD-CI users was investigated using a modified version of the MUSHRA (MUltiple Stimuli with Hidden Reference and Anchor) method. Listeners rated their enjoyment of song segments on a scale of 0 to 200, where 100 represented the enjoyment obtained from a song segment presented to the NH ear, 0 represented a highly degraded version of the same song segment presented to the same ear, and 200 represented enjoyment subjectively rated as twice as good as the 100 reference. Stimuli consisted of acoustic only, electric only, acoustic and electric, as well as other conditions with low pass filtered acoustic stimuli. Acoustic stimulation was provided by headphone to the NH ear and electric stimulation was provided by direct audio input to the subject's speech processor. In experiment 2, the task was repeated using NH listeners who received vocoded stimuli instead of electric stimuli. Experiment 3 tested the effect of adding the same unmodified song segment to the second ear, also in NH listeners.
Music presented through the CI only was very unpleasant, with an average rating of 20. Surprisingly, the combination of the unpleasant CI signal in one ear with acoustic stimulation in the other ear was rated more enjoyable (mean = 123) than acoustic processing alone. Presentation of the same monaural musical signal to both ears in NH listeners resulted with even greater enhancement of the experience compared with presentation to a single ear (mean = 159). Repeating the experiment using a vocoder to one ear of NH listeners resulted in interference rather than enhancement.
Music enjoyment from electric stimulation is extremely poor relative to a readily interpretable NH baseline for CI-SSD listeners. However, the combination of this unenjoyable signal presented through a CI and an unmodified acoustic signal presented to a NH (or near-NH) contralateral ear results in enhanced music enjoyment with respect to the acoustic signal alone. Remarkably, this two-ear enhancement experienced by CI-SSD listeners represents a substantial fraction of the two-ear enhancement seen in NH listeners. This unexpected benefit of electroacoustic auditory stimulation will have to be considered in theoretical accounts of music enjoyment and may facilitate the quest to enhance music enjoyment in CI users.
人工耳蜗(CI)可恢复安静环境下的言语感知,但同时也会消除或扭曲许多对音乐欣赏很重要的声学线索。不幸的是,量化人工耳蜗使用者的音乐欣赏感受一直很困难,因为比较必须依赖于他们对失聪前音乐的回忆。在此,我们旨在基于听觉正常的参考标准来评估人工耳蜗使用者的音乐欣赏感受,该标准易于理解。通过测试“单侧耳聋”(SSD)患者来进行比较,这些患者一只耳朵听力正常(NH),另一只耳朵植入了人工耳蜗。该研究还旨在评估双耳音乐欣赏感受,参考标准是单耳听力正常时的听觉体验。三个实验评估了向第二只耳朵添加不同类型输入(电刺激、声码化或未修改)的效果。
在实验1中,使用修改后的MUSHRA(带有隐藏参考和锚点的多刺激)方法研究了SSD - CI使用者的音乐欣赏感受。听众对歌曲片段的欣赏程度进行0至200的评分,其中100表示从呈现给听力正常耳朵的歌曲片段中获得的欣赏感受,0表示呈现给同一只耳朵的同一歌曲片段的高度退化版本,200表示主观评分比100参考标准好两倍的欣赏感受。刺激包括仅声学刺激、仅电刺激、声学和电刺激,以及其他低通滤波声学刺激的条件。通过耳机向听力正常的耳朵提供声学刺激,通过直接音频输入向受试者的言语处理器提供电刺激。在实验2中,对接受声码化刺激而非电刺激的听力正常听众重复该任务。实验3也在听力正常听众中测试了向第二只耳朵添加相同未修改歌曲片段的效果。
仅通过人工耳蜗呈现的音乐非常令人不悦,平均评分为20。令人惊讶的是,一只耳朵中令人不悦的人工耳蜗信号与另一只耳朵中的声学刺激相结合的评分(平均 = 123)比单独的声学处理更令人愉悦。与单耳呈现相比,在听力正常听众中双耳呈现相同的单声道音乐信号会使体验得到更大增强(平均 = 159)。对听力正常听众的一只耳朵使用声码器重复该实验会导致干扰而非增强。
相对于人工耳蜗 - SSD听众易于理解的听力正常基线,电刺激带来的音乐欣赏感受极差。然而,通过人工耳蜗呈现的这种不令人愉悦的信号与呈现给对侧听力正常(或接近听力正常)耳朵的未修改声学信号相结合,相对于单独的声学信号,会增强音乐欣赏感受。值得注意的是,人工耳蜗 - SSD听众体验到的这种双耳增强占听力正常听众中双耳增强的很大一部分。电声听觉刺激的这种意外益处必须在音乐欣赏的理论解释中加以考虑,并且可能有助于寻求增强人工耳蜗使用者的音乐欣赏感受。