Suppr超能文献

在具有不同滤波器斜率的人工耳蜗模拟中,对带有不同声学线索的情感感知和聚焦韵律。

The perception of emotion and focus prosody with varying acoustic cues in cochlear implant simulations with varying filter slopes.

作者信息

van de Velde Daan J, Schiller Niels O, van Heuven Vincent J, Levelt Claartje C, van Ginkel Joost, Beers Mieke, Briaire Jeroen J, Frijns Johan H M

机构信息

Leiden University Centre for Linguistics, Leiden University, Van Wijkplaats 3, 2311 BX, Leiden, the Netherlands.

Department of Applied Linguistics, Pannon Egyetem, 10 Egyetem Utca, 8200 Veszprém, Hungary.

出版信息

J Acoust Soc Am. 2017 May;141(5):3349. doi: 10.1121/1.4982198.

Abstract

This study aimed to find the optimal filter slope for cochlear implant simulations (vocoding) by testing the effect of a wide range of slopes on the discrimination of emotional and linguistic (focus) prosody, with varying availability of F0 and duration cues. Forty normally hearing participants judged if (non-)vocoded sentences were pronounced with happy or sad emotion, or with adjectival or nominal focus. Sentences were recorded as natural stimuli and manipulated to contain only emotion- or focus-relevant segmental duration or F0 information or both, and then noise-vocoded with 5, 20, 80, 120, and 160 dB/octave filter slopes. Performance increased with steeper slopes, but only up to 120 dB/octave, with bigger effects for emotion than for focus perception. For emotion, results with both cues most closely resembled results with F0, while for focus results with both cues most closely resembled those with duration, showing emotion perception relies primarily on F0, and focus perception on duration. This suggests that filter slopes affect focus perception less than emotion perception because for emotion, F0 is both more informative and more affected. The performance increase until extreme filter slope values suggests that much performance improvement in prosody perception is still to be gained for CI users.

摘要

本研究旨在通过测试一系列斜率对情感和语言(焦点)韵律辨别力的影响,来寻找人工耳蜗模拟(语音编码)的最佳滤波器斜率,其中F0和时长线索的可用性各不相同。40名听力正常的参与者判断(非)语音编码的句子是用快乐还是悲伤的情绪发音,或者是用形容词或名词焦点发音。句子被记录为自然刺激,并进行处理,使其仅包含与情感或焦点相关的片段时长或F0信息或两者兼有,然后用5、20、80、120和160 dB/倍频程的滤波器斜率进行噪声语音编码。随着斜率变陡,性能有所提高,但仅在120 dB/倍频程以内,情感方面的影响比焦点感知方面的影响更大。对于情感,两种线索的结果与仅F0线索的结果最为相似,而对于焦点,两种线索的结果与仅时长线索的结果最为相似,这表明情感感知主要依赖于F0,而焦点感知依赖于时长。这表明滤波器斜率对焦点感知的影响小于对情感感知的影响,因为对于情感,F0既更具信息性又受影响更大。在达到极端滤波器斜率值之前性能的提高表明,人工耳蜗使用者在韵律感知方面仍有很大的性能提升空间。

相似文献

2
Voice emotion recognition by cochlear-implanted children and their normally-hearing peers.
Hear Res. 2015 Apr;322:151-62. doi: 10.1016/j.heares.2014.10.003. Epub 2014 Oct 16.
3
Voice emotion perception and production in cochlear implant users.
Hear Res. 2017 Sep;352:30-39. doi: 10.1016/j.heares.2017.01.006. Epub 2017 Jan 11.
4
The effect of spectral smearing on the identification of pure F0 intonation contours in vocoder simulations of cochlear implants.
Cochlear Implants Int. 2015 Mar;16(2):77-87. doi: 10.1179/1754762814Y.0000000086. Epub 2014 Jul 7.
5
Masking release with changing fundamental frequency: Electric acoustic stimulation resembles normal hearing subjects.
Hear Res. 2017 Jul;350:226-234. doi: 10.1016/j.heares.2017.05.004. Epub 2017 May 11.
6
Multimodal and Spectral Degradation Effects on Speech and Emotion Recognition in Adult Listeners.
Trends Hear. 2018 Jan-Dec;22:2331216518804966. doi: 10.1177/2331216518804966.
7
Musical and vocal emotion perception for cochlear implants users.
Hear Res. 2018 Dec;370:272-282. doi: 10.1016/j.heares.2018.08.009. Epub 2018 Aug 25.
8
The perception of stress and intonation in children with a cochlear implant and a hearing aid.
Cochlear Implants Int. 2013 Nov;14 Suppl 4:S35-9. doi: 10.1179/1467010013Z.000000000132.
9
Speech prosody perception in cochlear implant users with and without residual hearing.
Ear Hear. 2015 Mar-Apr;36(2):239-48. doi: 10.1097/AUD.0000000000000105.
10
Perception of Child-Directed Versus Adult-Directed Emotional Speech in Pediatric Cochlear Implant Users.
Ear Hear. 2020 Sep/Oct;41(5):1372-1382. doi: 10.1097/AUD.0000000000000862.

本文引用的文献

2
Speech prosody perception in cochlear implant users with and without residual hearing.
Ear Hear. 2015 Mar-Apr;36(2):239-48. doi: 10.1097/AUD.0000000000000105.
3
The effect of spectral smearing on the identification of pure F0 intonation contours in vocoder simulations of cochlear implants.
Cochlear Implants Int. 2015 Mar;16(2):77-87. doi: 10.1179/1754762814Y.0000000086. Epub 2014 Jul 7.
6
Technological, biological, and acoustical constraints to music perception in cochlear implant users.
Hear Res. 2014 Feb;308:13-26. doi: 10.1016/j.heares.2013.04.009. Epub 2013 May 7.
8
Channel interaction limits melodic pitch perception in simulated cochlear implants.
J Acoust Soc Am. 2012 Nov;132(5):EL429-35. doi: 10.1121/1.4758770.
9
Auditory, visual, and auditory-visual perceptions of emotions by young children with hearing loss versus children with normal hearing.
J Speech Lang Hear Res. 2012 Aug;55(4):1148-62. doi: 10.1044/1092-4388(2011/11-0060). Epub 2012 Jan 23.
10
Cochlear-implant spatial selectivity with monopolar, bipolar and tripolar stimulation.
Hear Res. 2012 Jan;283(1-2):45-58. doi: 10.1016/j.heares.2011.11.005. Epub 2011 Nov 22.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验