• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用具有共振峰频率聚焦的声触觉感觉替代来提高触觉语音感知。

Improved tactile speech perception using audio-to-tactile sensory substitution with formant frequency focusing.

机构信息

University of Southampton Auditory Implant Service, University of Southampton, University Road, Southampton, SO17 1BJ, UK.

Institute of Sound and Vibration Research, University of Southampton, University Road, Southampton, SO17 1BJ, UK.

出版信息

Sci Rep. 2024 Feb 28;14(1):4889. doi: 10.1038/s41598-024-55429-3.

DOI:10.1038/s41598-024-55429-3
PMID:38418558
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10901863/
Abstract

Haptic hearing aids, which provide speech information through tactile stimulation, could substantially improve outcomes for both cochlear implant users and for those unable to access cochlear implants. Recent advances in wide-band haptic actuator technology have made new audio-to-tactile conversion strategies viable for wearable devices. One such strategy filters the audio into eight frequency bands, which are evenly distributed across the speech frequency range. The amplitude envelopes from the eight bands modulate the amplitudes of eight low-frequency tones, which are delivered through vibration to a single site on the wrist. This tactile vocoder strategy effectively transfers some phonemic information, but vowels and obstruent consonants are poorly portrayed. In 20 participants with normal touch perception, we tested (1) whether focusing the audio filters of the tactile vocoder more densely around the first and second formant frequencies improved tactile vowel discrimination, and (2) whether focusing filters at mid-to-high frequencies improved obstruent consonant discrimination. The obstruent-focused approach was found to be ineffective. However, the formant-focused approach improved vowel discrimination by 8%, without changing overall consonant discrimination. The formant-focused tactile vocoder strategy, which can readily be implemented in real time on a compact device, could substantially improve speech perception for haptic hearing aid users.

摘要

触觉助听器通过触觉刺激提供言语信息,可以大大改善人工耳蜗植入用户和无法接受人工耳蜗植入用户的效果。宽带触觉致动器技术的最新进展使得新的音频到触觉转换策略对于可穿戴设备变得可行。该策略之一是将音频过滤成八个频带,这些频带均匀分布在语音频率范围内。来自八个频带的幅度包络调制八个低频音的幅度,这些低频音通过振动传递到手腕上的单个位置。这种触觉声码器策略有效地传递了一些音位信息,但元音和塞音辅音的表现很差。在 20 名具有正常触觉感知的参与者中,我们测试了(1)是否通过将触觉声码器的音频滤波器更密集地聚焦在第一和第二共振峰频率周围来提高触觉元音辨别力,以及(2)是否通过聚焦在中高频来提高塞音辅音辨别力。发现阻塞音聚焦方法无效。然而,共振峰聚焦方法将元音辨别能力提高了 8%,而不会改变整体辅音辨别能力。该共振峰聚焦触觉声码器策略可以在紧凑的设备上实时实现,从而可以大大改善触觉助听器用户的语音感知。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/fb1c5a28fe73/41598_2024_55429_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/1636ddc23007/41598_2024_55429_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/433aa7fa262d/41598_2024_55429_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/43d184dad67c/41598_2024_55429_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/0db2855aae83/41598_2024_55429_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/fb1c5a28fe73/41598_2024_55429_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/1636ddc23007/41598_2024_55429_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/433aa7fa262d/41598_2024_55429_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/43d184dad67c/41598_2024_55429_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/0db2855aae83/41598_2024_55429_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2fd3/10901863/fb1c5a28fe73/41598_2024_55429_Fig5_HTML.jpg

相似文献

1
Improved tactile speech perception using audio-to-tactile sensory substitution with formant frequency focusing.使用具有共振峰频率聚焦的声触觉感觉替代来提高触觉语音感知。
Sci Rep. 2024 Feb 28;14(1):4889. doi: 10.1038/s41598-024-55429-3.
2
Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion.使用具有幅度包络扩展的声触觉感觉替代来提高触觉语音感知和抗噪能力。
Sci Rep. 2024 Jul 1;14(1):15029. doi: 10.1038/s41598-024-65510-6.
3
Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels.使用多频通道音频触觉感觉替代提高听力受损听众的语音感知。
Sci Rep. 2023 Aug 16;13(1):13336. doi: 10.1038/s41598-023-40509-7.
4
Discrimination of synthetic vowels by using tactile vocoder and a comparison to that of an eight-channel cochlear implant.使用触觉声码器对合成元音的辨别以及与八通道人工耳蜗辨别能力的比较。
IEEE Trans Biomed Eng. 1989 Nov;36(11):1085-91. doi: 10.1109/10.40815.
5
Improved tactile speech robustness to background noise with a dual-path recurrent neural network noise-reduction method.基于双路径递归神经网络降噪方法提高触觉语音对背景噪声的鲁棒性。
Sci Rep. 2024 Mar 28;14(1):7357. doi: 10.1038/s41598-024-57312-7.
6
A Phonemic-Based Tactile Display for Speech Communication.基于音位的语音通信触觉显示器。
IEEE Trans Haptics. 2019 Jan-Mar;12(1):2-17. doi: 10.1109/TOH.2018.2861010. Epub 2018 Jul 30.
7
Immediate improvement of speech-in-noise perception through multisensory stimulation via an auditory to tactile sensory substitution.通过听觉到触觉的感官替代进行多感官刺激,可立即改善噪声环境下的言语感知能力。
Restor Neurol Neurosci. 2019;37(2):155-166. doi: 10.3233/RNN-190898.
8
Saliency of Vowel Features in Neural Responses of Cochlear Implant Users.人工耳蜗使用者神经反应中元音特征的显著性
Clin EEG Neurosci. 2018 Nov;49(6):388-397. doi: 10.1177/1550059418770051. Epub 2018 Apr 24.
9
Evaluation of a principal-components tactile aid for the hearing-impaired.一种用于听力受损者的主成分触觉辅助设备的评估。
J Acoust Soc Am. 1991 Oct;90(4 Pt 1):1944-57. doi: 10.1121/1.401674.
10
Vowel and consonant recognition of cochlear implant patients using formant-estimating speech processors.使用共振峰估计语音处理器的人工耳蜗植入患者的元音和辅音识别
J Acoust Soc Am. 1987 Jul;82(1):48-57. doi: 10.1121/1.395436.

引用本文的文献

1
Sensory-substitution based sound perception using a spinal computer-brain interface.基于脊髓计算机脑接口的感觉替代声音感知。
Sci Rep. 2024 Oct 22;14(1):24879. doi: 10.1038/s41598-024-75779-2.
2
Improved tactile speech perception and noise robustness using audio-to-tactile sensory substitution with amplitude envelope expansion.使用具有幅度包络扩展的声触觉感觉替代来提高触觉语音感知和抗噪能力。
Sci Rep. 2024 Jul 1;14(1):15029. doi: 10.1038/s41598-024-65510-6.
3
Improved tactile speech robustness to background noise with a dual-path recurrent neural network noise-reduction method.

本文引用的文献

1
Improved speech intelligibility in the presence of congruent vibrotactile speech input.在存在一致的振动语音输入的情况下提高语音可懂度。
Sci Rep. 2023 Dec 19;13(1):22657. doi: 10.1038/s41598-023-48893-w.
2
Improving speech perception for hearing-impaired listeners using audio-to-tactile sensory substitution with multiple frequency channels.使用多频通道音频触觉感觉替代提高听力受损听众的语音感知。
Sci Rep. 2023 Aug 16;13(1):13336. doi: 10.1038/s41598-023-40509-7.
3
Influence of Electric Frequency-to-Place Mismatches on the Early Speech Recognition Outcomes for Electric-Acoustic Stimulation Users.
基于双路径递归神经网络降噪方法提高触觉语音对背景噪声的鲁棒性。
Sci Rep. 2024 Mar 28;14(1):7357. doi: 10.1038/s41598-024-57312-7.
电-位失配对电-声刺激使用者早期言语识别结果的影响。
Am J Audiol. 2023 Mar;32(1):251-260. doi: 10.1044/2022_AJA-21-00254. Epub 2023 Feb 17.
4
Enhancement of speech-in-noise comprehension through vibrotactile stimulation at the syllabic rate.通过音节率的振动触觉刺激提高语音噪声理解能力。
Proc Natl Acad Sci U S A. 2022 Mar 29;119(13):e2117000119. doi: 10.1073/pnas.2117000119. Epub 2022 Mar 21.
5
Effects of training and using an audio-tactile sensory substitution device on speech-in-noise understanding.训练和使用音频触觉感觉替代设备对噪声环境下言语理解的影响。
Sci Rep. 2022 Feb 25;12(1):3206. doi: 10.1038/s41598-022-06855-8.
6
Accuracy and cue use in word segmentation for cochlear-implant listeners and normal-hearing listeners presented vocoded speech.人工耳蜗使用者和正常听力者对语音编码语音进行分词的准确性和线索使用。
J Acoust Soc Am. 2021 Oct;150(4):2936. doi: 10.1121/10.0006448.
7
Electro-Haptic Stimulation: A New Approach for Improving Cochlear-Implant Listening.电触觉刺激:一种改善人工耳蜗听力的新方法。
Front Neurosci. 2021 Jun 9;15:581414. doi: 10.3389/fnins.2021.581414. eCollection 2021.
8
Sensitivity to Haptic Sound-Localization Cues at Different Body Locations.对不同身体部位触觉声音定位线索的敏感性。
Sensors (Basel). 2021 May 28;21(11):3770. doi: 10.3390/s21113770.
9
Deciphering Sounds Through Patterns of Vibration on the Skin.通过皮肤上的振动模式解读声音。
Neuroscience. 2021 Mar 15;458:77-86. doi: 10.1016/j.neuroscience.2021.01.008. Epub 2021 Jan 16.
10
Sensitivity to haptic sound-localisation cues.对触觉声音定位线索的敏感性。
Sci Rep. 2021 Jan 11;11(1):312. doi: 10.1038/s41598-020-79150-z.