• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

视觉运动检测中的视听交互:同步与异步

Audio-visual interaction in visual motion detection: Synchrony versus Asynchrony.

作者信息

Rosemann Stephanie, Wefel Inga-Maria, Elis Volkan, Fahle Manfred

机构信息

Department of Human-Neurobiology, University of Bremen, Hochschulring 18, 28359 Bremen, Germany.

Department of Human-Neurobiology, University of Bremen, Hochschulring 18, 28359 Bremen, Germany.

出版信息

J Optom. 2017 Oct-Dec;10(4):242-251. doi: 10.1016/j.optom.2016.12.003. Epub 2017 Feb 23.

DOI:10.1016/j.optom.2016.12.003
PMID:28237358
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC5595265/
Abstract

OBJECTIVE

Detection and identification of moving targets is of paramount importance in everyday life, even if it is not widely tested in optometric practice, mostly for technical reasons. There are clear indications in the literature that in perception of moving targets, vision and hearing interact, for example in noisy surrounds and in understanding speech. The main aim of visual perception, the ability that optometry aims to optimize, is the identification of objects, from everyday objects to letters, but also the spatial orientation of subjects in natural surrounds. To subserve this aim, corresponding visual and acoustic features from the rich spectrum of signals supplied by natural environments have to be combined.

METHODS

Here, we investigated the influence of an auditory motion stimulus on visual motion detection, both with a concrete (left/right movement) and an abstract auditory motion (increase/decrease of pitch).

RESULTS

We found that incongruent audiovisual stimuli led to significantly inferior detection compared to the visual only condition. Additionally, detection was significantly better in abstract congruent than incongruent trials. For the concrete stimuli the detection threshold was significantly better in asynchronous audiovisual conditions than in the unimodal visual condition.

CONCLUSION

We find a clear but complex pattern of partly synergistic and partly inhibitory audio-visual interactions. It seems that asynchrony plays only a positive role in audiovisual motion while incongruence mostly disturbs in simultaneous abstract configurations but not in concrete configurations. As in speech perception in hearing-impaired patients, patients suffering from visual deficits should be able to benefit from acoustic information.

摘要

目的

移动目标的检测与识别在日常生活中至关重要,即便在验光实践中因技术原因未得到广泛测试。文献中有明确迹象表明,在移动目标的感知中,视觉与听觉相互作用,例如在嘈杂环境以及言语理解方面。视觉感知的主要目的,即验光旨在优化的能力,是识别物体,从日常物体到字母,还包括主体在自然环境中的空间定向。为实现这一目的,必须整合自然环境提供的丰富信号频谱中的相应视觉和声学特征。

方法

在此,我们研究了听觉运动刺激对视觉运动检测的影响,既有具体的(左右移动),也有抽象的听觉运动(音高的升高/降低)。

结果

我们发现,与仅视觉条件相比,不一致的视听刺激导致检测效果显著较差。此外,在抽象一致的试验中检测明显优于不一致的试验。对于具体刺激,异步视听条件下的检测阈值明显优于单峰视觉条件。

结论

我们发现了一种清晰但复杂的模式,即视听交互部分协同、部分抑制。似乎异步仅在视听运动中起积极作用,而不一致在同时出现的抽象配置中大多起干扰作用,但在具体配置中并非如此。如同听力受损患者的言语感知一样,患有视觉缺陷的患者应该能够从声学信息中受益。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/a42d5e221eb6/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/adf071371f27/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/810f61ae6574/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/638af982270b/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/77af601a6d2d/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/a42d5e221eb6/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/adf071371f27/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/810f61ae6574/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/638af982270b/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/77af601a6d2d/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6cc4/5595265/a42d5e221eb6/gr5.jpg

相似文献

1
Audio-visual interaction in visual motion detection: Synchrony versus Asynchrony.视觉运动检测中的视听交互:同步与异步
J Optom. 2017 Oct-Dec;10(4):242-251. doi: 10.1016/j.optom.2016.12.003. Epub 2017 Feb 23.
2
Degradation of labial information modifies audiovisual speech perception in cochlear-implanted children.唇语信息的退化改变了植入人工耳蜗的儿童对视听语音的感知。
Ear Hear. 2013 Jan-Feb;34(1):110-21. doi: 10.1097/AUD.0b013e3182670993.
3
Sequential audiovisual interactions during speech perception: a whole-head MEG study.言语感知过程中的序列视听交互作用:一项全脑磁图研究。
Neuropsychologia. 2007 Mar 25;45(6):1342-54. doi: 10.1016/j.neuropsychologia.2006.09.019. Epub 2006 Oct 25.
4
Cross-modal integration of auditory and visual motion signals.听觉与视觉运动信号的跨模态整合
Neuroreport. 2001 Aug 8;12(11):2557-60. doi: 10.1097/00001756-200108080-00053.
5
Feature-based processing of audio-visual synchrony perception revealed by random pulse trains.随机脉冲序列揭示的基于特征的视听同步感知处理
Vision Res. 2007 Apr;47(8):1075-93. doi: 10.1016/j.visres.2007.01.021. Epub 2007 Mar 9.
6
Changing pitch of sounds alters perceived visual motion trajectory.改变声音的音高会改变所感知到的视觉运动轨迹。
Multisens Res. 2013;26(4):317-32.
7
Crossmodal interactions and multisensory integration in the perception of audio-visual motion -- a free-field study.视听运动知觉中的跨模态相互作用和多感觉整合——自由场研究。
Brain Res. 2012 Jul 23;1466:99-111. doi: 10.1016/j.brainres.2012.05.015. Epub 2012 May 14.
8
Effects of congruent and incongruent visual cues on speech perception and brain activity in cochlear implant users.一致和不一致视觉线索对人工耳蜗使用者言语感知及大脑活动的影响。
Brain Struct Funct. 2015 Mar;220(2):1109-25. doi: 10.1007/s00429-013-0704-6. Epub 2014 Jan 9.
9
Investigating the in-between: multisensory integration of auditory and visual motion streams.探究中间地带:听觉与视觉运动流的多感官整合
Seeing Perceiving. 2012;25(1):45-69. doi: 10.1163/187847611X620919.
10
Audiovisual synchrony improves motion discrimination via enhanced connectivity between early visual and auditory areas.视听同步通过增强早期视觉和听觉区域之间的连通性来提高运动辨别能力。
J Neurosci. 2010 Sep 15;30(37):12329-39. doi: 10.1523/JNEUROSCI.5745-09.2010.

引用本文的文献

1
Audiovisual interactions outside of visual awareness during motion adaptation.运动适应过程中视觉意识之外的视听交互。
Neurosci Conscious. 2024 Jan 29;2024(1):niad027. doi: 10.1093/nc/niad027. eCollection 2024.
2
Alterations of Audiovisual Integration in Alzheimer's Disease.阿尔茨海默病中的视听整合改变。
Neurosci Bull. 2023 Dec;39(12):1859-1872. doi: 10.1007/s12264-023-01125-7. Epub 2023 Oct 9.

本文引用的文献

1
Visual rehabilitation: visual scanning, multisensory stimulation and vision restoration trainings.视觉康复:视觉扫描、多感官刺激和视力恢复训练。
Front Behav Neurosci. 2015 Jul 27;9:192. doi: 10.3389/fnbeh.2015.00192. eCollection 2015.
2
Age-related hearing loss increases cross-modal distractibility.年龄相关性听力损失会增加跨模态注意力分散。
Hear Res. 2014 Oct;316:28-36. doi: 10.1016/j.heares.2014.07.005. Epub 2014 Jul 28.
3
Sounds activate visual cortex and improve visual discrimination.声音可以激活视觉皮层并提高视觉辨别能力。
J Neurosci. 2014 Jul 16;34(29):9817-24. doi: 10.1523/JNEUROSCI.4869-13.2014.
4
On the 'visual' in 'audio-visual integration': a hypothesis concerning visual pathways.论“视听整合”中的“视觉”:关于视觉通路的一种假说
Exp Brain Res. 2014 Jun;232(6):1631-8. doi: 10.1007/s00221-014-3927-8. Epub 2014 Apr 4.
5
Changing pitch of sounds alters perceived visual motion trajectory.改变声音的音高会改变所感知到的视觉运动轨迹。
Multisens Res. 2013;26(4):317-32.
6
Oscillatory mechanisms underlying the enhancement of visual motion perception by multisensory congruency.多感觉一致性增强视觉运动知觉的振荡机制。
Neuropsychologia. 2014 Jan;53:84-93. doi: 10.1016/j.neuropsychologia.2013.11.005. Epub 2013 Nov 18.
7
Effect of pitch-space correspondence on sound-induced visual motion perception.音高空间对应对声音诱导的视觉运动感知的影响。
Exp Brain Res. 2013 Nov;231(1):117-26. doi: 10.1007/s00221-013-3674-2. Epub 2013 Sep 13.
8
Multisensory temporal integration: task and stimulus dependencies.多感觉时间整合:任务和刺激的依赖性。
Exp Brain Res. 2013 Jun;227(2):249-61. doi: 10.1007/s00221-013-3507-3. Epub 2013 Apr 21.
9
Temporal structure and complexity affect audio-visual correspondence detection.时间结构和复杂性会影响视听对应检测。
Front Psychol. 2013 Jan 22;3:619. doi: 10.3389/fpsyg.2012.00619. eCollection 2012.
10
Audio-visual interactions for motion perception in depth modulate activity in visual area V3A.视听交互作用调节 V3A 视觉区的深度运动知觉活动。
Neuroimage. 2013 May 1;71:158-67. doi: 10.1016/j.neuroimage.2013.01.012. Epub 2013 Jan 17.