Atkins Joseph E, Jacobs Robert A, Knill David C
Department of Brain and Cognitive Sciences, The Center for Visual Science, University of Rochester, Rochester, NY 14627-0268, USA.
Vision Res. 2003 Nov;43(25):2603-13. doi: 10.1016/s0042-6989(03)00470-x.
We studied the hypothesis that observers can recalibrate their visual percepts when visual and haptic (touch) cues are discordant and the haptic information is judged to be reliable. Using a novel visuo-haptic virtual reality environment, we conducted a set of experiments in which subjects interacted with scenes consisting of two fronto-parallel surfaces. Subjects judged the distance between the two surfaces based on two perceptual cues: a visual stereo cue obtained when viewing the scene binocularly and a haptic cue obtained when subjects grasped the two surfaces between their thumb and index fingers. Visual and haptic cues regarding the scene were manipulated independently so that they could either be consistent or inconsistent. Experiment 1 explored the effect of visuo-haptic inconsistencies on depth-from-stereo estimates. Our findings suggest that when stereo and haptic cues are inconsistent, subjects recalibrate their interpretations of the visual stereo cue so that depth-from-stereo percepts are in greater agreement with depth-from-haptic percepts. In Experiment 2 the visuo-haptic discrepancy took a different form when the two surfaces were near the subject than when they were far from the subject. The results indicate that subjects recalibrated their interpretations of the stereo cue in a context-sensitive manner that depended on viewing distance, thereby making them more consistent with depth-from-haptic estimates at all viewing distances. Together these findings suggest that observers' visual and haptic percepts are tightly coupled in the sense that haptic percepts provide a standard to which visual percepts can be recalibrated when the visual percepts are deemed to be erroneous.
当视觉线索和触觉（触摸）线索不一致且触觉信息被判定为可靠时，观察者能够重新校准他们的视觉感知。利用一种新颖的视觉 - 触觉虚拟现实环境，我们进行了一组实验，实验中受试者与由两个 frontal - parallel 表面组成的场景进行交互。受试者基于两种感知线索来判断两个表面之间的距离：一种是双眼观看场景时获得的视觉立体线索，另一种是受试者用拇指和食指握住两个表面时获得的触觉线索。关于场景的视觉和触觉线索被独立操控，以便它们可以是一致的或不一致的。实验 1 探究了视觉 - 触觉不一致对基于立体视觉的深度估计的影响。我们的研究结果表明，当立体视觉线索和触觉线索不一致时，受试者会重新校准他们对视觉立体线索的解读，以使基于立体视觉的深度感知与基于触觉的深度感知更加一致。在实验 2 中，当两个表面靠近受试者时与远离受试者时，视觉 - 触觉差异呈现出不同的形式。结果表明，受试者以一种依赖于观察距离的情境敏感方式重新校准他们对立体线索的解读，从而使它们在所有观察距离下都与基于触觉的深度估计更加一致。这些研究结果共同表明，观察者的视觉和触觉感知紧密耦合，即当视觉感知被认为有误时，触觉感知提供了一个标准，视觉感知可以据此重新校准。
