IEEE Trans Image Process. 2017 Aug;26(8):3789-3801. doi: 10.1109/TIP.2017.2702383. Epub 2017 May 9.
Conventional stereoscopic 3D (S3D) displays do not provide accommodation depth cues of the 3D image or video contents being viewed. The sense of content depths is thus limited to cues supplied by motion parallax (for 3D video), stereoscopic vergence cues created by presenting left and right views to the respective eyes, and other contextual and perspective depth cues. The absence of accommodation cues can induce two kinds of accommodation vergence mismatches (AVM) at the fixation and peripheral points, which can result in severe visual discomfort. With the aim of alleviating discomfort arising from AVM, we propose a new visual comfort enhancement approach for processing S3D visual signals to deliver a more comfortable 3D viewing experience at the display. This is accomplished via an optimization process whereby a predictive indicator of visual discomfort is minimized, while still aiming to maintain the viewer's sense of 3D presence by performing a suitable parallax shift, and by directed blurring of the signal. Our processing framework is defined on 3D visual coordinates that reflect the nonuniform resolution of retinal sensors and that uses a measure of 3D saliency strength. An appropriate level of blur that corresponds to the degree of parallax shift is found, making it possible to produce synthetic accommodation cues implemented using a perceptively relevant filter. By this method, AVM, the primary contributor to the discomfort felt when viewing S3D images, is reduced. We show via a series of subjective experiments that the proposed approach improves visual comfort while preserving the sense of 3D presence.
传统的立体 3D(S3D)显示器无法提供观看的 3D 图像或视频内容的调节景深线索。因此,内容深度的感觉仅限于运动视差(用于 3D 视频)提供的线索、通过向相应的眼睛呈现左右视图创建的立体融合线索,以及其他上下文和透视深度线索。调节线索的缺失会在注视点和周边点引起两种调节融合不匹配(AVM),这可能导致严重的视觉不适。为了缓解 AVM 引起的不适,我们提出了一种新的立体视觉信号处理方法,以在显示器上提供更舒适的 3D 观看体验。这是通过优化过程来实现的,该过程最小化了视觉不适的预测指标,同时通过执行适当的视差移位并通过信号的定向模糊来保持观众的 3D 存在感。我们的处理框架是在反映视网膜传感器非均匀分辨率的 3D 视觉坐标上定义的,并使用 3D 显著性强度的度量。找到与视差移位程度相对应的适当模糊度,从而可以使用感知相关的滤波器生成合成的调节线索。通过这种方法,可以减少观看 S3D 图像时感到不适的主要原因——AVM。我们通过一系列主观实验表明,所提出的方法在保持 3D 存在感的同时提高了视觉舒适度。