Rhee Seon-Min, Ziegler Remo, Park Jiyoung, Naef Martin, Gross Markus, Kim Myoung-Hee
Visual Computing and Virtual Reality Laboratory, Department of Computer Science and Engineering, Ewha Womans University, Daehyun-Dong, Seodaemun-Gu, Seoul, Korea.
IEEE Trans Vis Comput Graph. 2007 Jan-Feb;13(1):156-66. doi: 10.1109/TVCG.2007.17.
We present a novel low-cost method for visual communication and telepresence in a CAVE -like environment, relying on 2D stereo-based video avatars. The system combines a selection of proven efficient algorithms and approximations in a unique way, resulting in a convincing stereoscopic real-time representation of a remote user acquired in a spatially immersive display. The system was designed to extend existing projection systems with acquisition capabilities requiring minimal hardware modifications and cost. The system uses infrared-based image segmentation to enable concurrent acquisition and projection in an immersive environment without a static background. The system consists of two color cameras and two additional b/w cameras used for segmentation in the near-IR spectrum. There is no need for special optics as the mask and color image are merged using image-warping based on a depth estimation. The resulting stereo image stream is compressed, streamed across a network, and displayed as a frame-sequential stereo texture on a billboard in the remote virtual environment.
我们提出了一种新颖的低成本方法，用于在类似CAVE的环境中进行视觉通信和远程呈现，该方法依赖于基于二维立体的视频化身。该系统以独特的方式结合了一系列经过验证的高效算法和近似方法，从而在空间沉浸式显示器中实现了对远程用户令人信服的立体实时呈现。该系统旨在扩展现有的投影系统，使其具有所需硬件修改和成本最小的采集能力。该系统使用基于红外的图像分割技术，在没有静态背景的沉浸式环境中实现并发采集和投影。该系统由两个彩色相机和另外两个用于近红外光谱分割的黑白相机组成。由于使用基于深度估计的图像扭曲将掩码和彩色图像合并，因此无需特殊光学器件。生成的立体图像流经过压缩，通过网络传输，并作为帧顺序立体纹理显示在远程虚拟环境中的广告牌上。
