IEEE Trans Vis Comput Graph. 2017 Nov;23(11):2474-2484. doi: 10.1109/TVCG.2017.2734426. Epub 2017 Aug 10.
Augmented Reality offers many applications today, especially on mobile devices. Due to the lack of mobile hardware for illumination measurements, photorealistic rendering with consistent appearance of virtual objects is still an area of active research. In this paper, we present a full two-stage pipeline for environment acquisition and augmentation of live camera images using a mobile device with a depth sensor. We show how to directly work on a recorded 3D point cloud of the real environment containing high dynamic range color values. For unknown and automatically changing camera settings, a color compensation method is introduced. Based on this, we show photorealistic augmentations using variants of differential light simulation techniques. The presented methods are tailored for mobile devices and run at interactive frame rates. However, our methods are scalable to trade performance for quality and can produce quality renderings on desktop hardware.
增强现实技术目前有很多应用，特别是在移动设备上。由于移动设备缺乏照明测量硬件，因此逼真的渲染和虚拟物体的一致外观仍然是一个活跃的研究领域。在本文中，我们提出了一个完整的两阶段管道，用于使用具有深度传感器的移动设备获取和增强实时摄像机图像。我们展示了如何直接处理包含高动态范围颜色值的真实环境的记录 3D 点云。对于未知和自动更改的相机设置，引入了一种颜色补偿方法。在此基础上，我们展示了使用不同差分光模拟技术的逼真增强效果。所提出的方法针对移动设备进行了优化，可以以交互帧率运行。但是，我们的方法可以扩展以平衡性能和质量，并在桌面硬件上生成高质量的渲染效果。
