IEEE Trans Vis Comput Graph. 2016 Feb;22(2):1076-87. doi: 10.1109/TVCG.2015.2440262.
We have developed a novel visualization system based on the reconstruction of high resolution and high frame rate images from a multi-tiered stream of samples that are rendered framelessly. This decoupling of the rendering system from the display system is particularly suitable when dealing with very high resolution displays or expensive rendering algorithms, where the latency of generating complete frames may be prohibitively high for interactive applications. In contrast to the traditional frameless rendering technique, we generate the lowest latency samples on the optimal sampling lattice in the 3D domain. This approach avoids many of the artifacts associated with existing sample caching and reprojection methods during interaction that may not be acceptable in many visualization applications. Advanced visualization effects are generated remotely and streamed into the reconstruction system using tiered samples with varying latencies and quality levels. We demonstrate the use of our visualization system for the exploration of volumetric data at stable guaranteed frame rates on high resolution displays, including a 470 megapixel tiled display as part of the Reality Deck immersive visualization facility.
我们开发了一种新颖的可视化系统,该系统基于从无帧渲染的多层样本流重建高分辨率和高帧率图像。当处理非常高分辨率的显示器或昂贵的渲染算法时,这种将渲染系统与显示系统解耦的方法特别适用,因为生成完整帧的延迟对于交互式应用程序来说可能非常高。与传统的无帧渲染技术相比,我们在 3D 域中的最佳采样网格上生成最低延迟的样本。这种方法避免了在交互过程中与现有样本缓存和重投影方法相关的许多伪影,这些伪影在许多可视化应用中可能是不可接受的。高级可视化效果在远程生成,并使用具有不同延迟和质量级别的分层样本流式传输到重建系统中。我们展示了我们的可视化系统在高分辨率显示器上以稳定的保证帧率探索体数据集的使用情况,包括 Reality Deck 沉浸式可视化设施的一部分,即 4700 万像素平铺显示器。