Soner Burak, Ulusoy Erdem, Tekalp A Murat, Urey Hakan
IEEE Trans Image Process. 2020 Feb 12. doi: 10.1109/TIP.2020.2972112.
Head-mounted holographic displays (HMHD) are projected to be the first commercial realization of holographic video display systems. HMHDs use liquid crystal on silicon (LCoS) spatial light modulators (SLM), which are best suited to display phase-only holograms (POH). The performance/watt requirement of a monochrome, 60 fps Full HD, 2-eye, POH HMHD system is about 10 TFLOPS/W, which is orders of magnitude higher than that is achievable by commercially available mobile processors. To mitigate this compute power constraint, display-ready POHs shall be generated on a nearby server and sent to the HMHD in compressed form over a wireless link. This paper discusses design of a feasible HMHD-based augmented reality system, focusing on compression requirements and per-pixel rate-distortion trade-off for transmission of display-ready POH from the server to HMHD. Since the decoder in the HMHD needs to operate on low power, only coding methods that have low-power decoder implementation are considered. Effects of 2D phase unwrapping and flat quantization on compression performance are also reported. We next propose a versatile PCM-POH codec with progressive quantization that can adapt to SLM-dynamic-range and available bitrate, and features per-pixel rate-distortion control to achieve acceptable POH quality at target rates of 60-200 Mbit/s that can be reliably achieved by current wireless technologies. Our results demonstrate feasibility of realizing a low-power, quality-ensured, multi-user, interactive HMHD augmented reality system with commercially available components using the proposed adaptive compression of display-ready POH with light-weight decoding.
头戴式全息显示器(HMHD)预计将成为全息视频显示系统的首个商业应用。HMHD使用硅基液晶(LCoS)空间光调制器(SLM),这种调制器最适合显示纯相位全息图(POH)。一个单色、60帧每秒、全高清、双眼、POH的HMHD系统的性能/瓦特需求约为10万亿次浮点运算/瓦特,这比市售移动处理器所能达到的性能高出几个数量级。为了缓解这种计算能力的限制,应在附近的服务器上生成可供显示的POH,并通过无线链路以压缩形式发送到HMHD。本文讨论了一种基于HMHD的可行增强现实系统的设计,重点关注从服务器向HMHD传输可供显示的POH时的压缩要求和每像素率失真权衡。由于HMHD中的解码器需要低功耗运行,因此只考虑具有低功耗解码器实现的编码方法。还报告了二维相位展开和平坦量化对压缩性能的影响。接下来,我们提出一种具有渐进量化的通用PCM-POH编解码器,它可以适应SLM动态范围和可用比特率,并具有每像素率失真控制功能,以便在60 - 200兆比特/秒的目标速率下实现可接受的POH质量,而当前的无线技术能够可靠地实现这些速率。我们的结果表明,使用所提出的对可供显示的POH进行自适应压缩并结合轻量级解码,利用市售组件实现低功耗、质量有保证、多用户、交互式HMHD增强现实系统是可行的。