Chakareski Jacob
IEEE Trans Image Process. 2020 May 5. doi: 10.1109/TIP.2020.2986547.
Virtual reality (VR) holds tremendous potential to advance our society, expected to make impact on quality of life, energy conservation, and the economy. To bring us closer to this vision, the present paper investigates a novel communications system that integrates for the first time scalable multi-layer 360° video tiling, viewport-adaptive rate-distortion optimal resource allocation, and VR-centric edge computing and caching, to enable next generation high-quality untethered VR streaming. Our system comprises a collection of 5G small cells that can pool their communication, computing, and storage resources to collectively deliver scalable 360° video content to mobile VR clients at much higher quality. The major contributions of the paper are the rigorous design of multi-layer 360° tiling and related models of statistical user navigation, analysis and optimization of edge-based multi-user VR streaming that integrates viewport adaptation and server cooperation, and base station 360° video packet scheduling. We also explore the possibility of network coded data operation and its implications for the analysis, optimization, and system performance we pursue in this setting. The advances introduced by our framework over the state-of-theart comprise considerable gains in delivered immersion fidelity, featuring much higher 360° viewport peak signal to noise ratio (PSNR) and VR video frame rates and spatial resolutions.
虚拟现实(VR)具有推动社会发展的巨大潜力,有望对生活质量、能源节约和经济产生影响。为了使我们更接近这一愿景,本文研究了一种新型通信系统,该系统首次集成了可扩展的多层360°视频拼接、视口自适应率失真最优资源分配以及以VR为中心的边缘计算和缓存,以实现下一代高质量的无束缚VR流传输。我们的系统由一组5G小基站组成,这些小基站可以汇聚它们的通信、计算和存储资源,以更高的质量向移动VR客户端集体交付可扩展的360°视频内容。本文的主要贡献包括多层360°拼接的严谨设计和统计用户导航的相关模型、对集成视口自适应和服务器协作的基于边缘的多用户VR流传输进行分析和优化,以及基站360°视频分组调度。我们还探讨了网络编码数据操作的可能性及其对我们在此环境中进行的分析、优化和系统性能的影响。我们的框架相对于现有技术的进步包括在沉浸式保真度方面取得了显著提升,具有更高的360°视口峰值信噪比(PSNR)、VR视频帧率和空间分辨率。