School of Electrical Engineering and Telecommunications, Faculty of Engineering, the University of New South Wales, Sydney, Australia.
IEEE Trans Image Process. 2011 May;20(5):1435-49. doi: 10.1109/TIP.2010.2093905. Epub 2010 Nov 18.
We propose a novel paradigm for interactive video streaming and we coin the term JPEG2000-based scalable interactive video (JSIV) for it. JSIV utilizes JPEG2000 to independently compress the original video sequence frames and provide for quality and spatial resolution scalability. To exploit interframe redundancy, JSIV utilizes prediction and conditional replenishment of code-blocks aided by a server policy that optimally selects the number of quality layer for each code-block transmitted and a client policy that makes most of the received (distorted) frames. It is also possible for JSIV to employ motion compensation; however, we leave this topic to future work. To optimally solve the server transmission problem, a Lagrangian-style rate-distortion optimization procedure is employed. In JSIV, a wide variety of frame prediction arrangements can be employed including hierarchical B-frames of the scalable video coding (SVC) extension of the H.264/AVC standard. JSIV provides considerably better interactivity compared to existing schemes and can adapt immediately to interactive changes in client interests, such as forward or backward playback and zooming into individual frames. Experimental results for surveillance footage, which does not suffer from the absence of motion compensation, show that JSIV's performance is comparable to that of SVC in some usage scenarios while JSIV performs better in others.
我们提出了一种新的交互式视频流范例，并将其命名为基于 JPEG2000 的可扩展交互式视频（JSIV）。JSIV 利用 JPEG2000 独立压缩原始视频序列帧，并提供质量和空间分辨率的可扩展性。为了利用帧间冗余，JSIV 利用预测和条件式的代码块补充，由服务器策略辅助，该策略最佳选择每个传输代码块的质量层数量，以及客户端策略最大限度地利用接收（失真）的帧。JSIV 也可以使用运动补偿；但是，我们将这个主题留给未来的工作。为了最优地解决服务器传输问题，采用了拉格朗日风格的率失真优化过程。在 JSIV 中，可以采用各种帧预测安排，包括 H.264/AVC 标准的可扩展视频编码（SVC）扩展的分层 B 帧。与现有方案相比，JSIV 提供了更好的交互性，并且可以立即适应客户端兴趣的交互变化，例如向前或向后播放以及放大到单个帧。对于不遭受运动补偿缺失的监控镜头的实验结果表明，在某些使用场景中，JSIV 的性能与 SVC 相当，而在其他场景中，JSIV 的性能更好。
