Zhou Fei, Yuan Shuhong, Liang Zhijie, Duan Jiang, Qiu Guoping
IEEE Trans Image Process. 2024;33:366-381. doi: 10.1109/TIP.2023.3343099. Epub 2023 Dec 27.
To enhance the viewer experience of standard dynamic range (SDR) video content on high dynamic range (HDR) displays, inverse tone mapping (ITM) is employed. Objective visual quality assessment (VQA) models are needed for effective evaluation of ITM algorithms. However, there is a lack of specialized VQA models for assessing the visual quality of inversely tone-mapped HDR videos (ITM-HDR-Videos). This paper addresses both an algorithmic and a dataset gap by introducing a novel SDR referenced HDR (SD-R-HD) VQA model tailored for ITM-HDR-Videos, along with the first public dataset specifically constructed for this purpose. The innovations of the SD-R-HD VQA model include 1) utilizing available SDR video as a reference signal, 2) extracting features that characterize standard ITM operations such as global mapping and local compensation, and 3) directly modeling interframe inconsistencies introduced by ITM operations. The newly created ITM-HDR-VQA dataset comprises 200 ITM-HDR-Videos annotated with mean opinion scores, gathered over 320 man-hours of psychovisual experiments. Experimental results demonstrate that the SD-R-HD VQA model significantly outperforms existing state-of-the-art VQA models.
为了提升高动态范围(HDR)显示器上标准动态范围(SDR)视频内容的观看体验,人们采用了逆色调映射(ITM)技术。为有效评估ITM算法,需要客观视觉质量评估(VQA)模型。然而,目前缺乏专门用于评估逆色调映射HDR视频(ITM-HDR-Videos)视觉质量的VQA模型。本文通过引入一种专门为ITM-HDR-Videos量身定制的新型SDR参考HDR(SD-R-HD)VQA模型,以及为此专门构建的首个公开数据集,解决了算法和数据集两方面的差距问题。SD-R-HD VQA模型的创新点包括:1)将可用的SDR视频用作参考信号;2)提取表征标准ITM操作(如全局映射和局部补偿)的特征;3)直接对ITM操作引入的帧间不一致性进行建模。新创建的ITM-HDR-VQA数据集包含200个标注了平均意见得分的ITM-HDR-Videos,这些视频是通过超过320人时的心理视觉实验收集而来的。实验结果表明,SD-R-HD VQA模型显著优于现有的最先进VQA模型。