Athar Shahrukh, Wang Zhou
IEEE Trans Image Process. 2023;32:822-837. doi: 10.1109/TIP.2023.3234498. Epub 2023 Jan 18.
In practical media distribution systems, visual content usually undergoes multiple stages of quality degradation along the delivery chain, but the pristine source content is rarely available at most quality monitoring points along the chain to serve as a reference for quality assessment. As a result, full-reference (FR) and reduced-reference (RR) image quality assessment (IQA) methods are generally infeasible. Although no-reference (NR) methods are readily applicable, their performance is often not reliable. On the other hand, intermediate references of degraded quality are often available, e.g., at the input of video transcoders, but how to make the best use of them in proper ways has not been deeply investigated. Here we make one of the first attempts to establish a new paradigm named degraded-reference IQA (DR IQA). Specifically, by using a two-stage distortion pipeline we lay out the architectures of DR IQA and introduce a 6-bit code to denote the choices of configurations. We construct the first large-scale databases dedicated to DR IQA and have made them publicly available. We make novel observations on distortion behavior in multi-stage distortion pipelines by comprehensively analyzing five multiple distortion combinations. Based on these observations, we develop novel DR IQA models and make extensive comparisons with a series of baseline models derived from top-performing FR and NR models. The results suggest that DR IQA may offer significant performance improvement in multiple distortion environments, thereby establishing DR IQA as a valid IQA paradigm that is worth further exploration.
在实际的媒体分发系统中,视觉内容在传输链中通常会经历多个质量下降阶段,但在传输链上的大多数质量监测点,很少能获取到原始的源内容作为质量评估的参考。因此,全参考(FR)和半参考(RR)图像质量评估(IQA)方法通常不可行。尽管无参考(NR)方法易于应用,但其性能往往不可靠。另一方面,质量下降的中间参考通常是可用的,例如在视频转码器的输入端,但如何以适当的方式充分利用它们尚未得到深入研究。在此,我们首次尝试建立一种名为降级参考IQA(DR IQA)的新范式。具体而言,通过使用两阶段失真管道,我们设计了DR IQA的架构,并引入了一个6位代码来表示配置选择。我们构建了首个专门用于DR IQA的大规模数据库,并已将其公开。通过全面分析五种多重失真组合,我们对多阶段失真管道中的失真行为有了新颖的观察结果。基于这些观察结果,我们开发了新颖的DR IQA模型,并与一系列源自性能最佳的FR和NR模型的基线模型进行了广泛比较。结果表明,DR IQA在多重失真环境中可能会显著提高性能,从而将DR IQA确立为一个值得进一步探索的有效IQA范式。