IEEE Trans Image Process. 2017 Oct;26(10):4818-4831. doi: 10.1109/TIP.2017.2718185. Epub 2017 Jun 21.
In this paper, an accurate full-reference image quality assessment (IQA) model developed for assessing screen content images (SCIs), called the edge similarity (ESIM), is proposed. It is inspired by the fact that the human visual system (HVS) is highly sensitive to edges that are often encountered in SCIs; therefore, essential edge features are extracted and exploited for conducting IQA for the SCIs. The key novelty of the proposed ESIM lies in the extraction and use of three salient edge features-i.e., edge contrast, edge width, and edge direction. The first two attributes are simultaneously generated from the input SCI based on a parametric edge model, while the last one is derived directly from the input SCI. The extraction of these three features will be performed for the reference SCI and the distorted SCI, individually. The degree of similarity measured for each above-mentioned edge attribute is then computed independently, followed by combining them together using our proposed edge-width pooling strategy to generate the final ESIM score. To conduct the performance evaluation of our proposed ESIM model, a new and the largest SCI database (denoted as SCID) is established in our work and made to the public for download. Our database contains 1800 distorted SCIs that are generated from 40 reference SCIs. For each SCI, nine distortion types are investigated, and five degradation levels are produced for each distortion type. Extensive simulation results have clearly shown that the proposed ESIM model is more consistent with the perception of the HVS on the evaluation of distorted SCIs than the multiple state-of-the-art IQA methods.
本文提出了一种用于评估屏幕内容图像 (SCI) 的精确全参考图像质量评估 (IQA) 模型,称为边缘相似性 (ESIM)。它的灵感来自于人类视觉系统 (HVS) 对 SCI 中经常遇到的边缘非常敏感的事实;因此,提取并利用了重要的边缘特征来进行 SCI 的 IQA。所提出的 ESIM 的主要新颖之处在于提取和使用三个显著的边缘特征,即边缘对比度、边缘宽度和边缘方向。前两个属性是根据参数化边缘模型从输入 SCI 中同时生成的,而最后一个则直接从输入 SCI 中得出。将对参考 SCI 和失真 SCI 分别提取这三个特征。然后,独立计算每个上述边缘属性的相似程度,然后使用我们提出的边缘宽度池化策略将它们组合在一起,生成最终的 ESIM 得分。为了对我们提出的 ESIM 模型进行性能评估,我们在工作中建立了一个新的、最大的 SCI 数据库(称为 SCID),并向公众提供下载。我们的数据库包含 1800 张失真 SCI,这些 SCI 是由 40 张参考 SCI 生成的。对于每个 SCI,研究了九种失真类型,并为每种失真类型生成了五个降级级别。大量的仿真结果清楚地表明,与多种最先进的 IQA 方法相比,所提出的 ESIM 模型在评估失真 SCI 时与 HVS 的感知更一致。