Zhu Hongzheng, Zhao Yingjuan, Qiao Ximing, Zhang Jinshuo, Ma Jingnan, Tong Sheng
Air Traffic Control and Navigation School, Air Force Engineering University, Xi'an 710051, China.
Fundamentals Department, Air Force Engineering University, Xi'an 710051, China.
Sensors (Basel). 2025 Aug 31;25(17):5373. doi: 10.3390/s25175373.
Image super-resolution (SR) techniques can significantly enhance visual quality and information density. However, existing methods often rely on large amounts of paired low- and high-resolution (LR-HR) data, which limits their generalization and robustness when faced with data scarcity, distribution inconsistencies, and missing high-frequency details. To tackle the challenges of image reconstruction in data-scarce scenarios, this paper proposes a semi-supervised learning-driven multi-fidelity fusion (SSLMF) method, which integrates multi-fidelity data fusion (MFDF) and semi-supervised learning (SSL) to reduce reliance on high-fidelity data. More specifically, (1) an MFDF strategy is employed to leverage low-fidelity data for global structural constraints, enhancing information compensation; (2) an SSL mechanism is introduced to reduce data dependence by using only a small amount of labeled HR samples along with a large quantity of unlabeled multi-fidelity data. This framework significantly improves data efficiency and reconstruction quality. We first validate the reconstruction accuracy of SSLMF on benchmark functions and then apply it to image reconstruction tasks. The results demonstrate that SSLMF can effectively model both linear and nonlinear relationships among multi-fidelity data, maintaining high performance even with limited high-fidelity samples. Finally, its cross-disciplinary potential is illustrated through an audio restoration case study, offering a novel solution for efficient image reconstruction, especially in data-scarce scenarios where high-fidelity samples are limited.
图像超分辨率(SR)技术可以显著提高视觉质量和信息密度。然而,现有方法通常依赖大量成对的低分辨率和高分辨率(LR-HR)数据,这限制了它们在面对数据稀缺、分布不一致和高频细节缺失时的泛化能力和鲁棒性。为了解决数据稀缺场景下的图像重建挑战,本文提出了一种半监督学习驱动的多保真融合(SSLMF)方法,该方法将多保真数据融合(MFDF)和半监督学习(SSL)相结合,以减少对高保真数据的依赖。具体来说,(1)采用MFDF策略利用低保真数据进行全局结构约束,增强信息补偿;(2)引入SSL机制,通过仅使用少量带标签的HR样本以及大量未标记的多保真数据来减少数据依赖性。该框架显著提高了数据效率和重建质量。我们首先在基准函数上验证了SSLMF的重建精度,然后将其应用于图像重建任务。结果表明,SSLMF可以有效地对多保真数据之间的线性和非线性关系进行建模,即使在高保真样本有限的情况下也能保持高性能。最后,通过一个音频恢复案例研究展示了其跨学科潜力,为高效图像重建提供了一种新颖的解决方案,特别是在高保真样本有限的数据稀缺场景中。