Yi Xunpeng, Xu Han, Zhang Hao, Tang Linfeng, Ma Jiayi
IEEE Trans Pattern Anal Mach Intell. 2025 Aug;47(8):6823-6841. doi: 10.1109/TPAMI.2025.3563612.
This paper proposes a Retinex-driven reinforced diffusion model for low-light image enhancement, termed Diff-Retinex++, to address various degradations caused by low light. Our main approach integrates the diffusion model with Retinex-driven restoration to achieve physically-inspired generative enhancement, making it a pioneering effort. To be detailed, Diff-Retinex++ consists of two-stage view modules, including the Denoising Diffusion Model (DDM), and the Retinex-Driven Mixture of Experts Model (RMoE). First, DDM treats low-light image enhancement as one type of image generation task, benefiting from the powerful generation ability of diffusion model to handle the enhancement. Second, we design the Retinex theory into the plug-and-play supervision attention module. It leverages the latent features in the backbone and knowledge distillation to learn Retinex rules, and further regulates these latent features through the attention mechanism. In this way, it couples the relationship between Retinex decomposition and image enhancement in a new view, achieving dual improvement. In addition, the Low-Light Mixture of Experts preserves the vividness of the diffusion model and fidelity of the Retinex-driven restoration to the greatest extent. Ultimately, the iteration of DDM and RMoE achieves the goal of Retinex-driven reinforced diffusion model. Extensive experiments conducted on real-world low-light datasets qualitatively and quantitatively demonstrate the effectiveness, superiority, and generalization of the proposed method.
本文提出了一种用于低光照图像增强的基于视网膜皮层理论驱动的强化扩散模型,称为Diff-Retinex++,以解决低光照引起的各种退化问题。我们的主要方法是将扩散模型与基于视网膜皮层理论的恢复方法相结合,以实现受物理启发的生成式增强,这是一项开创性的工作。具体来说,Diff-Retinex++由两阶段视图模块组成,包括去噪扩散模型(DDM)和基于视网膜皮层理论驱动的专家混合模型(RMoE)。首先,DDM将低光照图像增强视为一种图像生成任务,受益于扩散模型强大的生成能力来处理增强。其次,我们将视网膜皮层理论设计到即插即用的监督注意力模块中。它利用主干中的潜在特征和知识蒸馏来学习视网膜皮层规则,并通过注意力机制进一步调节这些潜在特征。通过这种方式,它以一种新的视角将视网膜皮层分解与图像增强之间的关系耦合起来,实现了双重改进。此外,低光照专家混合模型在最大程度上保留了扩散模型的生动性和基于视网膜皮层理论驱动的恢复的保真度。最终,DDM和RMoE的迭代实现了基于视网膜皮层理论驱动的强化扩散模型的目标。在真实世界的低光照数据集上进行的大量实验从定性和定量方面证明了所提方法的有效性、优越性和通用性。