IEEE Trans Med Imaging. 2023 May;42(5):1349-1362. doi: 10.1109/TMI.2022.3227105. Epub 2023 May 2.
As a hybrid imaging technology, photoacoustic microscopy (PAM) imaging suffers from noise due to the maximum permissible exposure of laser intensity, attenuation of ultrasound in the tissue, and the inherent noise of the transducer. De-noising is an image processing method to reduce noise, and PAM image quality can be recovered. However, previous de-noising techniques usually heavily rely on manually selected parameters, resulting in unsatisfactory and slow de-noising performance for different noisy images, which greatly hinders practical and clinical applications. In this work, we propose a deep learning-based method to remove noise from PAM images without manual selection of settings for different noisy images. An attention enhanced generative adversarial network is used to extract image features and adaptively remove various levels of Gaussian, Poisson, and Rayleigh noise. The proposed method is demonstrated on both synthetic and real datasets, including phantom (leaf veins) and in vivo (mouse ear blood vessels and zebrafish pigment) experiments. In the in vivo experiments using synthetic datasets, our method achieves the improvement of 6.53 dB and 0.26 in peak signal-to-noise ratio and structural similarity metrics, respectively. The results show that compared with previous PAM de-noising methods, our method exhibits good performance in recovering images qualitatively and quantitatively. In addition, the de-noising processing speed of 0.016 s is achieved for an image with 256×256 pixels, which has the potential for real-time applications. Our approach is effective and practical for the de-noising of PAM images.
作为一种混合成像技术,光声显微镜(PAM)成像由于激光强度的最大允许暴露、组织中超声的衰减以及换能器的固有噪声而受到噪声的影响。去噪是一种图像处理方法,可降低噪声并恢复 PAM 图像质量。然而,以前的去噪技术通常严重依赖于手动选择参数,导致不同噪声图像的去噪性能不理想且缓慢,这极大地阻碍了实际和临床应用。在这项工作中,我们提出了一种基于深度学习的方法,可去除 PAM 图像中的噪声,而无需为不同的噪声图像手动选择设置。使用注意力增强的生成对抗网络来提取图像特征,并自适应地去除各种水平的高斯、泊松和瑞利噪声。该方法在合成和真实数据集上进行了演示,包括幻影(叶脉)和体内(小鼠耳朵血管和斑马鱼色素)实验。在使用合成数据集的体内实验中,我们的方法分别在峰值信噪比和结构相似性指标方面提高了 6.53dB 和 0.26。结果表明,与以前的 PAM 去噪方法相比,我们的方法在图像质量和数量上都具有良好的恢复性能。此外,对于 256×256 像素的图像,实现了 0.016s 的去噪处理速度,具有实时应用的潜力。我们的方法对于 PAM 图像的去噪是有效且实用的。