Chi Jianning, Zhang Yifei, Yu Xiaosheng, Wang Ying, Wu Chengdong
Faculty of Robot Science and Engineering, Northeastern University, Shenyang 110004, China.
College of Information Science and Engineering, Northeastern University, Shenyang 110004, China.
Sensors (Basel). 2019 Jul 30;19(15):3348. doi: 10.3390/s19153348.
Computed tomography (CT) imaging technology has been widely used to assist medical diagnosis in recent years. However, noise during the process of imaging, and data compression during the process of storage and transmission always interrupt the image quality, resulting in unreliable performance of the post-processing steps in the computer assisted diagnosis system (CADs), such as medical image segmentation, feature extraction, and medical image classification. Since the degradation of medical images typically appears as noise and low-resolution blurring, in this paper, we propose a uniform deep convolutional neural network (DCNN) framework to handle the de-noising and super-resolution of the CT image at the same time. The framework consists of two steps: Firstly, a dense-inception network integrating an inception structure and dense skip connection is proposed to estimate the noise level. The inception structure is used to extract the noise and blurring features with respect to multiple receptive fields, while the dense skip connection can reuse those extracted features and transfer them across the network. Secondly, a modified residual-dense network combined with joint loss is proposed to reconstruct the high-resolution image with low noise. The inception block is applied on each skip connection of the dense-residual network so that the structure features of the image are transferred through the network more than the noise and blurring features. Moreover, both the perceptual loss and the mean square error (MSE) loss are used to restrain the network, leading to better performance in the reconstruction of image edges and details. Our proposed network integrates the degradation estimation, noise removal, and image super-resolution in one uniform framework to enhance medical image quality. We apply our method to the Cancer Imaging Archive (TCIA) public dataset to evaluate its ability in medical image quality enhancement. The experimental results demonstrate that the proposed method outperforms the state-of-the-art methods on de-noising and super-resolution by providing higher peak signal to noise ratio (PSNR) and structure similarity index (SSIM) values.
近年来,计算机断层扫描(CT)成像技术已被广泛用于辅助医学诊断。然而,成像过程中的噪声以及存储和传输过程中的数据压缩总是会干扰图像质量,导致计算机辅助诊断系统(CADs)中的后处理步骤(如医学图像分割、特征提取和医学图像分类)性能不可靠。由于医学图像的退化通常表现为噪声和低分辨率模糊,在本文中,我们提出了一个统一的深度卷积神经网络(DCNN)框架,以同时处理CT图像的去噪和超分辨率问题。该框架由两个步骤组成:首先,提出了一种集成了Inception结构和密集跳跃连接的密集Inception网络来估计噪声水平。Inception结构用于提取关于多个感受野的噪声和模糊特征,而密集跳跃连接可以重用这些提取的特征并在网络中传递它们。其次,提出了一种结合联合损失的改进残差密集网络来重建低噪声的高分辨率图像。Inception块应用于密集残差网络的每个跳跃连接上,以便图像的结构特征比噪声和模糊特征更多地通过网络传递。此外,感知损失和均方误差(MSE)损失都用于约束网络,从而在图像边缘和细节的重建中表现更好。我们提出的网络在一个统一的框架中集成了退化估计、去噪和图像超分辨率,以提高医学图像质量。我们将我们的方法应用于癌症成像存档(TCIA)公共数据集,以评估其在医学图像质量增强方面的能力。实验结果表明,所提出的方法在去噪和超分辨率方面优于现有方法,提供了更高的峰值信噪比(PSNR)和结构相似性指数(SSIM)值。