Lei Yang, Xu Dong, Zhou Zhengyang, Higgins Kristin, Dong Xue, Liu Tian, Shim Hyunsuk, Mao Hui, Curran Walter J, Yang Xiaofeng
Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA 30322.
Department of Ultrasound Imaging, Zhejiang Cancer Hospital, Hangzhou, China 310022.
Proc SPIE Int Soc Opt Eng. 2018 Feb;10573. doi: 10.1117/12.2292891. Epub 2018 Mar 9.
We propose a high-resolution CT image retrieval method based on sparse convolutional neural network. The proposed framework is used to train the end-to-end mapping from low-resolution to high-resolution images. The patch-wise feature of low-resolution CT is extracted and sparsely represented by a convolutional layer and a learned iterative shrinkage threshold framework, respectively. Restricted linear unit is utilized to non-linearly map the low-resolution sparse coefficients to the high-resolution ones. An adaptive high-resolution dictionary is applied to construct the informative signature which is highly connected to a high-resolution patch. Finally, we feed the signature to a convolutional layer to reconstruct the predicted high-resolution patches and average these overlapping patches to generate high-resolution CT. The loss function between reconstructed images and the corresponding ground truth high-resolution images is applied to optimize the parameters of end-to-end neural network. The well-trained map is used to generate the high-resolution CT from a new low-resolution input. This technique was tested with brain and lung CT images and the image quality was assessed using the corresponding CT images. Peak signal-to-noise ratio (PSNR), structural similarity index (SSIM) and mean absolute error (MAE) indexes were used to quantify the differences between the generated high-resolution and corresponding ground truth CT images. The experimental results showed the proposed method could enhance images resolution from low-resolution images. The proposed method has great potential in improving radiation dose calculation and delivery accuracy and decreasing CT radiation exposure of patients.
我们提出了一种基于稀疏卷积神经网络的高分辨率CT图像检索方法。所提出的框架用于训练从低分辨率到高分辨率图像的端到端映射。低分辨率CT的逐块特征分别由卷积层和学习到的迭代收缩阈值框架进行提取和稀疏表示。使用受限线性单元将低分辨率稀疏系数非线性映射到高分辨率稀疏系数。应用自适应高分辨率字典来构建与高分辨率块高度相关的信息性特征。最后,我们将该特征输入到卷积层以重建预测的高分辨率块,并对这些重叠块进行平均以生成高分辨率CT。应用重建图像与相应的真实高分辨率图像之间的损失函数来优化端到端神经网络的参数。训练良好的映射用于从新的低分辨率输入生成高分辨率CT。该技术在脑部和肺部CT图像上进行了测试,并使用相应的CT图像评估了图像质量。使用峰值信噪比(PSNR)、结构相似性指数(SSIM)和平均绝对误差(MAE)指标来量化生成的高分辨率CT图像与相应真实CT图像之间的差异。实验结果表明,所提出的方法可以从低分辨率图像提高图像分辨率。该方法在提高辐射剂量计算和输送精度以及降低患者CT辐射暴露方面具有巨大潜力。