Thummerer Adrian, Schmidt Lukas, Hofmaier Jan, Corradini Stefanie, Belka Claus, Landry Guillaume, Kurz Christopher
Department of Radiation Oncology, LMU University Hospital, LMU Munich, Munich, Germany.
German Cancer Consortium (DKTK), Partner Site Munich, A Partnership Between DKFZ and LMU University Hospital Munich Germany, Munich, Germany.
Med Phys. 2025 Mar;52(3):1629-1642. doi: 10.1002/mp.17557. Epub 2024 Dec 3.
Cone-beam computed tomography (CBCT) is a crucial daily imaging modality in image-guided and adaptive radiotherapy. However, the use of ionizing radiation in CBCT imaging increases the risk of secondary cancers, which is particularly concerning for pediatric patients. Deep learning super-resolution has shown promising results in enhancing the resolution of photographic and medical images but has not yet been explored in the context of CBCT dose reduction.
To facilitate CBCT imaging dose reduction, we propose using an enhanced super-resolution generative adversarial network (ESRGAN) in both the projection and image domains to restore the image quality of low-dose CBCT.
An extensive projection database, containing 2997 CBCT scans from head and neck cancer patients, was used to train two different ESRGAN models to generate super-resolution CBCTs. One model operated in the projection domain, using pairs of simulated low-resolution (low-dose) and original high-resolution (high-dose) projections and yielded CBCT. The other model operated in the image domain, using pairs of axial slices from reconstructed low-resolution and high-resolution CBCTs (CBCT and CBCT) and resulted in CBCT. Super-resolution CBCTs were evaluated in terms of image similarity (MAE, ME, PSNR, and SSIM), noise characteristics, spatial resolution, and registration accuracy, using the original CBCT as a reference. To test the perceptual difference between the original and super-resolution CBCT, we performed a visual Turing test.
Visually, both super-resolution approaches in the projection and image domains improved the image quality of low-dose CBCTs. This was confirmed by the visual Turing test, that showed low accuracy, sensitivity, and specificity, indicating almost no perceptual difference between CBCT and the super-resolution CBCTs. CBCT (accuracy: 0.55, sensitivity: 0.59, specificity: 0.50) performed slightly better than CBCT (accuracy: 0.59, sensitivity: 0.61, specificity: 0.57). Image similarity metrics were affected by varying noise levels and did not reflect the visual improvements, with MAE/ME/PSNR/SSIM values of 110.4 HU/2.9 HU/40.4 dB/0.82 for CBCT, 136.6 HU/-0.4 HU/38.6 dB/0.77 for CBCT, and 128.2 HU/1.9 HU/39.0 dB/0.80 for CBCT. In terms of spatial resolution, quantified by calculating 10% levels of the task transfer function, both CBCT and CBCT outperformed CBCT and nearly matched the reference CBCT (CBCT: 0.66 lp/mm, CBCT: 0.88 lp/mm, CBCT: 0.95 lp/mm, CBCT: 1.01 lp/mm). Noise characteristics of CBCT and CBCT were comparable to the reference CBCT. Registration parameters showed negligible differences for all CBCTs (CBCT, CBCT, CBCT), with average absolute differences in registration parameters being below 0.4° for rotations and below 0.06 mm for translations (CBCT as reference).
This study demonstrates that deep learning can be a valuable tool for CBCT dose reduction in CBCT-guided radiotherapy by acquiring low-dose CBCTs and restoring the image quality using deep learning super-resolution. The results suggest that higher quality images can be generated when super-resolution is performed in the image domain compared to the projection domain.
锥束计算机断层扫描(CBCT)是图像引导放疗和自适应放疗中至关重要的日常成像方式。然而,CBCT成像中电离辐射的使用增加了继发癌症的风险,这对于儿科患者尤为令人担忧。深度学习超分辨率在提高摄影图像和医学图像分辨率方面已显示出有前景的结果,但尚未在CBCT剂量降低的背景下进行探索。
为促进CBCT成像剂量降低,我们建议在投影域和图像域中使用增强型超分辨率生成对抗网络(ESRGAN)来恢复低剂量CBCT的图像质量。
使用一个包含2997例头颈癌患者CBCT扫描的广泛投影数据库来训练两个不同的ESRGAN模型,以生成超分辨率CBCT。一个模型在投影域中运行,使用模拟的低分辨率(低剂量)和原始高分辨率(高剂量)投影对来生成CBCT。另一个模型在图像域中运行,使用重建的低分辨率和高分辨率CBCT的轴向切片对(CBCT和CBCT)来生成CBCT。以原始CBCT作为参考,从图像相似度(MAE、ME、PSNR和SSIM)、噪声特征、空间分辨率和配准精度方面对超分辨率CBCT进行评估。为测试原始CBCT和超分辨率CBCT之间的感知差异,我们进行了视觉图灵测试。
在视觉上,投影域和图像域中的两种超分辨率方法均改善了低剂量CBCT的图像质量。视觉图灵测试证实了这一点,该测试显示出较低的准确性、敏感性和特异性,表明CBCT与超分辨率CBCT之间几乎没有感知差异。CBCT(准确性:0.55,敏感性:0.59,特异性:0.50)的表现略优于CBCT(准确性:0.59,敏感性:0.61,特异性:0.57)。图像相似度指标受不同噪声水平的影响,并未反映出视觉上的改善,CBCT的MAE/ME/PSNR/SSIM值分别为110.4 HU/2.9 HU/40.4 dB/0.82,CBCT为136.6 HU/-0.4 HU/38.6 dB/0.77,CBCT为128.2 HU/1.9 HU/39.0 dB/0.80。在空间分辨率方面,通过计算任务传递函数的10%水平进行量化,CBCT和CBCT均优于CBCT,且几乎与参考CBCT匹配(CBCT:0.66 lp/mm,CBCT:0.88 lp/mm,CBCT:0.95 lp/mm,CBCT:1.01 lp/mm)。CBCT和CBCT的噪声特征与参考CBCT相当。所有CBCT(CBCT、CBCT、CBCT)的配准参数差异可忽略不计,以CBCT作为参考时,配准参数的平均绝对差异在旋转方面低于0.4°,在平移方面低于0.06 mm。
本研究表明,深度学习可成为CBCT引导放疗中降低CBCT剂量的有价值工具,通过获取低剂量CBCT并使用深度学习超分辨率恢复图像质量。结果表明,与投影域相比,在图像域中进行超分辨率时可生成更高质量的图像。