School of Automation, Northwestern Polytechnical University, Xi'an, 710129, People's Republic of China.
The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, 213003, People's Republic of China; Center of Medical Physics, Nanjing Medical University, Changzhou, 213003,People's Republic of China.
Comput Methods Programs Biomed. 2022 Jun;221:106932. doi: 10.1016/j.cmpb.2022.106932. Epub 2022 Jun 3.
Multi-modal medical images with multiple feature information are beneficial for radiotherapy. A new radiotherapy treatment mode based on triangle generative adversarial network (TGAN) model was proposed to synthesize pseudo-medical images between multi-modal datasets.
CBCT, MRI and CT images of 80 patients with nasopharyngeal carcinoma were selected. The TGAN model based on multi-scale discriminant network was used for data training between different image domains. The generator of the TGAN model refers to cGAN and CycleGAN, and only one generation network can establish the non-linear mapping relationship between multiple image domains. The discriminator used multi-scale discrimination network to guide the generator to synthesize pseudo-medical images that are similar to real images from both shallow and deep aspects. The accuracy of pseudo-medical images was verified in anatomy and dosimetry.
In the three synthetic directions, namely, CBCT → CT, CBCT → MRI, and MRI → CT, significant differences (p < 0.05) in the three-fold-cross validation results on PSNR and SSIM metrics between the pseudo-medical images obtained based on TGAN and the real images. In the testing stage, for TGAN, the MAE metric results in the three synthesis directions (CBCT → CT, CBCT → MRI, and MRI → CT) were presented as mean (standard deviation), which were 68.67 (5.83), 83.14 (8.48), and 79.96 (7.59), and the NMI metric results were 0.8643 (0.0253), 0.8051 (0.0268), and 0.8146 (0.0267) respectively. In terms of dose verification, the differences in dose distribution between the pseudo-CT obtained by TGAN and the real CT were minimal. The H values of the measurement results of dose uncertainty in PGTV, PGTVnd, PTV1, and PTV2 were 42.510, 43.121, 17.054, and 7.795, respectively (P < 0.05). The differences were statistically significant. The gamma pass rate (2%/2 mm) of pseudo-CT obtained by the new model was 94.94% (0.73%), and the numerical results were better than those of the three other comparison models.
The pseudo-medical images acquired based on TGAN were close to the real images in anatomy and dosimetry. The pseudo-medical images synthesized by the TGAN model have good application prospects in clinical adaptive radiotherapy.
具有多种特征信息的多模态医学图像有利于放射治疗。本文提出了一种基于三角生成对抗网络(TGAN)模型的新放疗治疗模式,用于在多模态数据集中合成伪医学图像。
选取 80 例鼻咽癌患者的 CBCT、MRI 和 CT 图像。基于多尺度判别网络的 TGAN 模型用于不同图像域之间的数据训练。TGAN 模型的生成器参考 cGAN 和 CycleGAN,仅使用一个生成网络即可建立多个图像域之间的非线性映射关系。判别器使用多尺度判别网络从浅层和深层引导生成器合成与真实图像相似的伪医学图像。从解剖和剂量学两方面验证伪医学图像的准确性。
在三种合成方向,即 CBCT→CT、CBCT→MRI 和 MRI→CT 中,基于 TGAN 获得的伪医学图像与真实图像在 PSNR 和 SSIM 度量的三折交叉验证结果中存在显著差异(p<0.05)。在测试阶段,对于 TGAN,在三个合成方向(CBCT→CT、CBCT→MRI 和 MRI→CT)的 MAE 度量结果分别为平均值(标准差),分别为 68.67(5.83)、83.14(8.48)和 79.96(7.59),NMI 度量结果分别为 0.8643(0.0253)、0.8051(0.0268)和 0.8146(0.0267)。在剂量验证方面,基于 TGAN 获得的伪 CT 与真实 CT 的剂量分布差异最小。PGTV、PGTVnd、PTV1 和 PTV2 测量结果的 H 值分别为 42.510、43.121、17.054 和 7.795(P<0.05),差异具有统计学意义。新模型获得的伪 CT 的伽马通过率(2%/2mm)为 94.94%(0.73%),数值结果优于其他三种比较模型。
基于 TGAN 获得的伪医学图像在解剖学和剂量学方面与真实图像接近。TGAN 模型合成的伪医学图像在临床自适应放疗中具有良好的应用前景。