School of Information Technology and Electrical Engineering, University of Queensland, Brisbane, Australia.
ACRF Image X Institute, School of Health Sciences, University of Sydney, Sydney, Australia.
Med Phys. 2021 Jun;48(6):2991-3002. doi: 10.1002/mp.14861. Epub 2021 Apr 20.
The hybrid system combining a magnetic resonance imaging (MRI) scanner with a linear accelerator (Linac) has become increasingly desirable for tumor treatment because of excellent soft tissue contrast and nonionizing radiation. However, image distortions caused by gradient nonlinearity (GNL) can have detrimental impacts on real-time radiotherapy using MRI-Linac systems, where accurate geometric information of tumors is essential.
In this work, we proposed a deep convolutional neural network-based method to efficiently recover undistorted images (ReUINet) for real-time image guidance. The ReUINet, based on the encoder-decoder structure, was created to learn the relationship between the undistorted images and distorted images. The ReUINet was pretrained and tested on a publically available brain MR image dataset acquired from 23 volunteers. Then, transfer learning was adopted to implement the pretrained model (i.e., network with optimal weights) on the experimental three-dimensional (3D) grid phantom and in-vivo pelvis image datasets acquired from the 1.0 T Australian MRI-Linac system.
Evaluations on the phantom (768 slices) and pelvis data (88 slices) showed that the ReUINet achieved improvement over 15 times and 45 times on computational efficiency in comparison with standard interpolation and GNL-encoding methods, respectively. Moreover, qualitative and quantitative results demonstrated that the ReUINet provided better correction results than the standard interpolation method, and comparable performance compared to the GNL-encoding approach.
Validated by simulation and experimental results, the proposed ReUINet showed promise in obtaining accurate MR images for the implementation of real-time MRI-guided radiotherapy.
由于磁共振成像(MRI)扫描仪与线性加速器(Linac)相结合的混合系统具有出色的软组织对比度和非电离辐射,因此越来越希望将其用于肿瘤治疗。然而,梯度非线性(GNL)引起的图像失真会对使用 MRI-Linac 系统的实时放射治疗产生不利影响,因为在这种治疗中,肿瘤的准确几何信息至关重要。
在这项工作中,我们提出了一种基于深度卷积神经网络的方法,用于高效恢复实时图像引导所需的未失真图像(ReUINet)。ReUINet 基于编解码器结构,旨在学习未失真图像和失真图像之间的关系。在从 23 名志愿者采集的公开脑部 MR 图像数据集上对 ReUINet 进行预训练和测试。然后,采用迁移学习将预训练模型(即具有最佳权重的网络)应用于在 1.0 T 澳大利亚 MRI-Linac 系统上采集的实验三维(3D)网格体模和体内骨盆图像数据集。
在体模(768 个切片)和骨盆数据(88 个切片)上的评估表明,与标准插值和 GNL 编码方法相比,ReUINet 在计算效率方面分别提高了 15 倍和 45 倍。此外,定性和定量结果表明,ReUINet 提供了比标准插值方法更好的校正结果,并且与 GNL 编码方法的性能相当。
模拟和实验结果验证了所提出的 ReUINet 有望获得用于实时 MRI 引导放射治疗的准确 MR 图像。