Grover James, Liu Paul, Dong Bin, Shan Shanshan, Whelan Brendan, Keall Paul, Waddington David E J
Image X Institute, Sydney School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia.
Department of Medical Physics, Ingham Institute for Applied Medical Research, Sydney, NSW, Australia.
Commun Med (Lond). 2024 Apr 4;4(1):64. doi: 10.1038/s43856-024-00489-9.
Magnetic resonance imaging (MRI) offers superb non-invasive, soft tissue imaging of the human body. However, extensive data sampling requirements severely restrict the spatiotemporal resolution achievable with MRI. This limits the modality's utility in real-time guidance applications, particularly for the rapidly growing MRI-guided radiation therapy approach to cancer treatment. Recent advances in artificial intelligence (AI) could reduce the trade-off between the spatial and the temporal resolution of MRI, thus increasing the clinical utility of the imaging modality.
We trained deep learning-based super-resolution neural networks to increase the spatial resolution of real-time MRI. We developed a framework to integrate neural networks directly onto a 1.0 T MRI-linac enabling real-time super-resolution imaging. We integrated this framework with the targeting system of the MRI-linac to demonstrate real-time beam adaptation with super-resolution-based imaging. We tested the integrated system using large publicly available datasets, healthy volunteer imaging, phantom imaging, and beam tracking experiments using bicubic interpolation as a baseline comparison.
Deep learning-based super-resolution increases the spatial resolution of real-time MRI across a variety of experiments, offering measured performance benefits compared to bicubic interpolation. The temporal resolution is not compromised as measured by a real-time adaptation latency experiment. These two effects, an increase in the spatial resolution with a negligible decrease in the temporal resolution, leads to a net increase in the spatiotemporal resolution.
Deployed super-resolution neural networks can increase the spatiotemporal resolution of real-time MRI. This has applications to domains such as MRI-guided radiation therapy and interventional procedures.
磁共振成像(MRI)能够提供出色的人体软组织无创成像。然而,大量的数据采样需求严重限制了MRI可实现的时空分辨率。这限制了该模态在实时引导应用中的效用,特别是对于快速发展的MRI引导放射治疗癌症的方法。人工智能(AI)的最新进展可以减少MRI空间分辨率和时间分辨率之间的权衡,从而提高该成像模态的临床效用。
我们训练了基于深度学习的超分辨率神经网络,以提高实时MRI的空间分辨率。我们开发了一个框架,将神经网络直接集成到1.0 T MRI直线加速器上,实现实时超分辨率成像。我们将这个框架与MRI直线加速器的靶向系统集成,以展示基于超分辨率成像进行实时束流适配。我们使用大型公开可用数据集、健康志愿者成像、体模成像以及以双立方插值作为基线比较的束流跟踪实验来测试集成系统。
基于深度学习的超分辨率在各种实验中提高了实时MRI的空间分辨率,与双立方插值相比,显示出实测的性能优势。通过实时适配延迟实验测量,时间分辨率没有受到影响。这两种效果,即空间分辨率增加而时间分辨率仅有可忽略不计的降低,导致时空分辨率的净增加。
部署的超分辨率神经网络可以提高实时MRI的时空分辨率。这在MRI引导放射治疗和介入程序等领域有应用。