Zhang K, Yu J, Jin S, Su Z, Xu X, Zhang H
School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China.
Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University, Guangzhou 510515, China.
Nan Fang Yi Ke Da Xue Xue Bao. 2022 Dec 20;42(12):1858-1866. doi: 10.12122/j.issn.1673-4254.2022.12.15.
To propose a deep learning model for modeling and prediction of the integration of respiratory motion in all directions.
The respiratory motion signals in different directions were input into the sequential embedding layer composed of LSTM to capture the sequential dependence of the historical motion state and obtain the sequential embedding representation, which enabled relational embedding in all directions through the self-attention mechanism to obtain the relational embedding representation. The sequential embedding representation and the relational embedding representation were concatenated and input into a prediction layer consisting of a fully connected neural network to generate nonlinear prediction components, which were added to the linear prediction components generated by the autoregressive module parallel to the above structure to generate the final prediction. The model was trained using a 'pre-training + fine-tuning' approach. In the validation experiments, 304 respiratory motion trajectories were used for model pre-training, and 7 evaluation samples were used for model testing.
The proposed prediction model achieved more accurate prediction results than other methods. For the 7 evaluation samples with different delay time, the proposed prediction model achieved a reduction of absolute deviations in the 3D directions by over 70%.
The proposed model is capable of accurate prediction of respiratory motion and can thus help to reduce system delay in precise radiotherapy.
提出一种用于对各个方向呼吸运动整合进行建模和预测的深度学习模型。
将不同方向的呼吸运动信号输入由长短期记忆网络(LSTM)组成的序列嵌入层,以捕捉历史运动状态的序列依赖性并获得序列嵌入表示,通过自注意力机制在各个方向上实现关系嵌入以获得关系嵌入表示。将序列嵌入表示和关系嵌入表示连接起来并输入到由全连接神经网络组成的预测层,以生成非线性预测分量,将其与由与上述结构并行的自回归模块生成的线性预测分量相加,以生成最终预测。该模型采用“预训练+微调”方法进行训练。在验证实验中,使用304条呼吸运动轨迹进行模型预训练,使用7个评估样本进行模型测试。
所提出的预测模型比其他方法取得了更准确的预测结果。对于7个具有不同延迟时间的评估样本,所提出的预测模型在三维方向上实现了超过70%的绝对偏差减少。
所提出的模型能够准确预测呼吸运动,从而有助于减少精确放射治疗中的系统延迟。