School of Computer Science, Southwest Petroleum University, Chengdu, Sichuan, China.
Department of Biomedical Engineering, Michigan Technological University, Houghton, MI, USA.
Ultrason Imaging. 2020 Mar;42(2):74-91. doi: 10.1177/0161734620902527. Epub 2020 Jan 30.
Accurate tracking of tissue motion is critically important for several ultrasound elastography methods. In this study, we investigate the feasibility of using three published convolution neural network (CNN) models built for optical flow (hereafter referred to as CNN-based tracking) by the computer vision community for breast ultrasound strain elastography. Elastographic datasets produced by finite element and ultrasound simulations were used to retrain three published CNN models: FlowNet-CSS, PWC-Net, and LiteFlowNet. After retraining, the three improved CNN models were evaluated using computer-simulated and tissue-mimicking phantoms, and in vivo breast ultrasound data. CNN-based tracking results were compared with two published two-dimensional (2D) speckle tracking methods: coupled tracking and GLobal Ultrasound Elastography (GLUE) methods. Our preliminary data showed that, based on the Wilcoxon rank-sum tests, the improvements due to retraining were statistically significant (p < 0.05) for all three CNN models. We also found that the PWC-Net model was the best neural network model for data investigated, and its overall performance was on par with the coupled tracking method. CNR values estimated from in vivo axial and lateral strain elastograms showed that the GLUE algorithm outperformed both the retrained PWC-Net model and the coupled tracking method, though the GLUE algorithm exhibited some biases. The PWC-Net model was also able to achieve approximately 45 frames/second for 2D speckle tracking data investigated.
准确跟踪组织运动对于几种超声弹性成像方法至关重要。在这项研究中,我们研究了计算机视觉社区为光流开发的三个已发表的卷积神经网络 (CNN) 模型(以下简称基于 CNN 的跟踪)在乳腺超声应变成像中的应用的可行性。使用有限元法和超声模拟产生的弹性数据集来重新训练三个已发表的 CNN 模型:FlowNet-CSS、PWC-Net 和 LiteFlowNet。在重新训练后,使用计算机模拟和组织模拟体模以及体内乳腺超声数据评估了三个改进的 CNN 模型。基于 CNN 的跟踪结果与两种已发表的二维 (2D) 散斑跟踪方法(耦合跟踪和 GLobal Ultrasound Elastography (GLUE) 方法)进行了比较。我们的初步数据表明,基于 Wilcoxon 秩和检验,对于所有三个 CNN 模型,重新训练的改进均具有统计学意义 (p < 0.05)。我们还发现,PWC-Net 模型是所研究数据的最佳神经网络模型,其整体性能与耦合跟踪方法相当。从体内轴向和横向应变弹性图估计的 CNR 值表明,GLUE 算法优于重新训练的 PWC-Net 模型和耦合跟踪方法,尽管 GLUE 算法存在一些偏差。PWC-Net 模型还能够实现大约 45 帧/秒的 2D 散斑跟踪数据。