Li Ming, Wang Chengjia, Zhang Heye, Yang Guang
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China; Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences, Shenzhen, China.
BHF Centre for Cardiovascular Science, The University of Edinburgh, Edinburgh, EH16 4TJ, UK.
Comput Biol Med. 2020 May;120:103728. doi: 10.1016/j.compbiomed.2020.103728. Epub 2020 Mar 24.
Multiview based learning has generally returned dividends in performance because additional information can be extracted for the representation of the diversity of different views. The advantage of multiview based learning fits the purpose of segmenting cardiac anatomy from multiview echocardiography, which is a non-invasive, low-cost and low-risk imaging modality. Nevertheless, it is still challenging because of limited training data, a poor signal-to-noise ratio of the echocardiographic data, and large variances across views for a joint learning. In addition, for a better interpretation of pathophysiological processes, clinical decision-making and prognosis, such cardiac anatomy segmentation and quantitative analysis of various clinical indices should ideally be performed for the data covering the full cardiac cycle. To tackle these challenges, a multiview recurrent aggregation network (MV-RAN) has been developed for the echocardiographic sequences segmentation with the full cardiac cycle analysis. Experiments have been carried out on multicentre and multi-scanner clinical studies consisting of spatio-temporal (2D + t) datasets. Compared to other state-of-the-art deep learning based methods, the MV-RAN method has achieved significantly superior results (0.92 ± 0.04 Dice scores) for the segmentation of the left ventricle on the independent testing datasets. For the estimation of clinical indices, our MV-RAN method has also demonstrated great promise and will undoubtedly propel forward the understanding of pathophysiological processes, computer-aided diagnosis and personalised prognosis using echocardiography.
基于多视图的学习通常在性能上带来了好处,因为可以提取额外的信息来表示不同视图的多样性。基于多视图的学习的优势符合从多视图超声心动图中分割心脏解剖结构的目的,超声心动图是一种非侵入性、低成本且低风险的成像方式。然而,由于训练数据有限、超声心动图数据的信噪比低以及联合学习时不同视图之间的差异大,这仍然具有挑战性。此外,为了更好地解释病理生理过程、进行临床决策和预后评估,理想情况下,应该对覆盖整个心动周期的数据进行这种心脏解剖结构分割和各种临床指标的定量分析。为了应对这些挑战,已经开发了一种多视图循环聚合网络(MV-RAN)用于超声心动图序列分割及全心动周期分析。已经在由时空(2D + t)数据集组成的多中心和多扫描仪临床研究上进行了实验。与其他基于深度学习的先进方法相比,MV-RAN方法在独立测试数据集上对左心室分割取得了显著更优的结果(Dice分数为0.92±0.04)。对于临床指标的估计,我们的MV-RAN方法也显示出了巨大的潜力,无疑将推动利用超声心动图对病理生理过程的理解、计算机辅助诊断和个性化预后评估。