Easysignal Group, State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology, Department of Automation, Tsinghua University, Beijing 100084, China.
Comput Biol Med. 2022 Oct;149:106090. doi: 10.1016/j.compbiomed.2022.106090. Epub 2022 Sep 6.
In recent years, deep learning techniques have demonstrated promising performances in echocardiography (echo) data segmentation, which constitutes a critical step in the diagnosis and prognosis of cardiovascular diseases (CVDs). However, their successful implementation requires large number and high-quality annotated samples, whose acquisition is arduous and expertise-demanding. To this end, this study aims at circumventing the tedious, time-consuming and expertise-demanding data annotation involved in deep learning-based echo data segmentation.
We propose a two-phase framework for fast generation of annotated echo data needed for implementing intelligent cardiac structure segmentation systems. First, multi-size and multi-orientation cardiac structures are simulated leveraging polynomial fitting method. Second, the obtained cardiac structures are embedded onto curated endoscopic ultrasound images using Fourier Transform algorithm, resulting in pairs of annotated samples. The practical significance of the proposed framework is validated through using the generated realistic annotated images as auxiliary dataset to pretrain deep learning models for automatic segmentation of left ventricle and left ventricle wall in real echo data, respectively.
Extensive experimental analyses indicate that compared with training from scratch, fine-tuning after pretraining with the generated dataset always results in significant performance improvement whereby the improvement margins in terms of Dice and IoU can reach 12.9% and 7.74%, respectively.
The proposed framework has great potential to overcome the shortage of labeled data hampering the deployment of deep learning approaches in echo data analysis.
近年来,深度学习技术在超声心动图(echo)数据分割方面表现出了很有前景的性能,这是心血管疾病(CVDs)诊断和预后的关键步骤。然而,它们的成功实施需要大量的高质量标注样本,而这些样本的获取是艰巨且需要专业知识的。为此,本研究旨在避免基于深度学习的回声数据分割中涉及的繁琐、耗时且需要专业知识的数据标注。
我们提出了一个两阶段框架,用于快速生成用于实现智能心脏结构分割系统所需的标注回声数据。首先,利用多项式拟合方法模拟多尺寸和多方向的心脏结构。其次,使用傅里叶变换算法将获得的心脏结构嵌入到经过精心策划的内镜超声图像中,从而生成一对标注样本。通过将生成的真实标注图像用作辅助数据集来预训练深度学习模型,分别用于自动分割真实回声数据中的左心室和左心室壁,从而验证了所提出框架的实际意义。
广泛的实验分析表明,与从头开始训练相比,使用生成数据集进行微调后的预训练总是会导致性能显著提高,在 Dice 和 IoU 方面的提高幅度分别可达 12.9%和 7.74%。
所提出的框架具有很大的潜力,可以克服阻碍深度学习方法在回声数据分析中应用的标注数据不足的问题。