van Knippenberg Luuk, van Sloun Ruud J G, Mischi Massimo, de Ruijter Joerik, Lopata Richard, Bouwman R Arthur
Department of Electrical Engineering, Eindhoven University of Technology, the Netherlands.
Department of Electrical Engineering, Eindhoven University of Technology, the Netherlands; Department of Anesthesiology, Catharina Hospital Eindhoven, the Netherlands.
Comput Methods Programs Biomed. 2022 Oct;225:107037. doi: 10.1016/j.cmpb.2022.107037. Epub 2022 Jul 22.
Automatic vessel segmentation in ultrasound is challenging due to the quality of the ultrasound images, which is affected by attenuation, high level of speckle noise and acoustic shadowing. Recently, deep convolutional neural networks are increasing in popularity due to their great performance on image segmentation problems, including vessel segmentation. Traditionally, large labeled datasets are required to train a network that achieves high performance, and is able to generalize well to different orientations, transducers and ultrasound scanners. However, these large datasets are rare, given that it is challenging and time-consuming to acquire and manually annotate in-vivo data.
In this work, we present a model-based, unsupervised domain adaptation method that consists of two stages. In the first stage, the network is trained on simulated ultrasound images, which have an accurate ground truth. In the second stage, the network continues training on in-vivo data in an unsupervised way, therefore not requiring the data to be labelled. Rather than using an adversarial neural network, prior knowledge on the elliptical shape of the segmentation mask is used to detect unexpected outputs.
The segmentation performance was quantified using manually segmented images as ground truth. Due to the proposed domain adaptation method, the median Dice similarity coefficient increased from 0 to 0.951, outperforming a domain adversarial neural network (median Dice 0.922) and a state-of-the-art Star-Kalman algorithm that was specifically designed for this dataset (median Dice 0.942).
The results show that it is feasible to first train a neural network on simulated data, and then apply model-based domain adaptation to further improve segmentation performance by training on unlabeled in-vivo data. This overcomes the limitation of conventional deep learning approaches to require large amounts of manually labeled in-vivo data. Since the proposed domain adaptation method only requires prior knowledge on the shape of the segmentation mask, performance can be explored in various domains and applications in future research.
由于超声图像质量受衰减、高水平斑点噪声和声学阴影影响,超声中的血管自动分割具有挑战性。近年来,深度卷积神经网络因其在包括血管分割在内的图像分割问题上的出色表现而越来越受欢迎。传统上,需要大型标记数据集来训练一个性能高且能很好地推广到不同方向、换能器和超声扫描仪的网络。然而,这些大型数据集很罕见,因为获取和手动标注体内数据具有挑战性且耗时。
在这项工作中,我们提出了一种基于模型的无监督域适应方法,该方法包括两个阶段。在第一阶段,网络在具有准确真值的模拟超声图像上进行训练。在第二阶段,网络以无监督方式继续对体内数据进行训练,因此不需要对数据进行标注。不是使用对抗神经网络,而是利用分割掩码椭圆形状的先验知识来检测意外输出。
使用手动分割图像作为真值来量化分割性能。由于所提出的域适应方法,中位数骰子相似系数从0增加到0.951,优于域对抗神经网络(中位数骰子系数为0.922)和专门为该数据集设计的最先进的星卡尔曼算法(中位数骰子系数为0.942)。
结果表明,首先在模拟数据上训练神经网络,然后应用基于模型的域适应通过对未标记的体内数据进行训练来进一步提高分割性能是可行的。这克服了传统深度学习方法需要大量手动标记的体内数据的局限性。由于所提出的域适应方法仅需要关于分割掩码形状的先验知识,未来研究中可以在各种领域和应用中探索其性能。