School of Computer Engineering and Science, Shanghai University, Shanghai, China.
Shanghai Six Peoples' Hospital Affiliated to Shanghai Jiao Tong University School of Medicine.
Ultrasound Med Biol. 2023 Feb;49(2):489-496. doi: 10.1016/j.ultrasmedbio.2022.09.017. Epub 2022 Oct 31.
Ultrasonography is regarded as an effective technique for the detection, diagnosis and monitoring of thyroid nodules. Segmentation of thyroid nodules on ultrasound images is important in clinical practice. However, because in ultrasound images there is an unclear boundary between thyroid nodules and surrounding tissues, the accuracy of segmentation remains a challenge. Although the deep learning model provides an accurate and convenient method for thyroid nodule segmentation, it is unsatisfactory of the existing model in segmenting the margin of thyroid nodules. In this study, we developed boundary attention transformer net (BTNet), a novel segmentation network with a boundary attention mechanism combining the advantages of a convolutional neural network and transformer, which could fuse the features of both long and short ranges. Boundary attention is improved to focus on learning the boundary information, and this module enhances the segmentation ability of the network boundary. For features of different scales, we also incorporate a deep supervision mechanism to blend the outputs of different levels to enhance the segmentation effect. As the BTNet model incorporates the long range-short range connectivity effect and the boundary-regional cooperation capability, our model has excellent segmentation performance in thyroid nodule segmentation. The development of BTNet was based on the data set from Shanghai Jiao Tong University School of Medicine Affiliated Sixth People's Hospital and the public data set. BTNet achieved good performance in the segmentation of thyroid nodules with an intersection-over-union of 0.810 and Dice coefficient of 0.892 Moreover, our work revealed great improvement in the boundary metrics; for example, the boundary distance was 7.308, the boundary overlap 0.201 and the boundary Dice 0.194, all with p values <0.05.
超声检查被认为是检测、诊断和监测甲状腺结节的有效技术。在临床实践中,对超声图像中的甲状腺结节进行分割是很重要的。然而,由于甲状腺结节与周围组织之间的边界不清晰,因此分割的准确性仍然是一个挑战。尽管深度学习模型为甲状腺结节分割提供了一种准确、方便的方法,但现有的模型在分割甲状腺结节边界方面并不令人满意。在本研究中,我们开发了边界注意转换器网络(BTNet),这是一种新型的分割网络,具有边界注意机制,结合了卷积神经网络和转换器的优点,可以融合长距离和短距离的特征。边界注意得到了改进,可以集中学习边界信息,该模块增强了网络边界的分割能力。对于不同尺度的特征,我们还引入了深度监督机制,融合不同层次的输出,以增强分割效果。由于 BTNet 模型结合了长距离-短距离连接效应和边界-区域协作能力,因此在甲状腺结节分割中具有出色的分割性能。BTNet 的开发基于上海交通大学医学院附属第六人民医院的数据集和公共数据集。BTNet 在甲状腺结节分割方面表现良好,其交并比为 0.810,Dice 系数为 0.892。此外,我们的工作在边界指标上有了很大的提高,例如边界距离为 7.308,边界重叠为 0.201,边界 Dice 为 0.194,所有这些指标的 p 值均小于 0.05。