Liu Chuanba, Wang Wenshuo, Sun Rui, Wang Teng, Shen Xiantao, Sun Tao
Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, China.
International Institute for Innovative Design and Intelligent Manufacturing of Tianjin University in Zhejiang, Shaoxing, China.
Med Phys. 2025 Mar;52(3):1556-1572. doi: 10.1002/mp.17545. Epub 2024 Dec 9.
Ultrasound (US) has great potential for application in computer-assisted orthopedic surgery (CAOS) due to its non-radiative, cost-effective, and portable traits. However, bone segmentation from low-quality US images has been challenging. Traditional segmentation methods cannot achieve satisfactory results due to their high customization and dependence on bone morphology. Existing deep learning-based methods make it difficult to ensure efficient and accurate segmentation due to the ignorance of prior knowledge of bone features during feature learning.
This paper aims to systematically investigate feature extraction and segmentation methodologies of bone US images and then proposes an innovative convolutional neural network to address the need for precise and efficient bone structure extraction in CAOS.
This paper has proposed a dual-decoder banded convolutional attention network (BCA-Net), which takes the raw US image as input and simplified U-Net as the baseline network. Multiscale banded convolution kernels are employed internally in the BCA-Net model, leveraging the prior knowledge that bone surfaces in US images are exhibited as bright bands of a few millimeters in width. Additionally, a shared encoder to extract input features and two independent decoders to generate outputs for the bone surface and bone shadow mask are integrated into the BCA-Net model, leveraging the prior knowledge that US bone surfaces manifest low-intensity hollow shadows below. Then, a new task consistency loss is introduced that can utilize inter-task dependency fully and enhance the performance of our model. In the network construction process, a dataset containing 1623 sets of US images was adopted, and a five-fold cross-validation strategy was divided into the training and validation sets for the model's training and validation. Many vital metrics were introduced to comprehensively evaluate the model performance, including overlap, edge distance, area under curve, and model efficiency. Finally, the model performance was subjected to a confidence interval, Tukey's honest significant difference, and Cohen's d statistics at a significance level (5%) to ensure the accuracy and reliability of the obtained findings.
The experimental results show that the BCA-Net model performs well in the bone surface segmentation task. Its average Dice coefficient reaches 87.51%, 4.04% higher than U-Net's, proving its superior bone surface segmentation accuracy. Meanwhile, the average distance error is 0.2 mm, 0.33 mm lower than U-Net's, highlighting its accuracy in detail capture and boundary recognition. Using a confidence distance threshold of 1.02 mm, the Dice coefficient of the BCA-Net model exceeds 98%, an improvement of 1.87% over U-Net's, which is highly consistent with manual labeling. The BCA-Net model achieves a statistical significance of p-values < 0.05 in the above accuracy comparisons. In addition, the BCA-Net model has a small parameter count (5.58 M) and high computational efficiency (35.85 frames per second), further validating its excellent potential in bone surface segmentation tasks.
The proposed method achieves excellent performance with high accuracy and efficiency, aligning well with clinical requirements and holding excellent potential for advancing the utilization of US images in CAOS.
超声(US)因其无辐射、成本效益高和便携的特性,在计算机辅助骨科手术(CAOS)中具有巨大的应用潜力。然而,从低质量的超声图像中进行骨分割一直具有挑战性。传统的分割方法由于高度定制化且依赖骨形态,无法取得令人满意的结果。现有的基于深度学习的方法在特征学习过程中忽略了骨特征的先验知识,难以确保高效准确的分割。
本文旨在系统地研究骨超声图像的特征提取和分割方法,进而提出一种创新的卷积神经网络,以满足CAOS中精确高效的骨结构提取需求。
本文提出了一种双解码器带状卷积注意力网络(BCA-Net),它以原始超声图像为输入,以简化的U-Net作为基线网络。BCA-Net模型内部采用多尺度带状卷积核,利用超声图像中骨表面呈现为几毫米宽的亮带这一先验知识。此外,BCA-Net模型集成了一个用于提取输入特征的共享编码器和两个用于生成骨表面和骨阴影掩码输出的独立解码器,利用超声骨表面下方呈现低强度空心阴影的先验知识。然后,引入了一种新的任务一致性损失,它可以充分利用任务间的依赖性并提高模型的性能。在网络构建过程中,采用了一个包含1623组超声图像的数据集,并采用五折交叉验证策略将其划分为训练集和验证集用于模型的训练和验证。引入了许多重要指标来全面评估模型性能,包括重叠度、边缘距离、曲线下面积和模型效率。最后,在显著性水平(5%)下对模型性能进行置信区间、Tukey真实显著差异和Cohen's d统计,以确保所得结果的准确性和可靠性。
实验结果表明,BCA-Net模型在骨表面分割任务中表现良好。其平均Dice系数达到87.51%,比U-Net高4.04%,证明了其卓越的骨表面分割精度。同时,平均距离误差为0.2毫米,比U-Net低0.33毫米,突出了其在细节捕捉和边界识别方面的准确性。使用1.02毫米的置信距离阈值时BCA-Net模型的Dice系数超过98%,比U-Net提高了1.87%,与手动标注高度一致。在上述精度比较中,BCA-Net模型的p值具有统计学显著性(p值<0.05)。此外,BCA-Net模型参数数量少(558万)且计算效率高(每秒处理35.85帧),进一步验证了其在骨表面分割任务中的卓越潜力。
所提出的方法以高精度和高效率实现了卓越性能,与临床需求高度契合,在推进超声图像在CAOS中的应用方面具有卓越潜力。