School of Computer Science and Engineering, Central South University, Chang Sha 410083, China.
Research Center for Artificial Intelligence, Monash University, Clayton Vic 3800, Melbourne, Australia.
Comput Intell Neurosci. 2022 Aug 3;2022:7285600. doi: 10.1155/2022/7285600. eCollection 2022.
Among primary bone cancers, osteosarcoma is the most common, peaking between the ages of a child's rapid bone growth and adolescence. The diagnosis of osteosarcoma requires observing the radiological appearance of the infected bones. A common approach is MRI, but the manual diagnosis of MRI images is prone to observer bias and inaccuracy and is rather time consuming. The MRI images of osteosarcoma contain semantic messages in several different resolutions, which are often ignored by current segmentation techniques, leading to low generalizability and accuracy. In the meantime, the boundaries between osteosarcoma and bones or other tissues are sometimes too ambiguous to separate, making it a challenging job for inexperienced doctors to draw a line between them. In this paper, we propose using a multiscale residual fusion network to handle the MRI images. We placed a novel subnetwork after the encoders to exchange information between the feature maps of different resolutions, to fuse the information they contain. The outputs are then directed to both the decoders and a shape flow block, used for improving the spatial accuracy of the segmentation map. We tested over 80,000 osteosarcoma MRI images from the PET-CT center of a well-known hospital in China. Our approach can significantly improve the effectiveness of the semantic segmentation of osteosarcoma images. Our method has higher F1, DSC, and IOU compared with other models while maintaining the number of parameters and FLOPS.
在原发性骨肿瘤中,骨肉瘤最为常见,发病高峰在儿童骨骼快速生长和青春期。骨肉瘤的诊断需要观察受感染骨骼的影像学表现。一种常见的方法是 MRI,但 MRI 图像的手动诊断容易受到观察者偏差和不准确性的影响,而且相当耗时。骨肉瘤的 MRI 图像包含几个不同分辨率的语义信息,这些信息通常被当前的分割技术忽略,导致泛化能力和准确性较低。同时,骨肉瘤与骨骼或其他组织之间的边界有时过于模糊,难以区分,这使得经验不足的医生很难在两者之间划清界限。在本文中,我们提出使用多尺度残差融合网络来处理 MRI 图像。我们在编码器后放置了一个新的子网,以在不同分辨率的特征图之间交换信息,融合它们所包含的信息。然后,输出结果会同时发送到解码器和形状流块,用于提高分割图的空间准确性。我们在中国一家知名医院的 PET-CT 中心测试了超过 80000 张骨肉瘤 MRI 图像。我们的方法可以显著提高骨肉瘤图像语义分割的有效性。与其他模型相比,我们的方法在保持参数数量和 FLOPS 的同时,具有更高的 F1、DSC 和 IOU。