Institute of Image Processing and Pattern Recognition, Department of Automation, Shanghai Jiao Tong University, Shanghai, China.
Medical Image Processing Group, Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
Med Phys. 2021 Dec;48(12):7806-7825. doi: 10.1002/mp.15308. Epub 2021 Nov 18.
In the multi-atlas segmentation (MAS) method, a large enough atlas set, which can cover the complete spectrum of the whole population pattern of the target object will benefit the segmentation quality. However, the difficulty in obtaining and generating such a large set of atlases and the computational burden required in the segmentation procedure make this approach impractical. In this paper, we propose a method called SOMA to select subject-, object-, and modality-adapted precision atlases for automatic anatomy recognition in medical images with pathology, following the idea that different regions of the target object in a novel image can be recognized by different atlases with regionally best similarity, so that effective atlases have no need to be globally similar to the target subject and also have no need to be overall similar to the target object.
The SOMA method consists of three main components: atlas building, object recognition, and object delineation. Considering the computational complexity, we utilize an all-to-template strategy to align all images to the same image space belonging to the root image determined by the minimum spanning tree (MST) strategy among a subset of radiologically near-normal images. The object recognition process is composed of two stages: rough recognition and refined recognition. In rough recognition, subimage matching is conducted between the test image and each image of the whole atlas set, and only the atlas corresponding to the best-matched subimage contributes to the recognition map regionally. The frequency of best match for each atlas is recorded by a counter, and the atlases with the highest frequencies are selected as the precision atlases. In refined recognition, only the precision atlases are examined, and the subimage matching is conducted in a nonlocal manner of searching to further increase the accuracy of boundary matching. Delineation is based on a U-net-based deep learning network, where the original gray scale image together with the fuzzy map from refined recognition compose a two-channel input to the network, and the output is a segmentation map of the target object.
Experiments are conducted on computed tomography (CT) images with different qualities in two body regions - head and neck (H&N) and thorax, from 298 subjects with nine objects and 241 subjects with six objects, respectively. Most objects achieve a localization error within two voxels after refined recognition, with marked improvement in localization accuracy from rough to refined recognition of 0.6-3 mm in H&N and 0.8-4.9 mm in thorax, and also in delineation accuracy (Dice coefficient) from refined recognition to delineation of 0.01-0.11 in H&N and 0.01-0.18 in thorax.
The SOMA method shows high accuracy and robustness in anatomy recognition and delineation. The improvements from rough to refined recognition and further to delineation, as well as immunity of recognition accuracy to varying image and object qualities, demonstrate the core principles of SOMA where segmentation accuracy increases with precision atlases and gradually refined object matching.
在多图谱分割(MAS)方法中,一个足够大的图谱集可以覆盖目标对象的整个人群模式,这将有助于提高分割质量。然而,获取和生成如此大的图谱集的难度以及分割过程中的计算负担使得这种方法不切实际。在本文中,我们提出了一种称为 SOMA 的方法,用于为具有病理学的医学图像中的自动解剖识别选择适合于主体、对象和模态的精确图谱,其思想是可以使用具有区域最佳相似性的不同图谱来识别目标对象的不同区域,从而使有效的图谱无需全局与目标主体相似,也无需与目标对象整体相似。
SOMA 方法由三个主要组件组成:图谱构建、对象识别和对象描绘。考虑到计算复杂度,我们利用全到模板策略,通过最小生成树(MST)策略在一组放射学上接近正常的图像中,将所有图像对齐到属于根图像的相同图像空间。对象识别过程由两个阶段组成:粗识别和精识别。在粗识别中,在测试图像和整个图谱集中的每个图像之间进行子图像匹配,并且仅与最佳匹配子图像对应的图谱在区域上有助于识别图谱区域。通过计数器记录每个图谱的最佳匹配频率,选择具有最高频率的图谱作为精确图谱。在精识别中,仅检查精确图谱,并以非局部搜索方式进行子图像匹配,以进一步提高边界匹配的准确性。描绘基于基于 U 型网络的深度学习网络,原始灰度图像与精识别中的模糊图一起构成网络的双通道输入,输出是目标对象的分割图。
在两个身体区域 - 头部和颈部(H&N)和胸部 - 的具有不同质量的 CT 图像上进行了实验,分别来自 298 名具有 9 个对象和 241 名具有 6 个对象的受试者。经过精识别后,大多数对象的定位误差都在两个体素内,在 H&N 中从粗识别到精识别的定位精度提高了 0.6-3 毫米,在胸部提高了 0.8-4.9 毫米,在 H&N 中从精识别到描绘的描绘精度(Dice 系数)提高了 0.01-0.11,在胸部提高了 0.01-0.18。
SOMA 方法在解剖识别和描绘方面具有很高的准确性和鲁棒性。从粗识别到精识别再到描绘的改进,以及识别精度对图像和对象质量变化的免疫性,证明了 SOMA 的核心原则,即分割精度随着精确图谱的增加和逐渐细化的对象匹配而提高。