Yu Weihao, Zheng Hao, Gu Yun, Xie Fangfang, Yang Jie, Sun Jiayuan, Yang Guang-Zhong
IEEE Trans Med Imaging. 2023 Jan;42(1):103-118. doi: 10.1109/TMI.2022.3204538. Epub 2022 Dec 29.
Detailed anatomical labeling of bronchial trees extracted from CT images can be used as fine-grained maps for intra-operative navigation. To cater to the sparse distribution of airway voxels and large class imbalance in 3D image space, a graph-neural-network-based method is proposed to map branches to nodes in a graph space and assign anatomical labels down to subsegmental level. To address the inherent problem of overlapping distribution of positional and morphological features, especially for subsegmental categories, the proposed method focuses on the relative position between sibling subsegments which is fixed in most cases. The hierarchical nomenclature is represented by multi-level labeling and each category is associated with one or two subtrees in the graph. Hyperedges are used to extract the representation of subtrees while a hypergraph neural network is developed to encode their intrinsic relationship through hyperedge interaction. A filter module is further designed to guide feature aggregation between nodes and hyperedges. With the proposed method, the final accuracies for segmental and subsegmental node classification can achieve 93.6% and 82.0% respectively. The corresponding code is publicly available at https://github.com/haozheng-sjtu/airway-labeling.
从CT图像中提取的支气管树的详细解剖标记可作为术中导航的细粒度图谱。为了适应气道体素的稀疏分布和三维图像空间中的大类不平衡,提出了一种基于图神经网络的方法,将分支映射到图空间中的节点,并将解剖标记分配到亚段水平。为了解决位置和形态特征重叠分布的固有问题,特别是对于亚段类别,该方法关注大多数情况下固定的兄弟亚段之间的相对位置。分层命名法由多级标记表示,每个类别与图中的一个或两个子树相关联。超边用于提取子树的表示,同时开发了超图神经网络以通过超边交互对其内在关系进行编码。还设计了一个过滤模块来指导节点和超边之间的特征聚合。使用所提出的方法,段和亚段节点分类的最终准确率分别可以达到93.6%和82.0%。相应代码可在https://github.com/haozheng-sjtu/airway-labeling上公开获取。