Cao Xiaohuan, Yang Jianhua, Zhang Jun, Nie Dong, Kim Min-Jeong, Wang Qian, Shen Dinggang
School of Automation, Northwestern Polytechnical University, Xi'an, China.
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA.
Med Image Comput Comput Assist Interv. 2017 Sep;10433:300-308. doi: 10.1007/978-3-319-66182-7_35. Epub 2017 Sep 4.
Existing deformable registration methods require exhaustively iterative optimization, along with careful parameter tuning, to estimate the deformation field between images. Although some learning-based methods have been proposed for initiating deformation estimation, they are often template-specific and not flexible in practical use. In this paper, we propose a convolutional neural network (CNN) based regression model to directly learn the complex mapping from the input image pair (i.e., a pair of template and subject) to their corresponding deformation field. Specifically, our CNN architecture is designed in a patch-based manner to learn the complex mapping from the input patch pairs to their respective deformation field. First, the equalized active-points guided sampling strategy is introduced to facilitate accurate CNN model learning upon a limited image dataset. Then, the similarity-steered CNN architecture is designed, where we propose to add the auxiliary contextual cue, i.e., the similarity between input patches, to more directly guide the learning process. Experiments on different brain image datasets demonstrate promising registration performance based on our CNN model. Furthermore, it is found that the trained CNN model from one dataset can be successfully transferred to another dataset, although brain appearances across datasets are quite variable.
现有的可变形配准方法需要进行详尽的迭代优化以及仔细的参数调整,以估计图像之间的变形场。尽管已经提出了一些基于学习的方法来启动变形估计,但它们通常是特定于模板的,在实际应用中缺乏灵活性。在本文中,我们提出了一种基于卷积神经网络(CNN)的回归模型,以直接学习从输入图像对(即一对模板和目标图像)到其相应变形场的复杂映射。具体而言,我们的CNN架构是以基于块的方式设计的,以学习从输入块对到其各自变形场的复杂映射。首先,引入均衡化活性点引导采样策略,以在有限的图像数据集上促进准确的CNN模型学习。然后,设计了相似性引导的CNN架构,我们建议添加辅助上下文线索,即输入块之间的相似性,以更直接地指导学习过程。在不同脑图像数据集上的实验证明了基于我们的CNN模型有良好的配准性能。此外,还发现尽管不同数据集之间的脑外观差异很大,但从一个数据集训练的CNN模型可以成功转移到另一个数据集。