IEEE Trans Pattern Anal Mach Intell. 2023 Mar;45(3):3707-3720. doi: 10.1109/TPAMI.2022.3174908. Epub 2023 Feb 3.
In deformable registration, the Riemannian framework - Large Deformation Diffeomorphic Metric Mapping, or LDDMM for short - has inspired numerous techniques for comparing, deforming, averaging and analyzing shapes or images. Grounded in flows of vector fields, akin to the equations of motion used in fluid dynamics, LDDMM algorithms solve the flow equation in the space of plausible deformations, i.e., diffeomorphisms. In this work, we make use of deep residual neural networks to solve the non-stationary ODE (flow equation) based on an Euler's discretization scheme. The central idea is to represent time-dependent velocity fields as fully connected ReLU neural networks (building blocks) and derive optimal weights by minimizing a regularized loss function. Computing minimizing paths between deformations, thus between shapes, turns to find optimal network parameters by back-propagating over the intermediate building blocks. Geometrically, at each time step, our algorithm searches for an optimal partition of the space into multiple polytopes, and then computes optimal velocity vectors as affine transformations on each of these polytopes. As a result, different parts of the shape, even if they are close (such as two fingers of a hand), can be made to belong to different polytopes, and therefore be moved in different directions without costing too much energy. Importantly, we show how diffeomorphic transformations, or more precisely bilipshitz transformations, are predicted by our registration algorithm. We illustrate these ideas on diverse registration problems of 3D shapes under complex topology-preserving transformations. We thus provide essential foundations for more advanced shape variability analysis under a novel joint geometric-neural networks Riemannian-like framework, i.e., ResNet-LDDMM.
在可变形配准中,黎曼框架——大变形仿射度量映射,简称 LDDMM——激发了许多用于比较、变形、平均和分析形状或图像的技术。基于类似于流体动力学中使用的运动方程的向量场流,LDDMM 算法在合理变形(即仿射变换)的空间中求解流方程。在这项工作中,我们利用深度残差神经网络来解决基于 Euler 离散化方案的非定常 ODE(流方程)。核心思想是将时变速度场表示为全连接 ReLU 神经网络(构建块),并通过最小化正则化损失函数来推导出最优权重。通过在中间构建块上反向传播来计算变形之间(因此形状之间)的最小路径,从而找到最优的网络参数。从几何角度来看,在每个时间步,我们的算法搜索将空间划分为多个多面体的最优分区,然后在每个多面体上计算最优速度向量作为仿射变换。因此,形状的不同部分,即使它们很接近(例如手的两个手指),也可以属于不同的多面体,并且可以在不同的方向上移动而不会花费太多能量。重要的是,我们展示了我们的注册算法如何预测仿射变换,或者更确切地说是双 Lipschitz 变换。我们在具有复杂拓扑保持变换的 3D 形状的各种注册问题上说明了这些思想。因此,我们为在新的联合几何神经网络黎曼样框架下进行更高级的形状可变性分析提供了重要基础,即 ResNet-LDDMM。