Dwivedi Vikas, Srinivasan Balaji, Krishnamurthi Ganapathy
Atmospheric Science Research Center, State University of New York, Albany, NY, 12222, USA.
Department of Mechanical Engineering, Indian Institute of Technology, Madras, Chennai, 600036, India.
Sci Rep. 2024 Mar 24;14(1):6996. doi: 10.1038/s41598-024-57281-x.
Effective training of deep image segmentation models is challenging due to the need for abundant, high-quality annotations. To facilitate image annotation, we introduce Physics Informed Contour Selection (PICS)-an interpretable, physics-informed algorithm for rapid image segmentation without relying on labeled data. PICS draws inspiration from physics-informed neural networks (PINNs) and an active contour model called snake. It is fast and computationally lightweight because it employs cubic splines instead of a deep neural network as a basis function. Its training parameters are physically interpretable because they directly represent control knots of the segmentation curve. Traditional snakes involve minimization of the edge-based loss functionals by deriving the Euler-Lagrange equation followed by its numerical solution. However, PICS directly minimizes the loss functional, bypassing the Euler Lagrange equations. It is the first snake variant to minimize a region-based loss function instead of traditional edge-based loss functions. PICS uniquely models the three-dimensional (3D) segmentation process with an unsteady partial differential equation (PDE), which allows accelerated segmentation via transfer learning. To demonstrate its effectiveness, we apply PICS for 3D segmentation of the left ventricle on a publicly available cardiac dataset. We also demonstrate PICS's capacity to encode the prior shape information as a loss term by proposing a new convexity-preserving loss term for left ventricle. Overall, PICS presents several novelties in network architecture, transfer learning, and physics-inspired losses for image segmentation, thereby showing promising outcomes and potential for further refinement.
由于需要大量高质量的标注,深度图像分割模型的有效训练具有挑战性。为了便于图像标注,我们引入了物理信息轮廓选择(PICS)——一种无需依赖标记数据即可进行快速图像分割的可解释的、基于物理信息的算法。PICS的灵感来自于物理信息神经网络(PINNs)和一种名为蛇形的主动轮廓模型。它速度快且计算量小,因为它采用三次样条而不是深度神经网络作为基函数。其训练参数具有物理可解释性,因为它们直接表示分割曲线的控制节点。传统的蛇形算法通过推导欧拉-拉格朗日方程并进行数值求解来最小化基于边缘的损失泛函。然而,PICS直接最小化损失泛函,绕过了欧拉-拉格朗日方程。它是第一个最小化基于区域的损失函数而不是传统基于边缘的损失函数的蛇形变体。PICS用一个非稳态偏微分方程(PDE)对三维(³D)分割过程进行独特建模,这使得通过迁移学习可以加速分割。为了证明其有效性,我们将PICS应用于一个公开可用的心脏数据集上的左心室³D分割。我们还通过为左心室提出一个新的保持凸性的损失项,展示了PICS将先验形状信息编码为损失项的能力。总体而言,PICS在网络架构、迁移学习和用于图像分割的物理启发式损失方面呈现出几个新颖之处,从而显示出有前景的结果和进一步优化的潜力。