• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于快速图像分割的物理信息轮廓选择

Physics informed contour selection for rapid image segmentation.

作者信息

Dwivedi Vikas, Srinivasan Balaji, Krishnamurthi Ganapathy

机构信息

Atmospheric Science Research Center, State University of New York, Albany, NY, 12222, USA.

Department of Mechanical Engineering, Indian Institute of Technology, Madras, Chennai, 600036, India.

出版信息

Sci Rep. 2024 Mar 24;14(1):6996. doi: 10.1038/s41598-024-57281-x.

DOI:10.1038/s41598-024-57281-x
PMID:38523137
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10961308/
Abstract

Effective training of deep image segmentation models is challenging due to the need for abundant, high-quality annotations. To facilitate image annotation, we introduce Physics Informed Contour Selection (PICS)-an interpretable, physics-informed algorithm for rapid image segmentation without relying on labeled data. PICS draws inspiration from physics-informed neural networks (PINNs) and an active contour model called snake. It is fast and computationally lightweight because it employs cubic splines instead of a deep neural network as a basis function. Its training parameters are physically interpretable because they directly represent control knots of the segmentation curve. Traditional snakes involve minimization of the edge-based loss functionals by deriving the Euler-Lagrange equation followed by its numerical solution. However, PICS directly minimizes the loss functional, bypassing the Euler Lagrange equations. It is the first snake variant to minimize a region-based loss function instead of traditional edge-based loss functions. PICS uniquely models the three-dimensional (3D) segmentation process with an unsteady partial differential equation (PDE), which allows accelerated segmentation via transfer learning. To demonstrate its effectiveness, we apply PICS for 3D segmentation of the left ventricle on a publicly available cardiac dataset. We also demonstrate PICS's capacity to encode the prior shape information as a loss term by proposing a new convexity-preserving loss term for left ventricle. Overall, PICS presents several novelties in network architecture, transfer learning, and physics-inspired losses for image segmentation, thereby showing promising outcomes and potential for further refinement.

摘要

由于需要大量高质量的标注,深度图像分割模型的有效训练具有挑战性。为了便于图像标注,我们引入了物理信息轮廓选择(PICS)——一种无需依赖标记数据即可进行快速图像分割的可解释的、基于物理信息的算法。PICS的灵感来自于物理信息神经网络(PINNs)和一种名为蛇形的主动轮廓模型。它速度快且计算量小,因为它采用三次样条而不是深度神经网络作为基函数。其训练参数具有物理可解释性,因为它们直接表示分割曲线的控制节点。传统的蛇形算法通过推导欧拉-拉格朗日方程并进行数值求解来最小化基于边缘的损失泛函。然而,PICS直接最小化损失泛函,绕过了欧拉-拉格朗日方程。它是第一个最小化基于区域的损失函数而不是传统基于边缘的损失函数的蛇形变体。PICS用一个非稳态偏微分方程(PDE)对三维(³D)分割过程进行独特建模,这使得通过迁移学习可以加速分割。为了证明其有效性,我们将PICS应用于一个公开可用的心脏数据集上的左心室³D分割。我们还通过为左心室提出一个新的保持凸性的损失项,展示了PICS将先验形状信息编码为损失项的能力。总体而言,PICS在网络架构、迁移学习和用于图像分割的物理启发式损失方面呈现出几个新颖之处,从而显示出有前景的结果和进一步优化的潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/9b1661b1741a/41598_2024_57281_Fig19_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/53ec721e133a/41598_2024_57281_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/28de57d7e7ab/41598_2024_57281_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/d358da0e3cb2/41598_2024_57281_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/614e8b9e045b/41598_2024_57281_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/b7b18034cdc0/41598_2024_57281_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/7bce6a98383a/41598_2024_57281_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/4ebc37cf0dbc/41598_2024_57281_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/3208f8583c31/41598_2024_57281_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/255d745e5fe1/41598_2024_57281_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/fa7581fff74a/41598_2024_57281_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/a1991d8ccfc1/41598_2024_57281_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/4aa6049f7fce/41598_2024_57281_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/077fc9178fc9/41598_2024_57281_Fig13_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/57737e8813df/41598_2024_57281_Fig14_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/e42f7bb4a9ef/41598_2024_57281_Fig15_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/b5119a315775/41598_2024_57281_Fig16_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/8292c85d0414/41598_2024_57281_Fig17_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/beed5ec3bcad/41598_2024_57281_Fig18_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/9b1661b1741a/41598_2024_57281_Fig19_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/53ec721e133a/41598_2024_57281_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/28de57d7e7ab/41598_2024_57281_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/d358da0e3cb2/41598_2024_57281_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/614e8b9e045b/41598_2024_57281_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/b7b18034cdc0/41598_2024_57281_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/7bce6a98383a/41598_2024_57281_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/4ebc37cf0dbc/41598_2024_57281_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/3208f8583c31/41598_2024_57281_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/255d745e5fe1/41598_2024_57281_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/fa7581fff74a/41598_2024_57281_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/a1991d8ccfc1/41598_2024_57281_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/4aa6049f7fce/41598_2024_57281_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/077fc9178fc9/41598_2024_57281_Fig13_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/57737e8813df/41598_2024_57281_Fig14_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/e42f7bb4a9ef/41598_2024_57281_Fig15_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/b5119a315775/41598_2024_57281_Fig16_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/8292c85d0414/41598_2024_57281_Fig17_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/beed5ec3bcad/41598_2024_57281_Fig18_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ab59/10961308/9b1661b1741a/41598_2024_57281_Fig19_HTML.jpg

相似文献

1
Physics informed contour selection for rapid image segmentation.用于快速图像分割的物理信息轮廓选择
Sci Rep. 2024 Mar 24;14(1):6996. doi: 10.1038/s41598-024-57281-x.
2
Fully Automatic initialization and segmentation of left and right ventricles for large-scale cardiac MRI using a deeply supervised network and 3D-ASM.基于深度监督网络和 3D-ASM 的大规模心脏 MRI 左、右心室全自动初始化和分割。
Comput Methods Programs Biomed. 2023 Oct;240:107679. doi: 10.1016/j.cmpb.2023.107679. Epub 2023 Jun 14.
3
Physics-informed kernel function neural networks for solving partial differential equations.基于物理信息核函数神经网络求解偏微分方程。
Neural Netw. 2024 Apr;172:106098. doi: 10.1016/j.neunet.2024.106098. Epub 2024 Jan 2.
4
Recipes for when physics fails: recovering robust learning of physics informed neural networks.物理学失效时的方法:恢复物理信息神经网络的稳健学习
Mach Learn Sci Technol. 2023 Mar 1;4(1):015013. doi: 10.1088/2632-2153/acb416. Epub 2023 Feb 6.
5
Gradient Statistics-Based Multi-Objective Optimization in Physics-Informed Neural Networks.基于梯度统计的物理信息神经网络多目标优化
Sensors (Basel). 2023 Oct 24;23(21):8665. doi: 10.3390/s23218665.
6
Error estimates and physics informed augmentation of neural networks for thermally coupled incompressible Navier Stokes equations.用于热耦合不可压缩纳维-斯托克斯方程的神经网络的误差估计与物理信息增强
Comput Mech. 2023 Aug;72(2):267-289. doi: 10.1007/s00466-023-02334-7. Epub 2023 Jun 14.
7
Physics-informed attention-based neural network for hyperbolic partial differential equations: application to the Buckley-Leverett problem.基于物理信息注意的双曲型偏微分方程神经网络:在 Buckley-Leverett 问题中的应用。
Sci Rep. 2022 May 9;12(1):7557. doi: 10.1038/s41598-022-11058-2.
8
Deep learning-accelerated computational framework based on Physics Informed Neural Network for the solution of linear elasticity.基于物理信息神经网络的深度学习加速计算框架求解线性弹性力学问题。
Neural Netw. 2023 May;162:472-489. doi: 10.1016/j.neunet.2023.03.014. Epub 2023 Mar 13.
9
A Combination of Deep Neural Networks and Physics to Solve the Inverse Problem of Burger's Equation.基于深度神经网络与物理模型的 Burger 方程反问题求解
Annu Int Conf IEEE Eng Med Biol Soc. 2021 Nov;2021:4465-4468. doi: 10.1109/EMBC46164.2021.9630259.
10
Data-efficient Bayesian learning for radial dynamic MR reconstruction.用于径向动态磁共振成像重建的数据高效贝叶斯学习
Med Phys. 2023 Nov;50(11):6955-6977. doi: 10.1002/mp.16543. Epub 2023 Jun 27.

本文引用的文献

1
Investigating molecular transport in the human brain from MRI with physics-informed neural networks.基于物理信息神经网络的 MRI 研究人脑内分子传输
Sci Rep. 2022 Sep 14;12(1):15475. doi: 10.1038/s41598-022-19157-w.
2
Image Segmentation Using Deep Learning: A Survey.基于深度学习的图像分割技术综述。
IEEE Trans Pattern Anal Mach Intell. 2022 Jul;44(7):3523-3542. doi: 10.1109/TPAMI.2021.3059968. Epub 2022 Jun 3.
3
Convexity preserving level set for left ventricle segmentation.保凸水平集方法用于左心室分割。
Magn Reson Imaging. 2021 May;78:109-118. doi: 10.1016/j.mri.2021.02.003. Epub 2021 Feb 14.
4
Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?深度学习技术在自动 MRI 心脏多结构分割与诊断中的应用:问题是否已解决?
IEEE Trans Med Imaging. 2018 Nov;37(11):2514-2525. doi: 10.1109/TMI.2018.2837502. Epub 2018 May 17.
5
Deep learning for biology.用于生物学的深度学习
Nature. 2018 Feb 22;554(7693):555-557. doi: 10.1038/d41586-018-02174-z.
6
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.SegNet:一种用于图像分割的深度卷积编解码器架构。
IEEE Trans Pattern Anal Mach Intell. 2017 Dec;39(12):2481-2495. doi: 10.1109/TPAMI.2016.2644615. Epub 2017 Jan 2.
7
Fully Convolutional Networks for Semantic Segmentation.全卷积网络用于语义分割。
IEEE Trans Pattern Anal Mach Intell. 2017 Apr;39(4):640-651. doi: 10.1109/TPAMI.2016.2572683. Epub 2016 May 24.
8
Deep learning.深度学习。
Nature. 2015 May 28;521(7553):436-44. doi: 10.1038/nature14539.
9
Fluid vector flow and applications in brain tumor segmentation.流体向量流及其在脑肿瘤分割中的应用。
IEEE Trans Biomed Eng. 2009 Mar;56(3):781-9. doi: 10.1109/TBME.2009.2012423. Epub 2009 Jan 23.
10
MAC: magnetostatic active contour model.MAC:静磁有源轮廓模型。
IEEE Trans Pattern Anal Mach Intell. 2008 Apr;30(4):632-46. doi: 10.1109/TPAMI.2007.70737.