机器学习对图像引导介入的二维/三维配准的影响:系统综述与展望

The Impact of Machine Learning on 2D/3D Registration for Image-Guided Interventions: A Systematic Review and Perspective.

作者信息

Unberath Mathias, Gao Cong, Hu Yicheng, Judish Max, Taylor Russell H, Armand Mehran, Grupp Robert

机构信息

Advanced Robotics and Computationally Augmented Environments (ARCADE) Lab, Department of Computer Science, Johns Hopkins University, Baltimore, MD, United States.

出版信息

Front Robot AI. 2021 Aug 30;8:716007. doi: 10.3389/frobt.2021.716007. eCollection 2021.

Abstract

Image-based navigation is widely considered the next frontier of minimally invasive surgery. It is believed that image-based navigation will increase the access to reproducible, safe, and high-precision surgery as it may then be performed at acceptable costs and effort. This is because image-based techniques avoid the need of specialized equipment and seamlessly integrate with contemporary workflows. Furthermore, it is expected that image-based navigation techniques will play a major role in enabling mixed reality environments, as well as autonomous and robot-assisted workflows. A critical component of image guidance is 2D/3D registration, a technique to estimate the spatial relationships between 3D structures, e.g., preoperative volumetric imagery or models of surgical instruments, and 2D images thereof, such as intraoperative X-ray fluoroscopy or endoscopy. While image-based 2D/3D registration is a mature technique, its transition from the bench to the bedside has been restrained by well-known challenges, including brittleness with respect to optimization objective, hyperparameter selection, and initialization, difficulties in dealing with inconsistencies or multiple objects, and limited single-view performance. One reason these challenges persist today is that analytical solutions are likely inadequate considering the complexity, variability, and high-dimensionality of generic 2D/3D registration problems. The recent advent of machine learning-based approaches to imaging problems that, rather than specifying the desired functional mapping, approximate it using highly expressive parametric models holds promise for solving some of the notorious challenges in 2D/3D registration. In this manuscript, we review the impact of machine learning on 2D/3D registration to systematically summarize the recent advances made by introduction of this novel technology. Grounded in these insights, we then offer our perspective on the most pressing needs, significant open problems, and possible next steps.

摘要

基于图像的导航被广泛认为是微创手术的下一个前沿领域。人们相信,基于图像的导航将增加可重复、安全和高精度手术的可及性,因为届时可以以可接受的成本和努力来进行此类手术。这是因为基于图像的技术无需专门设备,并能与当代工作流程无缝集成。此外,预计基于图像的导航技术将在实现混合现实环境以及自主和机器人辅助工作流程方面发挥重要作用。图像引导的一个关键组成部分是二维/三维配准,这是一种估计三维结构(例如术前容积图像或手术器械模型)与其二维图像(如术中X射线荧光透视或内窥镜检查图像)之间空间关系的技术。虽然基于图像的二维/三维配准是一项成熟的技术,但其从实验室到临床的转变受到了一些众所周知的挑战的限制,包括在优化目标、超参数选择和初始化方面的脆弱性,处理不一致或多个物体的困难,以及单视图性能有限。这些挑战至今仍然存在的一个原因是,考虑到一般二维/三维配准问题的复杂性、变异性和高维度性,解析解可能并不充分。最近出现的基于机器学习的成像问题解决方法,不是指定所需的功能映射,而是使用高度表达性的参数模型对其进行近似,这有望解决二维/三维配准中一些臭名昭著的挑战。在本手稿中,我们回顾了机器学习对二维/三维配准的影响,以系统地总结引入这项新技术所取得的最新进展。基于这些见解,我们随后对最紧迫的需求、重大的开放性问题以及可能的下一步措施发表我们的看法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/69ca/8436154/b629536bda19/frobt-08-716007-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索