文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

一种用于腹腔镜部分肾切除术增强现实导航的无标记自动可变形配准框架。

A markerless automatic deformable registration framework for augmented reality navigation of laparoscopy partial nephrectomy.

机构信息

School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China.

Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100083, China.

出版信息

Int J Comput Assist Radiol Surg. 2019 Aug;14(8):1285-1294. doi: 10.1007/s11548-019-01974-6. Epub 2019 Apr 23.


DOI:10.1007/s11548-019-01974-6
PMID:31016562
Abstract

UNLABELLED: Purpose Video see-through augmented reality (VST-AR) navigation for laparoscopic partial nephrectomy (LPN) can enhance intraoperative perception of surgeons by visualizing surgical targets and critical structures of the kidney tissue. Image registration is the main challenge in the procedure. Existing registration methods in laparoscopic navigation systems suffer from limitations such as manual alignment, invasive external marker fixation, relying on external tracking devices with bulky tracking sensors and lack of deformation compensation. To address these issues, we present a markerless automatic deformable registration framework for LPN VST-AR navigation. METHOD: Dense stereo matching and 3D reconstruction, automatic segmentation and surface stitching are combined to obtain a larger dense intraoperative point cloud of the renal surface. A coarse-to-fine deformable registration is performed to achieve a precise automatic registration between the intraoperative point cloud and the preoperative model using the iterative closest point algorithm followed by the coherent point drift algorithm. Kidney phantom experiments and in vivo experiments were performed to evaluate the accuracy and effectiveness of our approach. RESULTS: The average segmentation accuracy rate of the automatic segmentation was 94.9%. The mean target registration error of the phantom experiments was found to be 1.28 ± 0.68 mm (root mean square error). In vivo experiments showed that tumor location was identified successfully by superimposing the tumor model on the laparoscopic view. CONCLUSION: Experimental results have demonstrated that the proposed framework could accurately overlay comprehensive preoperative models on deformable soft organs automatically in a manner of VST-AR without using extra intraoperative imaging modalities and external tracking devices, as well as its potential clinical use.

摘要

未加标签:目的 视频透视增强现实 (VST-AR) 导航腹腔镜部分肾切除术 (LPN) 可以通过可视化手术目标和肾脏组织的关键结构来增强外科医生的术中感知。图像配准是该手术的主要挑战。现有的腹腔镜导航系统中的配准方法存在手动对准、外部标记物固定侵入性、依赖具有庞大跟踪传感器的外部跟踪设备以及缺乏变形补偿等局限性。为了解决这些问题,我们提出了一种用于 LPN VST-AR 导航的无标记自动可变形配准框架。 方法:密集立体匹配和 3D 重建、自动分割和表面拼接相结合,以获得更大的肾脏表面术中密集点云。使用迭代最近点算法和相干点漂移算法进行粗到精的可变形配准,以实现术中点云和术前模型之间的精确自动配准。进行了肾脏模型实验和体内实验,以评估我们方法的准确性和有效性。 结果:自动分割的平均分割准确率为 94.9%。模型实验的平均目标配准误差为 1.28±0.68mm(均方根误差)。体内实验表明,通过将肿瘤模型叠加到腹腔镜视图上,可以成功识别肿瘤位置。 结论:实验结果表明,所提出的框架可以在不使用额外的术中成像方式和外部跟踪设备的情况下,以 VST-AR 的方式自动准确地将全面的术前模型叠加到可变形的软组织上,具有潜在的临床应用价值。

相似文献

[1]
A markerless automatic deformable registration framework for augmented reality navigation of laparoscopy partial nephrectomy.

Int J Comput Assist Radiol Surg. 2019-4-23

[2]
Assessment and application of the coherent point drift algorithm to augmented reality surgical navigation for laparoscopic partial nephrectomy.

Int J Comput Assist Radiol Surg. 2020-5-2

[3]
Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration.

Urology. 2009-4

[4]
A practical marker-less image registration method for augmented reality oral and maxillofacial surgery.

Int J Comput Assist Radiol Surg. 2019-3-1

[5]
Fast and automatic bone segmentation and registration of 3D ultrasound to CT for the full pelvic anatomy: a comparative study.

Int J Comput Assist Radiol Surg. 2018-5-26

[6]
Real-time computer-generated integral imaging and 3D image calibration for augmented reality surgical navigation.

Comput Med Imaging Graph. 2015-3

[7]
Evaluation of the 3D Augmented Reality-Guided Intraoperative Positioning of Dental Implants in Edentulous Mandibular Models.

Int J Oral Maxillofac Implants. 2018

[8]
Robust augmented reality registration method for localization of solid organs' tumors using CT-derived virtual biomechanical model and fluorescent fiducials.

Surg Endosc. 2017-7

[9]
Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: a pilot study.

Int J Comput Assist Radiol Surg. 2017-8-5

[10]
Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results.

Eur Urol. 2009-8

引用本文的文献

[1]
Landmark-free automatic digital twin registration in robot-assisted partial nephrectomy using a generic end-to-end model.

Int J Comput Assist Radiol Surg. 2025-7-17

[2]
Applications of mixed reality with medical imaging for training and clinical practice.

J Med Imaging (Bellingham). 2024-11

[3]
A novel 3D image registration technique for augmented reality vision in minimally invasive thoracoscopic pulmonary segmentectomy.

Int J Comput Assist Radiol Surg. 2025-4

[4]
Augmented Reality Implementation in Minimally Invasive Surgery for Future Application in Pulmonary Surgery: A Systematic Review.

Surg Innov. 2024-12

[5]
The Role of Artificial Intelligence on Tumor Boards: Perspectives from Surgeons, Medical Oncologists and Radiation Oncologists.

Curr Oncol. 2024-8-27

[6]
A High-Speed Hyperspectral Laparoscopic Imaging System.

Proc SPIE Int Soc Opt Eng. 2023-2

[7]
Modern Image-Guided Surgery: A Narrative Review of Medical Image Processing and Visualization.

Sensors (Basel). 2023-12-16

[8]
ASO Author Reflections: Clinical Value of Navigation Systems for RAPN and LPN Procedures.

Ann Surg Oncol. 2024-3

[9]
Current Application of Navigation Systems in Robotic-Assisted and Laparoscopic Partial Nephrectomy: Focus on the Improvement of Surgical Performance and Outcomes.

Ann Surg Oncol. 2024-3

[10]
On-Device Execution of Deep Learning Models on HoloLens2 for Real-Time Augmented Reality Medical Applications.

Sensors (Basel). 2023-10-25

本文引用的文献

[1]
The status of augmented reality in laparoscopic surgery as of 2016.

Med Image Anal. 2017-1-24

[2]
Robust augmented reality registration method for localization of solid organs' tumors using CT-derived virtual biomechanical model and fluorescent fiducials.

Surg Endosc. 2017-7

[3]
Robust augmented reality guidance with fluorescent markers in laparoscopic surgery.

Int J Comput Assist Radiol Surg. 2016-6

[4]
Automatic localization of endoscope in intraoperative CT image: A simple approach to augmented reality guidance in laparoscopic surgery.

Med Image Anal. 2016-2-13

[5]
Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy.

Langenbecks Arch Surg. 2015-4

[6]
An augmented reality framework for soft tissue surgery.

Med Image Comput Comput Assist Interv. 2014

[7]
Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery.

IEEE Trans Biomed Eng. 2014-4

[8]
Real-time dense stereo reconstruction using convex optimisation with a cost-volume for image-guided robotic surgery.

Med Image Comput Comput Assist Interv. 2013

[9]
An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images.

J Pediatr Surg. 2013-12

[10]
Augmented reality-guided artery-first pancreatico-duodenectomy.

J Gastrointest Surg. 2013-8-14

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索