EyeSLAM：眼内显微手术期间视网膜血管的实时同步定位与映射
EyeSLAM: Real-time simultaneous localization and mapping of retinal vessels during intraocular microsurgery.
作者信息
Braun Daniel, Yang Sungwook, Martel Joseph N, Riviere Cameron N, Becker Brian C
机构信息
The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA.
出版信息
Int J Med Robot. 2018 Feb;14(1). doi: 10.1002/rcs.1848. Epub 2017 Jul 18.
Abstract
BACKGROUND
Fast and accurate mapping and localization of the retinal vasculature is critical to increasing the effectiveness and clinical utility of robot-assisted intraocular microsurgery such as laser photocoagulation and retinal vessel cannulation.
METHODS
The proposed EyeSLAM algorithm delivers 30 Hz real-time simultaneous localization and mapping of the human retina and vasculature during intraocular surgery, combining fast vessel detection with 2D scan-matching techniques to build and localize a probabilistic map of the vasculature.
RESULTS
In the harsh imaging environment of retinal surgery with high magnification, quick shaky motions, textureless retina background, variable lighting and tool occlusion, EyeSLAM can map 75% of the vessels within two seconds of initialization and localize the retina in real time with a root mean squared (RMS) error of under 5.0 pixels (translation) and 1° (rotation).
CONCLUSIONS
EyeSLAM robustly provides retinal maps and registration that enable intelligent surgical micromanipulators to aid surgeons in simulated retinal vessel tracing and photocoagulation tasks.
摘要
背景
视网膜血管系统的快速、精确映射和定位对于提高机器人辅助眼内显微手术（如激光光凝和视网膜血管插管）的有效性和临床实用性至关重要。
方法
所提出的EyeSLAM算法在眼内手术期间以30赫兹的频率实时同步定位和映射人眼视网膜及血管系统，将快速血管检测与二维扫描匹配技术相结合，以构建和定位血管系统的概率地图。
结果
在高放大倍数、快速抖动、视网膜背景无纹理、光照变化和工具遮挡等恶劣的视网膜手术成像环境中，EyeSLAM能够在初始化两秒内映射75%的血管，并以低于5.0像素（平移）和1°（旋转）的均方根误差实时定位视网膜。
结论
EyeSLAM能够稳健地提供视网膜地图和配准，使智能手术微操作器能够在模拟视网膜血管追踪和光凝任务中辅助外科医生。
相似文献
1
EyeSLAM: Real-time simultaneous localization and mapping of retinal vessels during intraocular microsurgery.EyeSLAM：眼内显微手术期间视网膜血管的实时同步定位与映射
Int J Med Robot. 2018 Feb;14(1). doi: 10.1002/rcs.1848. Epub 2017 Jul 18.
2
EyeSAM: graph-based localization and mapping of retinal vasculature during intraocular microsurgery.EyeSAM：在眼内微创手术中基于图的视网膜血管定位和测绘。
Int J Comput Assist Radiol Surg. 2019 May;14(5):819-828. doi: 10.1007/s11548-019-01925-1. Epub 2019 Feb 21.
3
Handheld-automated microsurgical instrumentation for intraocular laser surgery.用于眼内激光手术的手持式自动显微手术器械。
Lasers Surg Med. 2015 Oct;47(8):658-68. doi: 10.1002/lsm.22383. Epub 2015 Aug 19.
4
Semiautomated intraocular laser surgery using handheld instruments.使用手持器械的半自动眼内激光手术。
Lasers Surg Med. 2010 Mar;42(3):264-73. doi: 10.1002/lsm.20897.
5
FBG-based sensorized light pipe for robotic intraocular illumination facilitates bimanual retinal microsurgery.基于空腹血糖（FBG）的传感光导管用于机器人眼内照明，有助于双手视网膜显微手术。
Annu Int Conf IEEE Eng Med Biol Soc. 2015;2015:13-6. doi: 10.1109/EMBC.2015.7318249.
6
Feasibility study on robot-assisted retinal vascular bypass surgery in an ex vivo porcine model.猪离体模型中机器人辅助视网膜血管搭桥手术的可行性研究。
Acta Ophthalmol. 2017 Sep;95(6):e462-e467. doi: 10.1111/aos.13457. Epub 2017 Jun 9.
7
Cooperative robot assistant for retinal microsurgery.用于视网膜显微手术的协作机器人助手。
Med Image Comput Comput Assist Interv. 2008;11(Pt 2):543-50. doi: 10.1007/978-3-540-85990-1_65.
8
'The Microhand': a new concept of micro-forceps for ocular robotic surgery.《微手》：眼机器人手术中的新型微型夹钳概念。
Eye (Lond). 2010 Feb;24(2):364-7. doi: 10.1038/eye.2009.47. Epub 2009 Mar 20.
9
Real-time algorithm for retinal tracking.视网膜跟踪的实时算法
IEEE Trans Biomed Eng. 1993 Dec;40(12):1269-81. doi: 10.1109/10.250583.
10
Cooperative robot assistant for vitreoretinal microsurgery: development of the RVRMS and feasibility studies in an animal model.用于玻璃体视网膜显微手术的协作机器人助手：RVRMS的开发及在动物模型中的可行性研究
Graefes Arch Clin Exp Ophthalmol. 2017 Jun;255(6):1167-1171. doi: 10.1007/s00417-017-3656-3. Epub 2017 Apr 8.
引用本文的文献
1
Sensor-driven digital motion correction of robotically-aligned optical coherence tomography retinal volumes.基于传感器驱动的机器人对准光学相干断层扫描视网膜容积的数字运动校正
Biomed Opt Express. 2025 Mar 26;16(4):1616-1637. doi: 10.1364/BOE.551186. eCollection 2025 Apr 1.
2
FOVEA: Preoperative and intraoperative retinal fundus images with optic disc and retinal vessel annotations.中央凹：带有视盘和视网膜血管标注的术前及术中视网膜眼底图像。
Sci Data. 2025 Apr 26;12(1):703. doi: 10.1038/s41597-025-04965-2.
3
Joint keypoint detection and description network for color fundus image registration.用于彩色眼底图像配准的关节关键点检测与描述网络。
Quant Imaging Med Surg. 2023 Jul 1;13(7):4540-4562. doi: 10.21037/qims-23-4. Epub 2023 May 26.
4
Simultaneous Online Registration-Independent Stiffness Identification and Tip Localization of Surgical Instruments in Robot-assisted Eye Surgery.机器人辅助眼科手术中手术器械的同步在线注册无关刚度识别与尖端定位
IEEE Trans Robot. 2023 Apr;39(2):1373-1387. doi: 10.1109/tro.2022.3201393. Epub 2022 Sep 9.
5
Reliable and stable fundus image registration based on brain-inspired spatially-varying adaptive pyramid context aggregation network.基于脑启发式空间可变自适应金字塔上下文聚合网络的可靠稳定眼底图像配准
Front Neurosci. 2023 Jan 16;16:1117134. doi: 10.3389/fnins.2022.1117134. eCollection 2022.
6
Robotic Assistance for Intraocular Microsurgery: Challenges and Perspectives.用于眼内显微手术的机器人辅助：挑战与展望。
Proc IEEE Inst Electr Electron Eng. 2022 Jul;110(7):893-908. doi: 10.1109/JPROC.2022.3169466. Epub 2022 May 9.
7
FBG-based Kalman Filtering and Control of Tool Insertion Depth For Safe Robot-assisted Vitrectomy.基于空腹血糖的卡尔曼滤波与工具插入深度控制用于安全的机器人辅助玻璃体切除术
Int Symp Med Robot. 2020 Nov;2020. doi: 10.1109/ismr48331.2020.9312931. Epub 2021 Jan 11.
8
Stochastic Force-based Insertion Depth and Tip Position Estimations of Flexible FBG-Equipped Instruments in Robotic Retinal Surgery.基于随机力的配备柔性光纤光栅仪器在机器人视网膜手术中的插入深度和尖端位置估计
IEEE ASME Trans Mechatron. 2021 Jun;26(3):1512-1523. doi: 10.1109/tmech.2020.3022830. Epub 2020 Sep 8.
9
Adaptive Control Improves Sclera Force Safety in Robot-Assisted Eye Surgery: A Clinical Study.自适应控制提高机器人辅助眼科手术中的巩膜力安全性：一项临床研究。
IEEE Trans Biomed Eng. 2021 Nov;68(11):3356-3365. doi: 10.1109/TBME.2021.3071135. Epub 2021 Oct 19.
10
Automatic Light Pipe Actuating System for Bimanual Robot-Assisted Retinal Surgery.用于双手机器人辅助视网膜手术的自动光导管驱动系统。
IEEE ASME Trans Mechatron. 2020 Dec;25(6):2846-2857. doi: 10.1109/tmech.2020.2996683. Epub 2020 May 22.
本文引用的文献
1
Handheld-automated microsurgical instrumentation for intraocular laser surgery.用于眼内激光手术的手持式自动显微手术器械。
Lasers Surg Med. 2015 Oct;47(8):658-68. doi: 10.1002/lsm.22383. Epub 2015 Aug 19.
2
Manipulator Design and Operation for a Six-Degree-of-Freedom Handheld Tremor-Canceling Microsurgical Instrument.用于六自由度手持式震颤消除显微外科器械的操纵器设计与操作
IEEE ASME Trans Mechatron. 2015 Apr;20(2):761-772. doi: 10.1109/TMECH.2014.2320858.
3
Fundus image mosaicking for information augmentation in computer-assisted slit-lamp imaging.眼底图像拼接在计算机辅助裂隙灯成像中的信息增强。
IEEE Trans Med Imaging. 2014 Jun;33(6):1304-12. doi: 10.1109/TMI.2014.2309440. Epub 2014 Mar 3.
4
Vision-Based Control of a Handheld Surgical Micromanipulator with Virtual Fixtures.基于视觉的带有虚拟夹具的手持式手术微操作器控制
IEEE Trans Robot. 2013 Feb 19;29(3):674-683. doi: 10.1109/TRO.2013.2239552.
5
Real-Time Retinal Vessel Mapping and Localization for Intraocular Surgery.用于眼内手术的实时视网膜血管映射与定位
IEEE Int Conf Robot Autom. 2013:5360-5365. doi: 10.1109/ICRA.2013.6631345.
6
Unified detection and tracking of instruments during retinal microsurgery.视网膜微创手术中器械的统一检测和跟踪。
IEEE Trans Pattern Anal Mach Intell. 2013 May;35(5):1263-73. doi: 10.1109/TPAMI.2012.209.
7
Fast retinal vessel detection and measurement using wavelets and edge location refinement.基于小波和边缘定位细化的快速视网膜血管检测和测量。
PLoS One. 2012;7(3):e32435. doi: 10.1371/journal.pone.0032435. Epub 2012 Mar 12.
8
Real-time multimodal retinal image registration for a computer-assisted laser photocoagulation system.用于计算机辅助激光光凝系统的实时多模态视网膜图像配准。
IEEE Trans Biomed Eng. 2011 Oct;58(10):2816-24. doi: 10.1109/TBME.2011.2159860. Epub 2011 Jun 16.
9
New Steady-Hand Eye Robot with Micro-Force Sensing for Vitreoretinal Surgery.用于玻璃体视网膜手术的新型带微力传感的稳手眼机器人
Proc IEEE RAS EMBS Int Conf Biomed Robot Biomechatron. 2010 Sep 1;2010(26-29):814-819. doi: 10.1109/BIOROB.2010.5625991.
10
Single-camera focus-based localization of intraocular devices.基于单目相机对焦的眼内设备定位。
IEEE Trans Biomed Eng. 2010 Aug;57(8):2064-74. doi: 10.1109/TBME.2010.2044177. Epub 2010 May 3.
Zotero 插件