Keller Brenton, Draelos Mark, Zhou Kevin, Qian Ruobing, Kuo Anthony, Konidaris George, Hauser Kris, Izatt Joseph
Department of Biomedical Engineering, Duke University, Durham, NC, USA.
Department of Ophthalmology, Duke University Medical Center, Durham, NC, USA.
IEEE Trans Robot. 2020 Aug;36(4):1207-1218. doi: 10.1109/TRO.2020.2980158. Epub 2020 Apr 16.
Ophthalmic microsurgery is technically difficult because the scale of required surgical tool manipulations challenge the limits of the surgeon's visual acuity, sensory perception, and physical dexterity. Intraoperative optical coherence tomography (OCT) imaging with micrometer-scale resolution is increasingly being used to monitor and provide enhanced real-time visualization of ophthalmic surgical maneuvers, but surgeons still face physical limitations when manipulating instruments inside the eye. Autonomously controlled robots are one avenue for overcoming these physical limitations. We demonstrate the feasibility of using learning from demonstration and reinforcement learning with an industrial robot to perform OCT-guided corneal needle insertions in an ex vivo model of deep anterior lamellar keratoplasty (DALK) surgery. Our reinforcement learning agent trained on ex vivo human corneas, then outperformed surgical fellows in reaching a target needle insertion depth in mock corneal surgery trials. This work shows the combination of learning from demonstration and reinforcement learning is a viable option for performing OCT guided robotic ophthalmic surgery.
眼科显微手术在技术上具有挑战性,因为所需手术工具操作的规模对外科医生的视力、感官知觉和身体灵活性的极限构成了挑战。具有微米级分辨率的术中光学相干断层扫描(OCT)成像越来越多地用于监测并增强眼科手术操作的实时可视化,但外科医生在眼内操作器械时仍面临身体上的限制。自主控制的机器人是克服这些身体限制的一种途径。我们展示了利用从示范学习和强化学习与工业机器人相结合,在深板层角膜移植术(DALK)手术的离体模型中进行OCT引导的角膜针插入的可行性。我们的强化学习智能体在离体人类角膜上进行训练,然后在模拟角膜手术试验中,在达到目标针插入深度方面超过了外科住院医师。这项工作表明,从示范学习和强化学习的结合是进行OCT引导的机器人眼科手术的一个可行选择。