• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

将眼动追踪技术集成到增强现实手术训练系统中。

Integrating Eye-Tracking to Augmented Reality System for Surgical Training.

机构信息

Multimedia Research Center, Department of Computing Science, University of Alberta, Edmonton, AB, Canada.

Surgical Simulation Research Lab, Department of Surgery, University of Alberta, Edmonton, AB, Canada.

出版信息

J Med Syst. 2020 Sep 29;44(11):192. doi: 10.1007/s10916-020-01656-w.

DOI:10.1007/s10916-020-01656-w
PMID:32990801
Abstract

Augmented Reality has been utilized for surgical training. During the implementation, displaying instructional information at the right moment is critical for skill acquisition. We built a new surgical training platform combining augmented reality system (HoloLens, Microsoft) with an eye-tracker (Pupil labs, Germany). Our goal is to detect the moments of performance difficulty using the integrated eye-tracker so that the system could display instructions at the precise moment when the user is seeking instructional information during a surgical skill practice in simulation. In the paper, we describe the system design, system calibration and data transferring between these devices.

摘要

增强现实技术已被应用于外科手术培训。在实施过程中,在正确的时刻显示教学信息对于技能的获取至关重要。我们结合增强现实系统(微软 HoloLens)和眼动追踪器(德国 Pupil labs)构建了一个新的手术培训平台。我们的目标是使用集成的眼动追踪器检测到操作困难时刻,以便在用户在模拟手术技能练习中寻找教学信息时,系统能够在精确的时刻显示说明。在本文中,我们描述了系统设计、系统校准以及这些设备之间的数据传输。

相似文献

1
Integrating Eye-Tracking to Augmented Reality System for Surgical Training.将眼动追踪技术集成到增强现实手术训练系统中。
J Med Syst. 2020 Sep 29;44(11):192. doi: 10.1007/s10916-020-01656-w.
2
Augmented reality with HoloLens in parotid surgery: how to assess and to improve accuracy.HoloLens增强现实技术在腮腺手术中的应用:如何评估并提高准确性
Eur Arch Otorhinolaryngol. 2021 Jul;278(7):2473-2483. doi: 10.1007/s00405-020-06351-7. Epub 2020 Sep 10.
3
A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens.基于微软 HoloLens 的可穿戴增强现实手术远程指导导航系统。
Ann Biomed Eng. 2021 Jan;49(1):287-298. doi: 10.1007/s10439-020-02538-5. Epub 2020 Jun 5.
4
ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays.增强现实眼动追踪工具包,用于头戴式显示器。
Sensors (Basel). 2021 Mar 23;21(6):2234. doi: 10.3390/s21062234.
5
Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens.使用 Microsoft HoloLens 实现基于 AR 的手术导航的光学透视头戴式显示器的快速准确在线校准。
Int J Comput Assist Radiol Surg. 2020 Nov;15(11):1907-1919. doi: 10.1007/s11548-020-02246-4. Epub 2020 Aug 18.
6
Transrectal ultrasound image-based real-time augmented reality guidance in robot-assisted laparoscopic rectal surgery: a proof-of-concept study.基于经直肠超声图像的实时增强现实引导在机器人辅助腹腔镜直肠手术中的应用:一项概念验证研究。
Int J Comput Assist Radiol Surg. 2020 Mar;15(3):531-543. doi: 10.1007/s11548-019-02100-2. Epub 2019 Dec 5.
7
Head-Mounted Augmented Reality Platform for Markerless Orthopaedic Navigation.头戴式无标记骨科导航增强现实平台。
IEEE J Biomed Health Inform. 2022 Feb;26(2):910-921. doi: 10.1109/JBHI.2021.3088442. Epub 2022 Feb 4.
8
User Evaluation of a Shared Robot Control System Combining BCI and Eye Tracking in a Portable Augmented Reality User Interface.用户对结合脑机接口和眼动追踪的便携式增强现实用户界面的共享机器人控制系统的评价。
Sensors (Basel). 2024 Aug 14;24(16):5253. doi: 10.3390/s24165253.
9
Hybrid Simulation and Planning Platform for Cryosurgery with Microsoft HoloLens.基于 Microsoft HoloLens 的冷冻手术混合仿真与规划平台。
Sensors (Basel). 2021 Jun 29;21(13):4450. doi: 10.3390/s21134450.
10
An augmented reality system characterization of placement accuracy in neurosurgery.神经外科中增强现实系统定位精度的评估。
J Clin Neurosci. 2020 Feb;72:392-396. doi: 10.1016/j.jocn.2019.12.014. Epub 2019 Dec 28.

引用本文的文献

1
Embedded CPU-GPU pupil tracking.嵌入式CPU-GPU瞳孔追踪。
Biomed Opt Express. 2024 Nov 13;15(12):6799-6815. doi: 10.1364/BOE.541421. eCollection 2024 Dec 1.
2
Wearable Biosensor Smart Glasses Based on Augmented Reality and Eye Tracking.基于增强现实和眼动追踪技术的可穿戴生物传感器智能眼镜
Sensors (Basel). 2024 Oct 20;24(20):6740. doi: 10.3390/s24206740.
3
Let's get it started: Eye Tracking in VR with the Pupil Labs Eye Tracking Add-On for the HTC Vive.让我们开始吧:使用适用于HTC Vive的Pupil Labs眼动追踪附加组件在虚拟现实中进行眼动追踪。
J Eye Mov Res. 2023 Jun 19;15(3). doi: 10.16910/jemr.15.3.10. eCollection 2022.
4
Calibration-Free Mobile Eye-Tracking Using Corneal Imaging.基于角膜成像的无标定移动眼动追踪。
Sensors (Basel). 2024 Feb 15;24(4):1237. doi: 10.3390/s24041237.
5
Comparison of stereopsis thresholds measured with conventional methods and a new eye tracking method.比较传统方法和新的眼动追踪方法测量的立体视敏度阈值。
PLoS One. 2023 Nov 2;18(11):e0293735. doi: 10.1371/journal.pone.0293735. eCollection 2023.
6
Use of Extended Reality in Medical Education: An Integrative Review.扩展现实技术在医学教育中的应用:一项综合综述。
Med Sci Educ. 2022 Dec 19;33(1):275-286. doi: 10.1007/s40670-022-01698-4. eCollection 2023 Feb.
7
The use of mixed reality technology for the objective assessment of clinical skills: a validation study.混合现实技术在临床技能客观评估中的应用:一项验证研究。
BMC Med Educ. 2022 Aug 23;22(1):639. doi: 10.1186/s12909-022-03701-3.
8
The role of eye tracker in teaching video-assisted thoracoscopic surgery: the differences in visual strategies between novice and expert surgeons in thoracoscopic surgery.眼动追踪仪在教学视频辅助胸腔镜手术中的作用:胸腔镜手术中新手与专家外科医生视觉策略的差异
Ann Transl Med. 2022 May;10(10):592. doi: 10.21037/atm-22-2145.
9
Integrated eye tracking on Magic Leap One during augmented reality medical simulation: a technical report.在增强现实医学模拟中Magic Leap One上的集成眼动追踪:技术报告
BMJ Simul Technol Enhanc Learn. 2021 Feb 24;7(5):431-434. doi: 10.1136/bmjstel-2020-000782. eCollection 2021.
10
When medical trainees encountering a performance difficulty: evidence from pupillary responses.当医学实习生遇到表现困难时:瞳孔反应的证据。
BMC Med Educ. 2022 Mar 19;22(1):191. doi: 10.1186/s12909-022-03256-3.