Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300, 3000, Leuven, Belgium.
Healthcare Division, Barco NV, Beneluxpark 21, 8500, Kortrijk, Belgium.
Int J Comput Assist Radiol Surg. 2023 Sep;18(9):1679-1686. doi: 10.1007/s11548-023-02876-4. Epub 2023 Mar 30.
PURPOSE: In general minimally invasive surgical procedures, surgeons are tied to 2D visualization, leading to the loss of depth perception. This can lead to large mental load for the surgeons and may be responsible for the long learning curve. To restore the sense of depth, this study investigated the use and benefits of an autostereoscopic (3D) display during a simulated laparoscopic task. METHODS: A mixed reality simulator was developed for comparing the performance of participants while using 2D and autostereoscopic 3D visualization. An electromagnetic sensor was mounted on a physical instrument, and its pose was mapped to the virtual instrument. The virtual scene was developed using Simulation Open Framework Architecture (SOFA). Finite element modeling was used to calculate interaction forces, which were then mapped to visual soft tissue deformation. RESULTS: Ten non-expert participants completed a virtual laparoscopic task, where the subjects were asked to contact eighteen target areas distributed on the surface of the vagina, both in 2D and 3D. Results showed an improvement with 3D vision in task completion time (-16%), total traveled distance (-25%) and errors made (-14%). There was no difference in the average contact forces between the vagina and the instrument. Only the difference in time and forces were shown to be statistically significant. CONCLUSION: Overall, autostereoscopic 3D showed superiority over conventional 2D visualization. The traveled trajectory increased in 2D as the instrument was retracted more between the targets to avoid contact. The 2D and 3D deformation upon contact seems not to contribute differently to force perception. However, the participants only had visual feedback, but no haptic feedback. Therefore, it could be interesting to include haptic feedback in a future study.
目的:在一般的微创手术中,由于 surgeons 被限制在 2D 可视化中,因此会失去深度感知。这可能会给 surgeons 带来很大的精神负担,并且可能是导致学习曲线长的原因。为了恢复深度感知,本研究调查了在模拟腹腔镜任务中使用自动立体(3D)显示器的效果和益处。
方法:为了比较参与者在使用 2D 和自动立体 3D 可视化时的表现,开发了一种混合现实模拟器。将电磁传感器安装在物理仪器上,并将其姿态映射到虚拟仪器上。使用 Simulation Open Framework Architecture (SOFA) 开发了虚拟场景。使用有限元建模计算了相互作用力,然后将其映射到软组织的视觉变形上。
结果:十位非专家参与者完成了一项虚拟腹腔镜任务,要求他们接触分布在阴道表面的十八个目标区域,分别在 2D 和 3D 下进行。结果显示,使用 3D 视觉可以提高任务完成时间(减少 16%)、总行程距离(减少 25%)和错误率(减少 14%)。阴道和器械之间的平均接触力没有差异。只有时间和力的差异具有统计学意义。
结论:总体而言,自动立体 3D 显示优于传统 2D 可视化。在 2D 中,由于仪器在目标之间缩回更多以避免接触,因此行进轨迹增加。接触时的 2D 和 3D 变形似乎不会对力感知产生不同的影响。但是,参与者只有视觉反馈,而没有触觉反馈。因此,在未来的研究中加入触觉反馈可能会很有趣。