Necker Fabian N, Cholok David J, Shaheen Mohammed S, Fischer Marc J, Gifford Kyle, El Chemaly Trishia, Leuze Christoph W, Scholz Michael, Daniel Bruce L, Momeni Arash
Department of Radiology, Stanford IMMERS (Incubator for Medical Mixed and Extended Reality at Stanford), Stanford University School of Medicine, Palo Alto, CA, USA.
Institute of Functional and Clinical Anatomy, Digital Anatomy Lab, Faculty of Medicine, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany.
Surg Innov. 2024 Oct;31(5):563-566. doi: 10.1177/15533506241262946. Epub 2024 Jun 21.
Plastic surgeons routinely use 3D-models in their clinical practice, from 3D-photography and surface imaging to 3D-segmentations from radiological scans. However, these models continue to be viewed on flattened 2D screens that do not enable an intuitive understanding of 3D-relationships and cause challenges regarding collaboration with colleagues. The Metaverse has been proposed as a new age of applications building on modern Mixed Reality headset technology that allows remote collaboration on virtual 3D-models in a shared physical-virtual space in real-time. We demonstrate the first use of the Metaverse in the context of reconstructive surgery, focusing on preoperative planning discussions and trainee education. Using a HoloLens headset with the Microsoft Mesh application, we performed planning sessions for 4 DIEP-flaps in our reconstructive metaverse on virtual patient-models segmented from routine CT angiography. In these sessions, surgeons discuss perforator anatomy and perforator selection strategies whilst comprehensively assessing the respective models. We demonstrate the workflow for a one-on-one interaction between an attending surgeon and a trainee in a video featuring both viewpoints as seen through the headset. We believe the Metaverse will provide novel opportunities to use the 3D-models that are already created in everyday plastic surgery practice in a more collaborative, immersive, accessible, and educational manner.
整形外科医生在临床实践中经常使用3D模型,从3D摄影和表面成像到放射扫描的3D分割。然而,这些模型仍然在扁平的2D屏幕上查看,这无法直观地理解3D关系,并给与同事协作带来挑战。元宇宙被认为是基于现代混合现实头戴式设备技术的新时代应用,它允许在共享的物理-虚拟空间中对虚拟3D模型进行实时远程协作。我们展示了元宇宙在重建手术中的首次应用,重点是术前规划讨论和实习生教育。使用配备微软Mesh应用程序的HoloLens头戴式设备,我们在重建元宇宙中针对从常规CT血管造影分割出的虚拟患者模型进行了4例腹壁下动脉穿支皮瓣(DIEP瓣)的规划会议。在这些会议中,外科医生讨论穿支解剖结构和穿支选择策略,同时全面评估各个模型。我们在一段视频中展示了主刀医生和实习生之间一对一互动的工作流程,视频呈现了通过头戴式设备看到的双方视角。我们相信,元宇宙将提供新的机会,以更协作、沉浸式、便捷和教育性的方式使用日常整形外科实践中已经创建的3D模型。
J Reconstr Microsurg. 2024-6
Plast Reconstr Surg. 2019-9
World J Urol. 2023-10
J Educ Eval Health Prof. 2021
Plast Reconstr Surg. 2021-2-1
J Plast Reconstr Aesthet Surg. 2020-11
Plast Surg (Oakv). 2024-5
Plast Reconstr Surg Glob Open. 2022-11-3
J Plast Reconstr Aesthet Surg. 2021-5
Plast Reconstr Surg Glob Open. 2019-4-25
Plast Reconstr Surg. 2017-3