Antonelli Martina, Lucignani Martina, Parrillo Chiara, Grassi Francesco, Figà Talamanca Lorenzo, Rossi Espagnet Maria C, Gandolfo Carlo, Secinaro Aurelio, Pasquini Luca, De Benedictis Alessandro, Placidi Elisa, De Palma Luca, Marras Carlo E, Marasi Alessandra, Napolitano Antonio
Medical Physics Department, Bambino Gesù Children's Hospital, IRCCS, Roma, Italy.
Neuroradiology Unit, Imaging Department, Bambino Gesù Children's Hospital, IRCCS, Roma, Italy.
Digit Health. 2023 Nov 16;9:20552076231214066. doi: 10.1177/20552076231214066. eCollection 2023 Jan-Dec.
OBJECTIVE: The goal of this work is to show how to implement a mixed reality application (app) for neurosurgery planning based on neuroimaging data, highlighting the strengths and weaknesses of its design. METHODS: Our workflow explains how to handle neuroimaging data, including how to load morphological, functional and diffusion tensor imaging data into a mixed reality environment, thus creating a first guide of this kind. Brain magnetic resonance imaging data from a paediatric patient were acquired using a 3 T Siemens Magnetom Skyra scanner. Initially, this raw data underwent specific software pre-processing and were subsequently transformed to ensure seamless integration with the mixed reality app. After that, we created three-dimensional models of brain structures and the mixed reality environment using Unity™ engine together with Microsoft® HoloLens 2™ device. To get an evaluation of the app we submitted a questionnaire to four neurosurgeons. To collect data concerning the performance of a user session we used Unity Performance Profiler. RESULTS: The use of the interactive features, such as rotating, scaling and moving models and browsing through menus, provided by the app had high scores in the questionnaire, and their use can still be improved as suggested by the performance data collected. The questionnaire's average scores were high, so the overall experiences of using our mixed reality app were positive. CONCLUSION: We have successfully created a valuable and easy-to-use neuroimaging data mixed reality app, laying the foundation for more future clinical uses, as more models and data derived from various biomedical images can be imported.
目的:本研究旨在展示如何基于神经影像数据实现用于神经外科手术规划的混合现实应用程序(应用),并突出其设计的优缺点。 方法:我们的工作流程阐述了如何处理神经影像数据,包括如何将形态学、功能和扩散张量成像数据加载到混合现实环境中,从而创建了此类首个指南。使用3 T西门子Magnetom Skyra扫描仪获取一名儿科患者的脑磁共振成像数据。最初,这些原始数据经过特定软件预处理,随后进行转换以确保与混合现实应用无缝集成。之后,我们使用Unity™引擎和Microsoft® HoloLens 2™设备创建了脑结构的三维模型和混合现实环境。为了评估该应用,我们向四位神经外科医生发放了问卷。为了收集有关用户会话性能的数据,我们使用了Unity性能分析器。 结果:该应用提供的诸如旋转、缩放和移动模型以及浏览菜单等交互功能在问卷中得分很高,并且根据收集到的性能数据,其使用仍有改进空间。问卷的平均得分较高,因此使用我们的混合现实应用的总体体验是积极的。 结论:我们成功创建了一个有价值且易于使用的神经影像数据混合现实应用,为未来更多临床应用奠定了基础,因为可以导入更多源自各种生物医学图像的模型和数据。
World Neurosurg. 2018-10
Comput Methods Programs Biomed. 2021-3
JMIR Biomed Eng. 2022-5-17
Oper Neurosurg (Hagerstown). 2022-7-1
J Biomed Inform. 2020
J Stroke Cerebrovasc Dis. 2020-6-8
JMIR Mhealth Uhealth. 2020-5-26