一种用于神经母细胞瘤PET/CT引导介入的快速交互式增强现实系统。

A Fast and Interactive Augmented Reality System for PET/CT-guided Intervention of Neuroblastoma.

作者信息

Fraser Rowan, Bettati Patric, Young Jeff, Rathgeb Armand, Sirsi Shashank, Fei Baowei

机构信息

Center for Imaging and Surgical Innovation, University of Texas at Dallas, TX.

Department of Bioengineering, University of Texas at Dallas, Richardson, TX.

出版信息

Proc SPIE Int Soc Opt Eng. 2024 Feb;12928. doi: 10.1117/12.3008663. Epub 2024 Mar 29.

Abstract

Neuroblastoma is the most common type of extracranial solid tumor in children and can often result in death if not treated. High-intensity focused ultrasound (HIFU) is a non-invasive technique for treating tissue that is deep within the body. It avoids the use of ionizing radiation, avoiding long-term side-effects of these treatments. The goal of this project was to develop the rendering component of an augmented reality (AR) system with potential applications for image-guided HIFU treatment of neuroblastoma. Our project focuses on taking 3D models of neuroblastoma lesions obtained from PET/CT and displaying them in our AR system in near real-time for use by physicians. We used volume ray casting with raster graphics as our preferred rendering method, as it allows for the real-time editing of our 3D radiologic data. Some unique features of our AR system include intuitive hand gestures and virtual user interfaces that allow the user to interact with the rendered data and process PET/CT images for optimal visualization. We implemented the feature to set a custom transfer function, set custom intensity cutoff points, and region-of-interest extraction via cutting planes. In the future, we hope to incorporate this work as part of a complete system for focused ultrasound treatment by adding ultrasound simulation, visualization, and deformable registration.

摘要

神经母细胞瘤是儿童最常见的颅外实体瘤类型,如果不进行治疗,往往会导致死亡。高强度聚焦超声(HIFU)是一种用于治疗体内深部组织的非侵入性技术。它避免了使用电离辐射,避免了这些治疗的长期副作用。本项目的目标是开发一种增强现实(AR)系统的渲染组件,该组件在神经母细胞瘤的图像引导HIFU治疗中具有潜在应用。我们的项目专注于获取从PET/CT获得的神经母细胞瘤病变的3D模型,并在我们的AR系统中近乎实时地显示它们,以供医生使用。我们使用带有光栅图形的体光线投射作为我们首选的渲染方法,因为它允许对我们的3D放射学数据进行实时编辑。我们的AR系统的一些独特功能包括直观的手势和虚拟用户界面,允许用户与渲染数据进行交互,并处理PET/CT图像以实现最佳可视化。我们实现了设置自定义传递函数、设置自定义强度截止点以及通过切割平面提取感兴趣区域的功能。未来,我们希望通过添加超声模拟、可视化和可变形配准,将这项工作纳入一个完整的聚焦超声治疗系统中。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索