Bettati Patric, Fei Baowei
Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX.
Department of Bioengineering, University of Texas at Dallas, Richardson, TX.
Proc SPIE Int Soc Opt Eng. 2023 Feb;12466. doi: 10.1117/12.2653952. Epub 2023 Apr 3.
Augmented Reality (AR) is becoming a more common addition to physicians' repertoire for aiding in resident training and patient interactions. However, the use of augmented reality in clinical settings is still beset with many complications, including the lack of physician control over the systems, set modes of interactions within the system, and physician's lack of familiarity with such AR systems. In this paper, we plan to expand on our previous prostate biopsy AR system by adding in improved user interface systems within the virtual world in order to allow the user to more accurately visualize only parts of the system which they consider to be useful at that time. To accomplish this, we have incorporated three-dimensional virtual sliders built from the ground up, using Unity to afford control over each model's RGB values, as well as their transparency. This means that the user would be able to fully edit the color, and transparency of each individual model in real time as they see fit quickly and easily while still being immersed in the augmented space. This would allow users to view internal holograms while not sacrificing the capability to view the external structure. Such leeway could be invaluable when visualizing a tumor within a prostate and would provide the physician with the capability to view as much or as little of the surrounded virtual models as desired, while providing the option to reinstate the surrounding models at will. The AR system can provide a new approach for potential uses in image-guided interventions including targeted biopsy of the prostate.
增强现实（AR）正日益成为医生在住院医师培训和患者互动中常用的辅助手段。然而，在临床环境中使用增强现实仍面临许多问题，包括医生对系统缺乏控制、系统内固定的交互模式以及医生对这类AR系统不够熟悉等。在本文中，我们计划在之前的前列腺活检AR系统基础上进行扩展，在虚拟世界中添加改进的用户界面系统，以便用户能更准确地仅可视化他们当时认为有用的系统部分。为实现这一目标，我们全新构建了三维虚拟滑块，利用Unity来控制每个模型的RGB值及其透明度。这意味着用户在沉浸于增强空间的同时，能够根据自身需要快速轻松地实时全面编辑每个单独模型的颜色和透明度。这将使用户在不牺牲查看外部结构能力的情况下查看内部全息图。在可视化前列腺肿瘤时，这种灵活性可能非常宝贵，它将赋予医生根据需要查看尽可能多或尽可能少的周围虚拟模型的能力，同时还能随意恢复周围模型。该AR系统可为包括前列腺靶向活检在内的图像引导干预的潜在应用提供一种新方法。
