IEEE Trans Vis Comput Graph. 2019 May;25(5):2011-2021. doi: 10.1109/TVCG.2019.2898763. Epub 2019 Feb 14.
Virtual colonoscopy (VC) is a non-invasive screening tool for colorectal polyps which employs volume visualization of a colon model reconstructed from a CT scan of the patient's abdomen. We present an immersive analytics system for VC which enhances and improves the traditional desktop VC through the use of VR technologies. Our system, using a head-mounted display (HMD), includes all of the standard VC features, such as the volume rendered endoluminal fly-through, measurement tool, bookmark modes, electronic biopsy, and slice views. The use of VR immersion, stereo, and wider field of view and field of regard has a positive effect on polyp search and analysis tasks in our immersive VC system, a volumetric-based immersive analytics application. Navigation includes enhanced automatic speed and direction controls, based on the user's head orientation, in conjunction with physical navigation for exploration of local proximity. In order to accommodate the resolution and frame rate requirements for HMDs, new rendering techniques have been developed, including mesh-assisted volume raycasting and a novel lighting paradigm. Feedback and further suggestions from expert radiologists show the promise of our system for immersive analysis for VC and encourage new avenues for exploring the use of VR in visualization systems for medical diagnosis.
虚拟结肠镜检查(VC)是一种非侵入性的结直肠息肉筛查工具,它利用患者腹部 CT 扫描重建的结肠模型的容积可视化来实现。我们提出了一种用于 VC 的沉浸式分析系统,通过使用 VR 技术增强和改进传统的桌面 VC。我们的系统使用头戴式显示器(HMD),包括所有标准的 VC 功能,如容积渲染内腔飞行通过、测量工具、书签模式、电子活检和切片视图。在我们的基于体积的沉浸式分析应用程序中,VR 沉浸感、立体视觉和更宽的视野和视角对息肉搜索和分析任务有积极的影响。导航包括增强的自动速度和方向控制,基于用户的头部方向,并结合物理导航以探索局部接近度。为了适应 HMD 的分辨率和帧率要求,开发了新的渲染技术,包括网格辅助体积光线投射和新颖的照明范例。来自专家放射科医生的反馈和进一步建议表明,我们的系统在 VC 的沉浸式分析中具有广阔的应用前景,并鼓励探索 VR 在医学诊断可视化系统中的应用的新途径。