IEEE Trans Vis Comput Graph. 2023 Mar;29(3):1651-1663. doi: 10.1109/TVCG.2021.3127918. Epub 2023 Jan 30.
We present a novel approach for volume exploration that is versatile yet effective in isolating semantic structures in both noisy and clean data. Specifically, we describe a hierarchical active contours approach based on Bhattacharyya gradient flow which is easier to control, robust to noise, and can incorporate various types of statistical information to drive an edge-agnostic exploration process. To facilitate a time-bound user-driven volume exploration process that is applicable to a wide variety of data sources, we present an efficient multi-GPU implementation that (1) is approximately 400 times faster than a single thread CPU implementation, (2) allows hierarchical exploration of 2D and 3D images, (3) supports customization through multidimensional attribute spaces, and (4) is applicable to a variety of data sources and semantic structures. The exploration system follows a 2-step process. It first applies active contours to isolate semantically meaningful subsets of the volume. It then applies transfer functions to the isolated regions locally to produce clear and clutter-free visualizations. We show the effectiveness of our approach in isolating and visualizing structures-of-interest without needing any specialized segmentation methods on a variety of data sources, including 3D optical microscopy, multi-channel optical volumes, abdominal and chest CT, micro-CT, MRI, simulation, and synthetic data. We also gathered feedback from a medical trainee regarding the usefulness of our approach and discussion on potential applications in clinical workflows.
我们提出了一种新颖的体积探索方法,该方法在嘈杂和干净的数据中都具有通用性和有效性,可以有效地隔离语义结构。具体来说,我们描述了一种基于 Bhattacharyya 梯度流的分层主动轮廓方法,该方法更易于控制,对噪声鲁棒,并且可以合并各种类型的统计信息来驱动无边缘的探索过程。为了促进适用于各种数据源的限时用户驱动的体积探索过程,我们提出了一种高效的多 GPU 实现方法,(1)比单线程 CPU 实现快约 400 倍,(2)允许对 2D 和 3D 图像进行分层探索,(3)支持通过多维属性空间进行定制,(4)适用于各种数据源和语义结构。探索系统遵循两步过程。它首先应用主动轮廓来隔离体积中语义上有意义的子集。然后,它将传递函数应用于隔离区域以产生清晰且无杂波的可视化效果。我们展示了我们的方法在各种数据源上无需任何特殊分割方法即可有效地隔离和可视化感兴趣的结构的有效性,包括 3D 光学显微镜、多通道光学体积、腹部和胸部 CT、微 CT、MRI、模拟和合成数据。我们还从一名医学实习生那里收集了关于我们的方法的有用性的反馈,并讨论了在临床工作流程中的潜在应用。