IEEE Trans Med Imaging. 2020 Apr;39(4):1195-1205. doi: 10.1109/TMI.2019.2945980. Epub 2019 Oct 7.
Morphology reconstruction of tree-like structures in volumetric images, such as neurons, retinal blood vessels, and bronchi, is of fundamental interest for biomedical research. 3D branch points play an important role in many reconstruction applications, especially for graph-based or seed-based reconstruction methods and can help to visualize the morphology structures. There are a few hand-crafted models proposed to detect the branch points. However, they are highly dependent on the empirical setting of the parameters for different images. In this paper, we propose a DeepBranch model for branch point detection with two-level designed convolutional networks, a candidate region segmenter and a false positive reducer. On the first level, an improved 3D U-Net model with anisotropic convolution kernels is employed to detect initial candidates. Compared with the traditional sliding window strategy, the improved 3D U-Net can avoid massive redundant computations and dramatically speed up the detection process by employing dense-inference with fully convolutional neural networks (FCN). On the second level, a method based on multi-scale multi-view convolutional neural networks (MSMV-Net) is proposed for false positive reduction by feeding multi-scale views of 3D volumes into multiple streams of 2D convolution neural networks (CNNs), which can take full advantage of spatial contextual information as well as fit different sizes. Experiments on multiple 3D biomedical images of neurons, retinal blood vessels and bronchi confirm that the proposed 3D branch point detection method outperforms other state-of-the-art detection methods, and is helpful for graph-based or seed-based reconstruction methods.
树状结构的体积图像形态重建,如神经元、视网膜血管和支气管,对生物医学研究具有重要意义。3D 分支点在许多重建应用中起着重要作用,特别是对于基于图或基于种子的重建方法,并有助于可视化形态结构。已经提出了一些手工制作的模型来检测分支点。然而,它们高度依赖于不同图像的参数的经验设置。在本文中,我们提出了一种用于分支点检测的 DeepBranch 模型,该模型具有两级设计的卷积网络,即候选区域分割器和假阳性减少器。在第一级,使用具有各向异性卷积核的改进 3D U-Net 模型来检测初始候选者。与传统的滑动窗口策略相比,改进的 3D U-Net 可以通过使用全卷积神经网络(FCN)进行密集推理来避免大量冗余计算,并通过 3D 体积的多尺度视图将多尺度多视图卷积神经网络(MSMV-Net)方法应用于假阳性减少,将多个 2D 卷积神经网络(CNN)的流中的多尺度视图送入,这可以充分利用空间上下文信息并适应不同的大小。对神经元、视网膜血管和支气管的多个 3D 生物医学图像的实验表明,所提出的 3D 分支点检测方法优于其他最先进的检测方法,有助于基于图或基于种子的重建方法。