Division of Imaging, Diagnostics, and Software Reliability, CDRH, U.S Food and Drug Administration, Silver Spring, MD, 20993, USA.
Med Phys. 2021 Jul;48(7):3741-3751. doi: 10.1002/mp.14915. Epub 2021 May 26.
Most state-of-the-art automated medical image analysis methods for volumetric data rely on adaptations of two-dimensional (2D) and three-dimensional (3D) convolutional neural networks (CNNs). In this paper, we develop a novel unified CNN-based model that combines the benefits of 2D and 3D networks for analyzing volumetric medical images.
In our proposed framework, multiscale contextual information is first extracted from 2D slices inside a volume of interest (VOI). This is followed by dilated 1D convolutions across slices to aggregate in-plane features in a slice-wise manner and encode the information in the entire volume. Moreover, we formalize a curriculum learning strategy for a two-stage system (i.e., a system that consists of screening and false positive reduction), where the training samples are presented to the network in a meaningful order to further improve the performance.
We evaluated the proposed approach by developing a computer-aided detection (CADe) system for lung nodules. Our results on 888 CT exams demonstrate that the proposed approach can effectively analyze volumetric data by achieving a sensitivity of > 0.99 in the screening stage and a sensitivity of > 0.96 at eight false positives per case in the false positive reduction stage.
Our experimental results show that the proposed method provides competitive results compared to state-of-the-art 3D frameworks. In addition, we illustrate the benefits of curriculum learning strategies in two-stage systems that are of common use in medical imaging applications.
大多数最先进的用于容积数据的自动化医学图像分析方法都依赖于二维(2D)和三维(3D)卷积神经网络(CNN)的改编。在本文中,我们开发了一种新颖的基于 CNN 的模型,该模型结合了 2D 和 3D 网络的优势,用于分析容积医学图像。
在我们提出的框架中,首先从感兴趣体积(VOI)内的 2D 切片中提取多尺度上下文信息。然后,通过在切片上进行扩张的 1D 卷积来聚合平面内特征,并以切片方式对整个体积中的信息进行编码。此外,我们为两阶段系统(即由筛选和假阳性减少组成的系统)制定了课程学习策略,其中以有意义的顺序向网络提供训练样本,以进一步提高性能。
我们通过开发用于肺结节的计算机辅助检测(CADe)系统来评估所提出的方法。我们在 888 次 CT 检查中的结果表明,所提出的方法可以通过在筛选阶段实现>0.99 的灵敏度以及在假阳性减少阶段每例 8 个假阳性的灵敏度>0.96 来有效地分析容积数据。
与最先进的 3D 框架相比,我们的实验结果表明,所提出的方法提供了有竞争力的结果。此外,我们还说明了课程学习策略在医学成像应用中常用的两阶段系统中的优势。