Masoudi Samira, Harmon Stephanie A, Mehralivand Sherif, Walker Stephanie M, Raviprakash Harish, Bagci Ulas, Choyke Peter L, Turkbey Baris
National Cancer Institute, National Institutes of Health, Molecular Imaging Branch, Bethesda, Maryland, United States.
National Institutes of Health, Department of Radiology and Imaging Sciences, Bethesda, Maryland, United States.
J Med Imaging (Bellingham). 2021 Jan;8(1):010901. doi: 10.1117/1.JMI.8.1.010901. Epub 2021 Jan 6.
: Deep learning has achieved major breakthroughs during the past decade in almost every field. There are plenty of publicly available algorithms, each designed to address a different task of computer vision in general. However, most of these algorithms cannot be directly applied to images in the medical domain. Herein, we are focused on the required preprocessing steps that should be applied to medical images prior to deep neural networks. To be able to employ the publicly available algorithms for clinical purposes, we must make a meaningful pixel/voxel representation from medical images which facilitates the learning process. Based on the ultimate goal expected from an algorithm (classification, detection, or segmentation), one may infer the required pre-processing steps that can ideally improve the performance of that algorithm. Required pre-processing steps for computed tomography (CT) and magnetic resonance (MR) images in their correct order are discussed in detail. We further supported our discussion by relevant experiments to investigate the efficiency of the listed preprocessing steps. Our experiments confirmed how using appropriate image pre-processing in the right order can improve the performance of deep neural networks in terms of better classification and segmentation. This work investigates the appropriate pre-processing steps for CT and MR images of prostate cancer patients, supported by several experiments that can be useful for educating those new to the field (https://github.com/NIH-MIP/Radiology_Image_Preprocessing_for_Deep_Learning).
深度学习在过去十年里几乎在每个领域都取得了重大突破。有大量公开可用的算法,总体而言,每个算法都旨在解决计算机视觉的不同任务。然而,这些算法中的大多数不能直接应用于医学领域的图像。在此,我们关注在深度神经网络之前应应用于医学图像的所需预处理步骤。为了能够将公开可用的算法用于临床目的,我们必须从医学图像中创建有意义的像素/体素表示,这有助于学习过程。根据算法预期的最终目标(分类、检测或分割),可以推断出理想情况下能够提高该算法性能的所需预处理步骤。详细讨论了计算机断层扫描(CT)和磁共振(MR)图像所需的正确顺序的预处理步骤。我们通过相关实验进一步支持我们的讨论,以研究所列预处理步骤的效率。我们的实验证实了按正确顺序使用适当的图像预处理如何能够在更好的分类和分割方面提高深度神经网络的性能。这项工作研究了前列腺癌患者CT和MR图像的适当预处理步骤,并得到了一些实验的支持,这些实验对该领域的新手有教育意义(https://github.com/NIH-MIP/Radiology_Image_Preprocessing_for_Deep_Learning)。