Salvi Massimo, Acharya U Rajendra, Molinari Filippo, Meiburger Kristen M
Politecnico di Torino, PoliToBIOMed Lab, Biolab, Department of Electronics and Telecommunications, Corso Duca Degli Abruzzi 24, Turin, 10129, Italy.
Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore; Department of Biomedical Engineering, School of Science and Technology, SUSS University, Clementi, 599491, Singapore; Department of Bioinformatics and Medical Engineering, Asia University, Taiwan.
Comput Biol Med. 2021 Jan;128:104129. doi: 10.1016/j.compbiomed.2020.104129. Epub 2020 Nov 21.
Recently, deep learning frameworks have rapidly become the main methodology for analyzing medical images. Due to their powerful learning ability and advantages in dealing with complex patterns, deep learning algorithms are ideal for image analysis challenges, particularly in the field of digital pathology. The variety of image analysis tasks in the context of deep learning includes classification (e.g., healthy vs. cancerous tissue), detection (e.g., lymphocytes and mitosis counting), and segmentation (e.g., nuclei and glands segmentation). The majority of recent machine learning methods in digital pathology have a pre- and/or post-processing stage which is integrated with a deep neural network. These stages, based on traditional image processing methods, are employed to make the subsequent classification, detection, or segmentation problem easier to solve. Several studies have shown how the integration of pre- and post-processing methods within a deep learning pipeline can further increase the model's performance when compared to the network by itself. The aim of this review is to provide an overview on the types of methods that are used within deep learning frameworks either to optimally prepare the input (pre-processing) or to improve the results of the network output (post-processing), focusing on digital pathology image analysis. Many of the techniques presented here, especially the post-processing methods, are not limited to digital pathology but can be extended to almost any image analysis field.
近年来,深度学习框架迅速成为分析医学图像的主要方法。由于其强大的学习能力以及在处理复杂模式方面的优势,深度学习算法非常适合应对图像分析挑战,尤其是在数字病理学领域。深度学习背景下的图像分析任务种类繁多,包括分类(例如,健康组织与癌组织)、检测(例如,淋巴细胞计数和有丝分裂计数)以及分割(例如,细胞核和腺体分割)。数字病理学中大多数最新的机器学习方法都有一个与深度神经网络集成的预处理和/或后处理阶段。这些基于传统图像处理方法的阶段用于使后续的分类、检测或分割问题更易于解决。多项研究表明,与仅使用网络本身相比,在深度学习流程中集成预处理和后处理方法如何能够进一步提高模型的性能。本综述的目的是概述深度学习框架中用于优化输入(预处理)或改善网络输出结果(后处理)的方法类型,重点关注数字病理学图像分析。这里介绍的许多技术,尤其是后处理方法,不仅限于数字病理学,还可以扩展到几乎任何图像分析领域。