Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China; Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou, 310058, China.
Department of Biomedical Engineering, MOE Key Laboratory of Biomedical Engineering, State Key Laboratory of Modern Optical Instrumentation, Zhejiang Provincial Key Laboratory of Cardio-Cerebral Vascular Detection Technology and Medicinal Effectiveness Appraisal, Zhejiang University, Hangzhou, 310027, China.
Comput Biol Med. 2021 Jul;134:104523. doi: 10.1016/j.compbiomed.2021.104523. Epub 2021 May 29.
Advanced microscopy enables us to acquire quantities of time-lapse images to visualize the dynamic characteristics of tissues, cells or molecules. Microscopy images typically vary in signal-to-noise ratios and include a wealth of information which require multiple parameters and time-consuming iterative algorithms for processing. Precise analysis and statistical quantification are often needed for the understanding of the biological mechanisms underlying these dynamic image sequences, which has become a big challenge in the field. As deep learning technologies develop quickly, they have been applied in bioimage processing more and more frequently. Novel deep learning models based on convolution neural networks have been developed and illustrated to achieve inspiring outcomes. This review article introduces the applications of deep learning algorithms in microscopy image analysis, which include image classification, region segmentation, object tracking and super-resolution reconstruction. We also discuss the drawbacks of existing deep learning-based methods, especially on the challenges of training datasets acquisition and evaluation, and propose the potential solutions. Furthermore, the latest development of augmented intelligent microscopy that based on deep learning technology may lead to revolution in biomedical research.
高级显微镜使我们能够获取大量的延时图像,以可视化组织、细胞或分子的动态特征。显微镜图像的信噪比通常不同,并且包含大量的信息,这些信息需要多个参数和耗时的迭代算法进行处理。为了理解这些动态图像序列背后的生物学机制,通常需要进行精确的分析和统计量化,这在该领域已成为一个巨大的挑战。随着深度学习技术的快速发展,它们在生物图像处理中的应用越来越频繁。已经开发和说明了基于卷积神经网络的新型深度学习模型,以实现令人鼓舞的结果。本文介绍了深度学习算法在显微镜图像分析中的应用,包括图像分类、区域分割、目标跟踪和超分辨率重建。我们还讨论了现有基于深度学习的方法的缺点,特别是在训练数据集获取和评估方面的挑战,并提出了潜在的解决方案。此外,基于深度学习技术的增强型智能显微镜的最新发展可能会引发生物医学研究的革命。