Liao Jun, Chen Xu, Ding Ge, Dong Pei, Ye Hu, Wang Han, Zhang Yongbing, Yao Jianhua
Tencent AI Lab, Shenzhen 518054, China.
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen 518055, China.
Biomed Opt Express. 2021 Dec 14;13(1):314-327. doi: 10.1364/BOE.446928. eCollection 2022 Jan 1.
Digital pathology is being transformed by artificial intelligence (AI)-based pathological diagnosis. One major challenge for correct AI diagnoses is to ensure the focus quality of captured images. Here, we propose a deep learning-based single-shot autofocus method for microscopy. We use a modified MobileNetV3, a lightweight network, to predict the defocus distance with a single-shot microscopy image acquired at an arbitrary image plane without secondary camera or additional optics. The defocus prediction takes only 9 ms with a focusing error of only ∼1/15 depth of field. We also provide implementation examples for the augmented reality microscope and the whole slide imaging (WSI) system. Our proposed technique can perform real-time and accurate autofocus which will not only support pathologists in their daily work, but also provide potential applications in the life sciences, material research, and industrial automatic detection.
基于人工智能(AI)的病理诊断正在改变数字病理学。正确的人工智能诊断面临的一个主要挑战是确保所采集图像的对焦质量。在此,我们提出一种基于深度学习的显微镜单次自动对焦方法。我们使用经过改进的轻量级网络MobileNetV3,通过在任意图像平面采集的单次显微镜图像来预测散焦距离,无需辅助相机或额外光学器件。散焦预测仅需9毫秒,聚焦误差仅约为景深的1/15。我们还提供了增强现实显微镜和全玻片成像(WSI)系统的实现示例。我们提出的技术能够进行实时且准确的自动对焦,这不仅将在日常工作中为病理学家提供支持,还将在生命科学、材料研究和工业自动检测中提供潜在应用。