Jiang Hao, Li Sen, Liu Weihuang, Zheng Hongjin, Liu Jinghao, Zhang Yang
College of Science, Harbin Institute of Technology, Shenzhen, China.
College of Science, Harbin Institute of Technology, Shenzhen, China
mSystems. 2020 Feb 4;5(1):e00840-19. doi: 10.1128/mSystems.00840-19.
Analyzing cells and tissues under a microscope is a cornerstone of biological research and clinical practice. However, the challenge faced by conventional microscopy image analysis is the fact that cell recognition through a microscope is still time-consuming and lacks both accuracy and consistency. Despite enormous progress in computer-aided microscopy cell detection, especially with recent deep-learning-based techniques, it is still difficult to translate an established method directly to a new cell target without extensive modification. The morphology of a cell is complex and highly varied, but it has long been known that cells show a nonrandom geometrical order in which a distinct and defined shape can be formed in a given type of cell. Thus, we have proposed a geometry-aware deep-learning method, geometric-feature spectrum ExtremeNet (GFS-ExtremeNet), for cell detection. GFS-ExtremeNet is built on the framework of ExtremeNet with a collection of geometric features, resulting in the accurate detection of any given cell target. We obtained promising detection results with microscopic images of publicly available mammalian cell nuclei and newly collected protozoa, whose cell shapes and sizes varied. Even more striking, our method was able to detect unicellular parasites within red blood cells without misdiagnosis of each other. Automated diagnostic microscopy powered by deep learning is useful, particularly in rural areas. However, there is no general method for object detection of different cells. In this study, we developed GFS-ExtremeNet, a geometry-aware deep-learning method which is based on the detection of four extreme key points for each object (topmost, bottommost, rightmost, and leftmost) and its center point. A postprocessing step, namely, adjacency spectrum, was employed to measure whether the distances between the key points were below a certain threshold for a particular cell candidate. Our newly proposed geometry-aware deep-learning method outperformed other conventional object detection methods and could be applied to any type of cell with a certain geometrical order. Our GFS-ExtremeNet approach opens a new window for the development of an automated cell detection system.
在显微镜下分析细胞和组织是生物学研究和临床实践的基石。然而,传统显微镜图像分析面临的挑战在于,通过显微镜进行细胞识别仍然耗时,且缺乏准确性和一致性。尽管计算机辅助显微镜细胞检测取得了巨大进展,尤其是最近基于深度学习的技术,但在没有大量修改的情况下,仍难以将既定方法直接应用于新的细胞目标。细胞的形态复杂且高度多样,但长期以来人们已知细胞呈现出非随机的几何顺序,在给定类型的细胞中可以形成独特且明确的形状。因此,我们提出了一种几何感知深度学习方法——几何特征谱极端网络(GFS - ExtremeNet)用于细胞检测。GFS - ExtremeNet基于极端网络框架构建,并集合了几何特征,从而能够准确检测任何给定的细胞目标。我们使用公开可用的哺乳动物细胞核显微图像以及新收集的原生动物(其细胞形状和大小各异)获得了有前景的检测结果。更引人注目的是,我们的方法能够检测红细胞内的单细胞寄生虫,且不会相互误诊。由深度学习驱动的自动诊断显微镜很有用,特别是在农村地区。然而,目前尚无针对不同细胞进行目标检测的通用方法。在本研究中,我们开发了GFS - ExtremeNet,这是一种几何感知深度学习方法,它基于检测每个物体的四个极端关键点(最顶部、最底部、最右侧和最左侧)及其中心点。采用了一个后处理步骤,即邻接谱,来测量特定细胞候选物的关键点之间的距离是否低于某个阈值。我们新提出的几何感知深度学习方法优于其他传统目标检测方法,并且可以应用于任何具有一定几何顺序的细胞类型。我们的GFS - ExtremeNet方法为自动细胞检测系统的开发打开了一扇新窗口。