Biomedical Computer Vision Group, BioQuant, IPMB, Heidelberg University Im Neuenheimer Feld 267, Heidelberg, Germany.
Med Image Anal. 2021 May;70:102019. doi: 10.1016/j.media.2021.102019. Epub 2021 Feb 24.
Detection of cells and particles in microscopy images is a common and challenging task. In recent years, detection approaches in computer vision achieved remarkable improvements by leveraging deep learning. Microscopy images pose challenges like small and clustered objects, low signal to noise, and complex shape and appearance, for which current approaches still struggle. We introduce Deep Consensus Network, a new deep neural network for object detection in microscopy images based on object centroids. Our network is trainable end-to-end and comprises a Feature Pyramid Network-based feature extractor, a Centroid Proposal Network, and a layer for ensembling detection hypotheses over all image scales and anchors. We suggest an anchor regularization scheme that favours prior anchors over regressed locations. We also propose a novel loss function based on Normalized Mutual Information to cope with strong class imbalance, which we derive within a Bayesian framework. In addition, we introduce an improved algorithm for Non-Maximum Suppression which significantly reduces the algorithmic complexity. Experiments on synthetic data are performed to provide insights into the properties of the proposed loss function and its robustness. We also applied our method to challenging data from the TUPAC16 mitosis detection challenge and the Particle Tracking Challenge, and achieved results competitive or better than state-of-the-art.
在显微镜图像中检测细胞和粒子是一项常见且具有挑战性的任务。近年来,计算机视觉中的检测方法通过利用深度学习取得了显著的进展。显微镜图像存在着小而聚集的物体、低信噪比以及复杂的形状和外观等挑战,目前的方法仍然难以应对。我们引入了 Deep Consensus Network,这是一种基于物体质心的用于显微镜图像目标检测的新型深度神经网络。我们的网络是端到端可训练的,由基于特征金字塔网络的特征提取器、质心提议网络和一个用于在所有图像尺度和锚点上组合检测假设的层组成。我们提出了一种锚定正则化方案,该方案有利于先验锚定而不是回归位置。我们还在贝叶斯框架内提出了一种基于归一化互信息的新损失函数,以应对强烈的类别不平衡。此外,我们引入了一种改进的非极大值抑制算法,显著降低了算法复杂度。在合成数据上进行的实验提供了对所提出的损失函数的性质及其鲁棒性的深入了解。我们还将我们的方法应用于 TUPAC16 有丝分裂检测挑战赛和粒子跟踪挑战赛中的具有挑战性的数据,并取得了与最先进方法相当或更好的结果。