Thayer School of Engineering, Dartmouth College, Hanover, NH 03755, USA.
Department of Electrical Engineering and Computer Science, Vanderbilt University, Nashville, TN 37235, USA.
Med Image Anal. 2021 Jul;71:102048. doi: 10.1016/j.media.2021.102048. Epub 2021 Apr 5.
Recently, single-stage embedding based deep learning algorithms gain increasing attention in cell segmentation and tracking. Compared with the traditional "segment-then-associate" two-stage approach, a single-stage algorithm not only simultaneously achieves consistent instance cell segmentation and tracking but also gains superior performance when distinguishing ambiguous pixels on boundaries and overlaps. However, the deployment of an embedding based algorithm is restricted by slow inference speed (e.g., ≈1-2 min per frame). In this study, we propose a novel Faster Mean-shift algorithm, which tackles the computational bottleneck of embedding based cell segmentation and tracking. Different from previous GPU-accelerated fast mean-shift algorithms, a new online seed optimization policy (OSOP) is introduced to adaptively determine the minimal number of seeds, accelerate computation, and save GPU memory. With both embedding simulation and empirical validation via the four cohorts from the ISBI cell tracking challenge, the proposed Faster Mean-shift algorithm achieved 7-10 times speedup compared to the state-of-the-art embedding based cell instance segmentation and tracking algorithm. Our Faster Mean-shift algorithm also achieved the highest computational speed compared to other GPU benchmarks with optimized memory consumption. The Faster Mean-shift is a plug-and-play model, which can be employed on other pixel embedding based clustering inference for medical image analysis. (Plug-and-play model is publicly available: https://github.com/masqm/Faster-Mean-Shift).
最近,基于单阶段嵌入的深度学习算法在细胞分割和跟踪方面受到了越来越多的关注。与传统的“分割-关联”两阶段方法相比,单阶段算法不仅同时实现了一致的实例细胞分割和跟踪,而且在区分边界和重叠处的模糊像素方面具有更好的性能。然而,基于嵌入的算法的部署受到推理速度慢的限制(例如,≈1-2 分钟/帧)。在本研究中,我们提出了一种新颖的快速均值漂移算法,该算法解决了基于嵌入的细胞分割和跟踪的计算瓶颈。与以前的 GPU 加速快速均值漂移算法不同,我们引入了一种新的在线种子优化策略(OSOP),以自适应地确定最小种子数、加速计算并节省 GPU 内存。通过来自 ISBI 细胞跟踪挑战的四个队列的嵌入模拟和经验验证,与最先进的基于嵌入的细胞实例分割和跟踪算法相比,所提出的快速均值漂移算法实现了 7-10 倍的加速。与其他 GPU 基准测试相比,我们的快速均值漂移算法在优化内存消耗的情况下也实现了最高的计算速度。快速均值漂移是一种即插即用的模型,可用于其他基于像素嵌入的聚类推理,用于医学图像分析。(即插即用模型可在 https://github.com/masqm/Faster-Mean-Shift 上获得)。