School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China; Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China.
School of Electronic and Information Engineering, Soochow University, Suzhou 215009, China; Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China.
Comput Biol Med. 2024 Aug;178:108456. doi: 10.1016/j.compbiomed.2024.108456. Epub 2024 Apr 12.
Large-scale electron microscopy (EM) has enabled the reconstruction of brain connectomes at the synaptic level by serially scanning over massive areas of sample sections. The acquired big EM data sets raise the great challenge of image mosaicking at high accuracy. Currently, it simply follows the conventional algorithms designed for natural images, which are usually composed of only a few tiles, using a single type of keypoint feature that would sacrifice speed for stronger performance. Even so, in the process of stitching hundreds of thousands of tiles for large EM data, errors are still inevitable and diverse. Moreover, there has not yet been an appropriate metric to quantitatively evaluate the stitching of biomedical EM images. Here we propose a two-stage error detection method to improve the EM image mosaicking. It firstly uses point-based error detection in combination with a hybrid feature framework to expedite the stitching computation while maintaining high accuracy. Following is the second detection of unresolved errors with a newly designed metric of EM stitched image quality assessment (EMSIQA). The novel detection-based mosaicking pipeline is tested on large EM data sets and proven to be more effective and as accurate when compared with existing methods.
大规模电子显微镜(EM)通过对大量样本切片区域进行连续扫描,实现了突触水平的大脑连接组重建。所获得的大型 EM 数据集提出了高精度图像拼接的巨大挑战。目前,它只是简单地遵循为自然图像设计的传统算法,这些算法通常只由几个瓦片组成,使用单一类型的关键点特征,这将牺牲速度来提高性能。即便如此,在拼接数十万张大型 EM 数据的瓦片时,仍然不可避免地会出现各种错误。此外,还没有一种合适的指标来定量评估生物医学 EM 图像的拼接。在这里,我们提出了一种两阶段的错误检测方法来改进 EM 图像拼接。它首先使用基于点的错误检测,并结合混合特征框架,在保持高精度的同时加快拼接计算速度。接下来,使用新设计的 EM 拼接图像质量评估(EMSIQA)度量标准对未解决的错误进行第二次检测。该新的基于检测的拼接流水线在大型 EM 数据集上进行了测试,结果表明与现有方法相比,它更有效且准确。