School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100190, China.
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190,China.
Bioinformatics. 2023 Aug 1;39(8). doi: 10.1093/bioinformatics/btad436.
The registration of serial section electron microscope images is a critical step in reconstructing biological tissue volumes, and it aims to eliminate complex nonlinear deformations from sectioning and replicate the correct neurite structure. However, due to the inherent properties of biological structures and the challenges posed by section preparation of biological tissues, achieving an accurate registration of serial sections remains a significant challenge. Conventional nonlinear registration techniques, which are effective in eliminating nonlinear deformation, can also eliminate the natural morphological variation of neurites across sections. Additionally, accumulation of registration errors alters the neurite structure.
This article proposes a novel method for serial section registration that utilizes an unsupervised optical flow network to measure feature similarity rather than pixel similarity to eliminate nonlinear deformation and achieve pairwise registration between sections. The optical flow network is then employed to estimate and compensate for cumulative registration error, thereby allowing for the reconstruction of the structure of biological tissues. Based on the novel serial section registration method, a serial split technique is proposed for long-serial sections. Experimental results demonstrate that the state-of-the-art method proposed here effectively improves the spatial continuity of serial sections, leading to more accurate registration and improved reconstruction of the structure of biological tissues.
The source code and data are available at https://github.com/TongXin-CASIA/EFSR.
串行切片电子显微镜图像的配准是重建生物组织体积的关键步骤,其目的是消除切片带来的复杂非线性变形并复制正确的神经突结构。然而,由于生物结构的固有特性以及生物组织切片制备带来的挑战,实现准确的序列切片配准仍然是一个重大挑战。传统的非线性配准技术在消除非线性变形方面非常有效,但也会消除神经突在切片间的自然形态变化。此外,配准误差的累积会改变神经突的结构。
本文提出了一种新的串行切片配准方法,该方法利用无监督光流网络来测量特征相似性,而不是像素相似性,以消除非线性变形并实现切片间的两两配准。然后,利用光流网络来估计和补偿累积配准误差,从而允许重建生物组织的结构。基于新的串行切片配准方法,提出了一种用于长串行切片的串行分割技术。实验结果表明,本文提出的最先进方法有效地提高了串行切片的空间连续性,从而实现更准确的配准和改善生物组织结构的重建。
源代码和数据可在 https://github.com/TongXin-CASIA/EFSR 上获得。