IEEE Trans Med Imaging. 2023 May;42(5):1509-1521. doi: 10.1109/TMI.2022.3231626. Epub 2023 May 2.
Cryo-electron microscopy (cryo-EM) is a widely used structural determination technique. Because of the extremely low signal-to-noise ratio (SNR) of images captured by cryo-EM, clustering single-particle cryo-EM images with high accuracy is challenging. To address this, we proposed an iterative denoising and clustering method based on a deep convolutional variational autoencoder and K-means++. The proposed method contains two modules: a denoising ResNet variational autoencoder (DRVAE), and Balance size K-means++ (BSK-means++). First, the DRVAE is trained in a fully unsupervised manner to initialize the neural network and obtain preliminary denoised images. Second, BSK-means++ is built for clustering denoised images, and images closer to class centers are divided into reliable samples. Third, the training of DRVAE is continued, while the class-average images are used as pseudo supervision of reliable samples to reserve more detailed information of denoised images. Finally, the second and third steps mentioned above can be performed jointly and iteratively until convergence occurs. The experimental results showed that the proposed method can generate reliable class average images and achieve better clustering accuracy and normalized mutual information than current methods. This study confirmed that DRVAE with BSK-means++ could achieve a good denoise performance on single-particle cryo-EM images, which can help researchers obtain information such as symmetry and heterogeneity of the target particles. In addition, the proposed method avoids the extreme imbalance of class size, which improves the reliability of the clustering result.
低温电子显微镜(cryo-EM)是一种广泛使用的结构测定技术。由于低温电子显微镜捕获的图像信噪比(SNR)极低,因此高精度地对单颗粒低温电子显微镜图像进行聚类具有挑战性。为了解决这个问题,我们提出了一种基于深度卷积变分自动编码器和 K-means++的迭代去噪和聚类方法。所提出的方法包含两个模块:去噪 ResNet 变分自动编码器(DRVAE)和平衡大小 K-means++(BSK-means++)。首先,以完全无监督的方式训练 DRVAE,以初始化神经网络并获得初步去噪图像。其次,构建 BSK-means++进行去噪图像聚类,将更接近类中心的图像分为可靠样本。第三,继续训练 DRVAE,同时使用类平均图像作为可靠样本的伪监督,以保留去噪图像的更多详细信息。最后,可以联合并迭代执行上述第二和第三步,直到收敛发生。实验结果表明,所提出的方法可以生成可靠的类平均图像,并实现比现有方法更好的聚类准确性和归一化互信息。这项研究证实,带有 BSK-means++的 DRVAE 可以对单颗粒低温电子显微镜图像实现良好的去噪性能,这有助于研究人员获取目标颗粒的对称性和异质性等信息。此外,所提出的方法避免了类大小的极端不平衡,提高了聚类结果的可靠性。