Rühle Bastian, Krumrey Julian Frederic, Hodoroaba Vasile-Dan
Federal Institute for Materials Research and Testing (BAM), Richard-Willstätter-Strasse 11, 12489, Berlin, Germany.
Faculty IV - Electrical Engineering and Computer Science, Technical University of Berlin, Marchstrasse 23, 10587, Berlin, Germany.
Sci Rep. 2021 Mar 2;11(1):4942. doi: 10.1038/s41598-021-84287-6.
We present a workflow for obtaining fully trained artificial neural networks that can perform automatic particle segmentations of agglomerated, non-spherical nanoparticles from scanning electron microscopy images "from scratch", without the need for large training data sets of manually annotated images. The whole process only requires about 15 min of hands-on time by a user and can typically be finished within less than 12 h when training on a single graphics card (GPU). After training, SEM image analysis can be carried out by the artificial neural network within seconds. This is achieved by using unsupervised learning for most of the training dataset generation, making heavy use of generative adversarial networks and especially unpaired image-to-image translation via cycle-consistent adversarial networks. We compare the segmentation masks obtained with our suggested workflow qualitatively and quantitatively to state-of-the-art methods using various metrics. Finally, we used the segmentation masks for automatically extracting particle size distributions from the SEM images of TiO particles, which were in excellent agreement with particle size distributions obtained manually but could be obtained in a fraction of the time.
我们提出了一种工作流程,用于获得经过充分训练的人工神经网络,该网络能够“从零开始”对扫描电子显微镜图像中的团聚、非球形纳米颗粒进行自动粒子分割,而无需大量手动标注图像的训练数据集。整个过程仅需用户约15分钟的实际操作时间,在单个图形处理器(GPU)上进行训练时,通常可在不到12小时内完成。训练后,人工神经网络可在数秒内完成扫描电子显微镜图像分析。这是通过在大多数训练数据集生成过程中使用无监督学习来实现的,大量使用生成对抗网络,特别是通过循环一致对抗网络进行的无配对图像到图像的转换。我们使用各种指标,将通过我们建议的工作流程获得的分割掩码与最先进的方法进行定性和定量比较。最后,我们使用分割掩码从TiO颗粒的扫描电子显微镜图像中自动提取粒径分布,其与手动获得的粒径分布非常吻合,但所需时间仅为手动获取的一小部分。