Electron Physical Sciences Imaging Centre, Diamond Light Source, Oxfordshire, UK.
Department of Materials, University of Oxford, Oxford, UK.
J Microsc. 2022 Dec;288(3):169-184. doi: 10.1111/jmi.13110. Epub 2022 May 11.
We present a trainable segmentation method implemented within the python package ParticleSpy. The method takes user labelled pixels, which are used to train a classifier and segment images of inorganic nanoparticles from transmission electron microscope images. This implementation is based on the trainable Waikato Environment for Knowledge Analysis (WEKA) segmentation, but is written in python, allowing a large degree of flexibility and meaning it can be easily expanded using other python packages. We find that trainable segmentation offers better accuracy than global or local thresholding methods and requires as few as 100 user-labelled pixels to produce an accurate segmentation. Trainable segmentation presents a balance of accuracy and training time between global/local thresholding and neural networks, when used on transmission electron microscope images of nanoparticles. We also quantitatively investigate the effectiveness of the components of trainable segmentation, its filter kernels and classifiers, in order to demonstrate the use cases for the different filter kernels in ParticleSpy and the most accurate classifiers for different data types. A set of filter kernels is identified that are effective in distinguishing particles from background but that retain dissimilar features. In terms of classifiers, we find that different classifiers perform optimally for different image contrast; specifically, a random forest classifier performs best for high-contrast ADF images, but that QDA and Gaussian Naïve Bayes classifiers perform better for low-contrast TEM images.
我们提出了一种可训练的分割方法,该方法在 Python 包 ParticleSpy 中实现。该方法采用用户标记的像素,用于训练分类器,并从透射电子显微镜图像中分割无机纳米粒子的图像。此实现基于可训练的怀卡托知识分析环境 (WEKA) 分割,但用 Python 编写,具有很大的灵活性,并且可以使用其他 Python 包轻松扩展。我们发现,可训练的分割比全局或局部阈值方法具有更高的准确性,并且只需 100 个用户标记的像素即可产生准确的分割。在使用纳米粒子的透射电子显微镜图像时,可训练的分割在准确性和训练时间之间提供了全局/局部阈值和神经网络之间的平衡。我们还定量研究了可训练分割的组成部分、其滤波器核和分类器的有效性,以展示 ParticleSpy 中不同滤波器核的用例以及不同数据类型的最准确分类器。确定了一组滤波器核,这些滤波器核可有效区分粒子与背景,但保留不同的特征。就分类器而言,我们发现不同的分类器在不同的图像对比度下表现最佳;具体来说,随机森林分类器在高对比度 ADF 图像上表现最佳,但 QDA 和高斯朴素贝叶斯分类器在低对比度 TEM 图像上表现更好。