Zhang Chuanhao, Wu Shangshang, Lu Zhiming, Shen Yajuan, Wang Jing, Huang Pu, Lou Jingjiao, Liu Cong, Xing Lei, Zhang Jian, Xue Jie, Li Dengwang
Shandong Key Laboratory of Medical Physics and Image Processing, Shandong Institute of Industrial Technology for Health Sciences and Precision Medicine, School of Physics and Electronics, Shandong Normal University, Jinan, Shandong, 250358, China.
Department of Clinical Laboratory, Shandong Provincial Hospital Affiliated to Shandong University, 250014, China.
Med Phys. 2020 Aug;47(8):3732-3744. doi: 10.1002/mp.14144. Epub 2020 Jun 24.
Leukemia is a lethal disease that is harmful to bone marrow and overall blood health. The classification of white blood cell images is crucial for leukemia diagnosis. The purpose of this study is to classify white blood cells by extracting discriminative information from cell segmentation and combining it with the fine-grained features. We propose a hybrid adversarial residual network with support vector machine (SVM), which utilizes the extracted features to improve the classification accuracy for human peripheral white cells.
Firstly, we segment the cell and nucleus by utilizing an adversarial residual network, which contains a segmentation network and a discriminator network. To extract features that can handle the inter-class consistency problem effectively, we introduce the adversarial residual network. Then, we utilize convolutional neural network (CNN) features and histogram of oriented gradient (HOG) features, which can extract discriminative features from images of segmented cell nuclei. To utilize the representative features fully, a discriminative network is introduced to deal with neighboring information at different scales. Finally, we combine the vectors of HOG features with those of CNN features and feed them into a linear SVM to classify white blood cells into six types.
We used three methods to evaluate the effect of leukocyte classification based on 5000 leukocyte images acquired from a local hospital. The first approach is to use the CNN features as the input of SVM to classify leukocytes, which achieved 94.23% specificity, 95.10% sensitivity, and 94.41% accuracy. The use of the HOG features for SVM achieved 83.50% specificity, 87.50% sensitivity, and 85.00% accuracy. The use of combined CNN and HOG features achieved 94.57% specificity, 96.11% sensitivity, and 95.93% accuracy.
We propose a novel hybrid adversarial-discriminative network for the classification of microscopic leukocyte images. It improves the accuracy of cell classification, reduces the difficulty and time pressure of doctors' work, and economizes the valuable time of doctors in daily clinical diagnosis.
白血病是一种对骨髓和整体血液健康有害的致命疾病。白细胞图像分类对于白血病诊断至关重要。本研究的目的是通过从细胞分割中提取判别信息并将其与细粒度特征相结合来对白细胞进行分类。我们提出了一种带有支持向量机(SVM)的混合对抗残差网络,该网络利用提取的特征来提高人类外周白细胞的分类准确率。
首先,我们利用一个对抗残差网络对细胞和细胞核进行分割,该网络包含一个分割网络和一个判别器网络。为了有效提取能够处理类间一致性问题的特征,我们引入了对抗残差网络。然后,我们利用卷积神经网络(CNN)特征和定向梯度直方图(HOG)特征,它们能够从分割后的细胞核图像中提取判别特征。为了充分利用代表性特征,引入一个判别网络来处理不同尺度的相邻信息。最后,我们将HOG特征向量与CNN特征向量相结合,并将它们输入到线性SVM中,将白细胞分为六种类型。
我们使用三种方法基于从当地医院获取的5000张白细胞图像评估白细胞分类效果。第一种方法是使用CNN特征作为SVM的输入来对白细胞进行分类,其特异性为94.23%,灵敏度为95.10%,准确率为94.41%。使用HOG特征进行SVM分类,特异性为83.50%,灵敏度为87.50%,准确率为85.00%。使用CNN和HOG特征相结合进行分类,特异性为94.57%,灵敏度为96.11%,准确率为95.93%。
我们提出了一种用于微观白细胞图像分类的新型混合对抗判别网络。它提高了细胞分类的准确率,降低了医生工作的难度和时间压力,并节省了医生在日常临床诊断中的宝贵时间。