Cinar Umut, Cetin Atalay Rengul, Cetin Yasemin Yardimci
Graduate School of Informatics, Middle East Technical University, Ankara 06800, Turkey.
J Imaging. 2023 Jan 21;9(2):25. doi: 10.3390/jimaging9020025.
This paper proposes a new Hepatocellular Carcinoma (HCC) classification method utilizing a hyperspectral imaging system (HSI) integrated with a light microscope. Using our custom imaging system, we have captured 270 bands of hyperspectral images of healthy and cancer tissue samples with HCC diagnosis from a liver microarray slide. Convolutional Neural Networks with 3D convolutions (3D-CNN) have been used to build an accurate classification model. With the help of 3D convolutions, spectral and spatial features within the hyperspectral cube are incorporated to train a strong classifier. Unlike 2D convolutions, 3D convolutions take the spectral dimension into account while automatically collecting distinctive features during the CNN training stage. As a result, we have avoided manual feature engineering on hyperspectral data and proposed a compact method for HSI medical applications. Moreover, the focal loss function, utilized as a CNN cost function, enables our model to tackle the class imbalance problem residing in the dataset effectively. The focal loss function emphasizes the hard examples to learn and prevents overfitting due to the lack of inter-class balancing. Our empirical results demonstrate the superiority of hyperspectral data over RGB data for liver cancer tissue classification. We have observed that increased spectral dimension results in higher classification accuracy. Both spectral and spatial features are essential in training an accurate learner for cancer tissue classification.
本文提出了一种新的肝细胞癌(HCC)分类方法,该方法利用与光学显微镜集成的高光谱成像系统(HSI)。使用我们的定制成像系统,我们从肝脏微阵列载玻片上捕获了具有HCC诊断的健康和癌组织样本的270波段高光谱图像。已使用具有3D卷积的卷积神经网络(3D-CNN)来构建准确的分类模型。借助3D卷积,高光谱立方体中的光谱和空间特征被纳入以训练强大的分类器。与2D卷积不同,3D卷积在CNN训练阶段自动收集独特特征的同时考虑了光谱维度。结果,我们避免了对高光谱数据进行手动特征工程,并提出了一种用于HSI医学应用的紧凑方法。此外,用作CNN成本函数的焦点损失函数使我们的模型能够有效解决数据集中存在的类不平衡问题。焦点损失函数强调难例学习,并防止由于缺乏类间平衡而导致的过拟合。我们的实证结果证明了高光谱数据在肝癌组织分类方面优于RGB数据。我们观察到光谱维度的增加导致更高的分类准确率。光谱和空间特征对于训练用于癌症组织分类的准确学习器都至关重要。