Papadomanolakis Theodoros N, Sergaki Eleftheria S, Polydorou Andreas A, Krasoudakis Antonios G, Makris-Tsalikis Georgios N, Polydorou Alexios A, Afentakis Nikolaos M, Athanasiou Sofia A, Vardiambasis Ioannis O, Zervakis Michail E
School of Electrical and Computer Engineering, Technical University of Crete, 73100 Chania, Greece.
Areteio Hospital, 2nd University Department of Surgery, Medical School, National and Kapodistrian University of Athens, 11528 Athens, Greece.
Brain Sci. 2023 Feb 17;13(2):348. doi: 10.3390/brainsci13020348.
Brain tumors are diagnosed and classified manually and noninvasively by radiologists using Magnetic Resonance Imaging (MRI) data. The risk of misdiagnosis may exist due to human factors such as lack of time, fatigue, and relatively low experience. Deep learning methods have become increasingly important in MRI classification. To improve diagnostic accuracy, researchers emphasize the need to develop Computer-Aided Diagnosis (CAD) computational diagnostics based on artificial intelligence (AI) systems by using deep learning methods such as convolutional neural networks (CNN) and improving the performance of CNN by combining it with other data analysis tools such as wavelet transform. In this study, a novel diagnostic framework based on CNN and DWT data analysis is developed for the diagnosis of glioma tumors in the brain, among other tumors and other diseases, with T2-SWI MRI scans. It is a binary CNN classifier that treats the disease "glioma tumor" as positive and the other pathologies as negative, resulting in a very unbalanced binary problem. The study includes a comparative analysis of a CNN trained with wavelet transform data of MRIs instead of their pixel intensity values in order to demonstrate the increased performance of the CNN and DWT analysis in diagnosing brain gliomas. The results of the proposed CNN architecture are also compared with a deep CNN pre-trained on VGG16 transfer learning network and with the SVM machine learning method using DWT knowledge.
To improve the accuracy of the CNN classifier, the proposed CNN model uses as knowledge the spatial and temporal features extracted by converting the original MRI images to the frequency domain by performing Discrete Wavelet Transformation (DWT), instead of the traditionally used original scans in the form of pixel intensities. Moreover, no pre-processing was applied to the original images. The images used are MRIs of type T2-SWI sequences parallel to the axial plane. Firstly, a compression step is applied for each MRI scan applying DWT up to three levels of decomposition. These data are used to train a 2D CNN in order to classify the scans as showing glioma or not. The proposed CNN model is trained on MRI slices originated from 382 various male and female adult patients, showing healthy and pathological images from a selection of diseases (showing glioma, meningioma, pituitary, necrosis, edema, non-enchasing tumor, hemorrhagic foci, edema, ischemic changes, cystic areas, etc.). The images are provided by the database of the Medical Image Computing and Computer-Assisted Intervention (MICCAI) and the Ischemic Stroke Lesion Segmentation (ISLES) challenges on Brain Tumor Segmentation (BraTS) challenges 2016 and 2017, as well as by the numerous records kept in the public general hospital of Chania, Crete, "Saint George".
The proposed frameworks are experimentally evaluated by examining MRI slices originating from 190 different patients (not included in the training set), of which 56% are showing gliomas by the longest two axes less than 2 cm and 44% are showing other pathological effects or healthy cases. Results show convincing performance when using as information the spatial and temporal features extracted by the original scans. With the proposed CNN model and with data in DWT format, we achieved the following statistic percentages: accuracy 0.97, sensitivity (recall) 1, specificity 0.93, precision 0.95, FNR 0, and FPR 0.07. These numbers are higher for this data format (respectively: accuracy by 6% higher, recall by 11%, specificity by 7%, precision by 5%, FNR by 0.1%, and FPR is the same) than it would be, had we used as input data the intensity values of the MRIs (instead of the DWT analysis of the MRIs). Additionally, our study showed that when our CNN takes into account the TL of the existing network VGG, the performance values are lower, as follows: accuracy 0.87, sensitivity (recall) 0.91, specificity 0.84, precision 0.86, FNR of 0.08, and FPR 0.14.
The experimental results show the outperformance of the CNN, which is not based on transfer learning, but is using as information the MRI brain scans decomposed into DWT information instead of the pixel intensity of the original scans. The results are promising for the proposed CNN based on DWT knowledge to serve for binary diagnosis of glioma tumors among other tumors and diseases. Moreover, the SVM learning model using DWT data analysis performs with higher accuracy and sensitivity than using pixel values.
脑肿瘤由放射科医生使用磁共振成像(MRI)数据进行手动和非侵入性诊断及分类。由于诸如时间不足、疲劳和经验相对不足等人为因素,可能存在误诊风险。深度学习方法在MRI分类中变得越来越重要。为提高诊断准确性,研究人员强调需要通过使用卷积神经网络(CNN)等深度学习方法,并将其与小波变换等其他数据分析工具相结合来提高CNN性能,从而开发基于人工智能(AI)系统的计算机辅助诊断(CAD)计算诊断方法。在本研究中,针对脑内胶质瘤肿瘤以及其他肿瘤和疾病,利用T2-SWI MRI扫描,开发了一种基于CNN和离散小波变换(DWT)数据分析的新型诊断框架。它是一个二分类CNN分类器,将“胶质瘤肿瘤”疾病视为阳性,其他病理视为阴性,从而产生了一个非常不平衡的二分类问题。该研究包括对一个使用MRI的小波变换数据而非其像素强度值进行训练的CNN的对比分析,以证明CNN和DWT分析在诊断脑胶质瘤方面的性能提升。所提出的CNN架构的结果还与在VGG16迁移学习网络上预训练的深度CNN以及使用DWT知识的支持向量机(SVM)机器学习方法进行了比较。
为提高CNN分类器的准确性,所提出的CNN模型将通过对原始MRI图像进行离散小波变换(DWT)转换到频域而提取的空间和时间特征用作知识,而非传统上以像素强度形式使用的原始扫描数据。此外,未对原始图像进行预处理。所使用图像为与轴向平面平行的T2-SWI序列的MRI。首先,对每个MRI扫描应用DWT进行多达三级分解的压缩步骤。这些数据用于训练一个二维CNN,以便将扫描分类为显示胶质瘤或不显示。所提出的CNN模型在源自382名不同成年男女患者的MRI切片上进行训练,这些切片展示了多种疾病(显示胶质瘤、脑膜瘤、垂体瘤、坏死、水肿、非强化肿瘤、出血灶、水肿、缺血性改变、囊性区域等)的健康和病理图像。图像由医学图像计算和计算机辅助干预(MICCAI)数据库以及2016年和2017年脑肿瘤分割(BraTS)挑战中的缺血性中风病变分割(ISLES)挑战提供,以及由克里特岛哈尼亚“圣乔治”公立综合医院保存的众多记录提供。
通过检查源自190名不同患者(不包括在训练集中)的MRI切片对所提出的框架进行实验评估,其中56%的切片显示最长两个轴小于2 cm的胶质瘤,44%的切片显示其他病理效应或健康病例。当将原始扫描提取的空间和时间特征用作信息时,结果显示出令人信服的性能。使用所提出的CNN模型和DWT格式的数据,我们获得了以下统计百分比:准确率0.97、灵敏度(召回率)1、特异性0.93、精确率0.95、漏诊率0、误报率0.07。对于此数据格式,这些数字(分别为:准确率高6%、召回率高11%、特异性高7%、精确率高5%、漏诊率高0.1%,误报率相同)高于我们将MRI的强度值用作输入数据(而非对MRI进行DWT分析)时的情况。此外,我们的研究表明,当我们的CNN考虑现有网络VGG的迁移学习时,性能值较低,如下:准确率0.87、灵敏度(召回率)0.91、特异性0.84、精确率0.86、漏诊率0.08、误报率0.14。
实验结果表明,不基于迁移学习但将分解为DWT信息的MRI脑扫描用作信息的CNN具有优越性。基于DWT知识所提出的CNN在胶质瘤肿瘤以及其他肿瘤和疾病的二分类诊断方面的结果很有前景。此外,使用DWT数据分析的SVM学习模型比使用像素值时具有更高的准确性和灵敏度。