Abu Masyitah, Zahri Nik Adilah Hanin, Amir Amiza, Ismail Muhammad Izham, Yaakub Azhany, Anwar Said Amirul, Ahmad Muhammad Imran
Center of Excellence for Advanced Computing, Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis, Kangar 01000, Malaysia.
Institute of Engineering Mathematics, Faculty of Applied and Human Sciences, Universiti Malaysia Perlis, Arau 02600, Malaysia.
Diagnostics (Basel). 2022 May 18;12(5):1258. doi: 10.3390/diagnostics12051258.
Numerous research have demonstrated that Convolutional Neural Network (CNN) models are capable of classifying visual field (VF) defects with great accuracy. In this study, we evaluated the performance of different pre-trained models (VGG-Net, MobileNet, ResNet, and DenseNet) in classifying VF defects and produced a comprehensive comparative analysis to compare the performance of different CNN models before and after hyperparameter tuning and fine-tuning. Using 32 batch sizes, 50 epochs, and ADAM as the optimizer to optimize weight, bias, and learning rate, VGG-16 obtained the highest accuracy of 97.63 percent, according to experimental findings. Subsequently, Bayesian optimization was utilized to execute automated hyperparameter tuning and automated fine-tuning layers of the pre-trained models to determine the optimal hyperparameter and fine-tuning layer for classifying many VF defect with the highest accuracy. We found that the combination of different hyperparameters and fine-tuning of the pre-trained models significantly impact the performance of deep learning models for this classification task. In addition, we also discovered that the automated selection of optimal hyperparameters and fine-tuning by Bayesian has significantly enhanced the performance of the pre-trained models. The results observed the best performance for the DenseNet-121 model with a validation accuracy of 98.46% and a test accuracy of 99.57% for the tested datasets.
大量研究表明,卷积神经网络(CNN)模型能够高精度地对视野(VF)缺陷进行分类。在本研究中,我们评估了不同预训练模型(VGG-Net、MobileNet、ResNet和DenseNet)在分类VF缺陷方面的性能,并进行了全面的比较分析,以比较不同CNN模型在超参数调整和微调前后的性能。根据实验结果,使用32的批量大小、50个轮次,并以ADAM作为优化器来优化权重、偏差和学习率,VGG-16获得了97.63%的最高准确率。随后,利用贝叶斯优化对预训练模型执行自动超参数调整和自动微调层,以确定用于以最高准确率对多种VF缺陷进行分类的最优超参数和微调层。我们发现,不同超参数的组合以及预训练模型的微调对深度学习模型在此分类任务中的性能有显著影响。此外,我们还发现,通过贝叶斯自动选择最优超参数和进行微调显著提高了预训练模型的性能。对于测试数据集,DenseNet-121模型表现出最佳性能,验证准确率为98.46%,测试准确率为99.57%。