Department of Computer Science, University of Colorado, Colorado Springs, CO, 80918, USA.
Department of Mathematics, Oberlin College, Oberlin, OH, 44074, USA.
BMC Bioinformatics. 2022 Oct 6;23(1):413. doi: 10.1186/s12859-022-04971-w.
Identifying splice site regions is an important step in the genomic DNA sequencing pipelines of biomedical and pharmaceutical research. Within this research purview, efficient and accurate splice site detection is highly desirable, and a variety of computational models have been developed toward this end. Neural network architectures have recently been shown to outperform classical machine learning approaches for the task of splice site prediction. Despite these advances, there is still considerable potential for improvement, especially regarding model prediction accuracy, and error rate.
Given these deficits, we propose EnsembleSplice, an ensemble learning architecture made up of four (4) distinct convolutional neural networks (CNN) model architecture combination that outperform existing splice site detection methods in the experimental evaluation metrics considered including the accuracies and error rates. We trained and tested a variety of ensembles made up of CNNs and DNNs using the five-fold cross-validation method to identify the model that performed the best across the evaluation and diversity metrics. As a result, we developed our diverse and highly effective splice site (SS) detection model, which we evaluated using two (2) genomic Homo sapiens datasets and the Arabidopsis thaliana dataset. The results showed that for of the Homo sapiens EnsembleSplice achieved accuracies of 94.16% for one of the acceptor splice sites and 95.97% for donor splice sites, with an error rate for the same Homo sapiens dataset, 4.03% for the donor splice sites and 5.84% for the acceptor splice sites datasets.
Our five-fold cross validation ensured the prediction accuracy of our models are consistent. For reproducibility, all the datasets used, models generated, and results in our work are publicly available in our GitHub repository here: https://github.com/OluwadareLab/EnsembleSplice.
鉴定剪接位点区域是生物医学和制药研究基因组 DNA 测序管道中的重要步骤。在这一研究范围内,高效准确的剪接位点检测是非常理想的,为此已经开发了各种计算模型。神经网络架构最近已被证明在剪接位点预测任务中优于经典机器学习方法。尽管取得了这些进展,但仍有很大的改进空间,特别是在模型预测准确性和错误率方面。
鉴于这些缺陷,我们提出了 EnsembleSplice,这是一种由四个(4)不同的卷积神经网络(CNN)模型架构组合而成的集成学习架构,在考虑到的实验评估指标中,包括准确性和错误率,均优于现有的剪接位点检测方法。我们使用五重交叉验证方法训练和测试了由 CNN 和 DNN 组成的各种集成,以确定在评估和多样性指标方面表现最佳的模型。结果,我们开发了我们的多样化和高效的剪接位点(SS)检测模型,我们使用两个(2)人类基因组 Homo sapiens 数据集和拟南芥数据集对其进行了评估。结果表明,对于 Homo sapiens 数据集,EnsembleSplice 的接受剪接位点的准确率达到 94.16%,供体剪接位点的准确率达到 95.97%,同一 Homo sapiens 数据集的错误率为供体剪接位点为 4.03%,接受剪接位点为 5.84%。
我们的五重交叉验证确保了我们模型的预测准确性是一致的。为了实现可重复性,我们工作中使用的所有数据集、生成的模型和结果都在我们的 GitHub 存储库中公开可用:https://github.com/OluwadareLab/EnsembleSplice。