Department of Computer Science, CICESE Research Center, Ensenada, 22860, Mexico.
Current address: School of Mathematics & Statistical Sciences, University of Galway, Galway, H91 TK33, Ireland.
Mol Inform. 2023 Nov;42(11):e202300104. doi: 10.1002/minf.202300104. Epub 2023 Sep 6.
Cell-Penetrating Peptides (CPP) are emerging as an alternative to small-molecule drugs to expand the range of biomolecules that can be targeted for therapeutic purposes. Due to the importance of identifying and designing new CPP, a great variety of predictors have been developed to achieve these goals. To establish a ranking for these predictors, a couple of recent studies compared their performances on specific datasets, yet their conclusions cannot determine if the ranking obtained is due to the model, the set of descriptors or the datasets used to test the predictors. We present a systematic study of the influence of the peptide sequence's similarity of the datasets on the predictors' performance. The analysis reveals that the datasets used for training have a stronger influence on the predictors performance than the model or descriptors employed. We show that datasets with low sequence similarity between the positive and negative examples can be easily separated, and the tested classifiers showed good performance on them. On the other hand, a dataset with high sequence similarity between CPP and non-CPP will be a hard dataset, and it should be the one to be used for assessing the performance of new predictors.
细胞穿透肽 (CPP) 作为小分子药物的替代品正在兴起,以扩大可用于治疗目的的生物分子范围。由于确定和设计新的 CPP 的重要性,已经开发了各种各样的预测器来实现这些目标。为了对这些预测器进行排名,最近的几项研究比较了它们在特定数据集上的性能,但它们的结论并不能确定所获得的排名是由于模型、描述符集还是用于测试预测器的数据集。我们对数据集的肽序列相似性对预测器性能的影响进行了系统研究。分析表明,用于训练的数据集对预测器性能的影响比所使用的模型或描述符更强。我们表明,阳性和阴性示例之间序列相似性低的数据集可以很容易地分离,并且测试的分类器在这些数据集上表现良好。另一方面,CPP 和非 CPP 之间序列相似性高的数据集将是一个困难的数据集,应该是用于评估新预测器性能的数据集。