Department of Computer Science, University of Missouri, Columbia, MO 65211, USA.
Proteins. 2011;79 Suppl 10(Suppl 10):185-95. doi: 10.1002/prot.23185. Epub 2011 Oct 14.
Assessing the quality of predicted models is essential in protein tertiary structure prediction. In the past critical assessment of techniques for protein structure prediction (CASP) experiments, consensus quality assessment (QA) methods have shown to be very effective, outperforming single-model methods and other competing approaches by a large margin. In the consensus QA approach, the quality score of a model is typically estimated based on pair-wise structure similarity of it to a set of reference models. In CASP8, the differences among the top QA servers were mostly in the selection of the reference models. In this article, we present a new consensus method "SelCon" based on two key ideas: (1) to adaptively select appropriate reference models based on the attributes of the whole set of predicted models and (2) to weigh different reference models differently, and in particular not to use models that are too similar or too different from the candidate model as its references. We have developed several reference selection functions in SelCon and obtained improved QA results over existing QA methods in experiments using CASP7 and CASP8 data. In the recently completed CASP9 in 2010, the new method was implemented in our MUFOLD-WQA server. Both the official CASP9 assessment and our in-house evaluation showed that MUFOLD-WQA performed very well and achieved top performances in both the global structure QA and top-model selection category in CASP9.
评估预测模型的质量在蛋白质三级结构预测中至关重要。在过去的蛋白质结构预测技术关键评估(CASP)实验中,共识质量评估(QA)方法被证明非常有效,其性能远远优于单模型方法和其他竞争方法。在共识 QA 方法中,模型的质量得分通常是根据模型与一组参考模型的结构相似性对其进行估计的。在 CASP8 中,顶级 QA 服务器之间的差异主要在于参考模型的选择。在本文中,我们提出了一种新的共识方法“SelCon”,该方法基于两个关键思想:(1)根据整个预测模型集的属性自适应地选择适当的参考模型;(2)对不同的参考模型进行不同的加权,特别是不使用与候选模型太相似或太不相似的模型作为其参考。我们在 SelCon 中开发了几种参考选择函数,并在使用 CASP7 和 CASP8 数据的实验中获得了比现有 QA 方法更好的 QA 结果。在最近完成的 2010 年 CASP9 中,该新方法已在我们的 MUFOLD-WQA 服务器中实现。无论是官方的 CASP9 评估还是我们的内部评估都表明,MUFOLD-WQA 表现非常出色,在 CASP9 的全局结构 QA 和顶级模型选择类别中均取得了最佳性能。