Istituto per le Applicazioni del Calcolo, CNR, Naples, Italy.
BMC Bioinformatics. 2014 May 9;15:135. doi: 10.1186/1471-2105-15-135.
The main goal of the whole transcriptome analysis is to correctly identify all expressed transcripts within a specific cell/tissue--at a particular stage and condition--to determine their structures and to measure their abundances. RNA-seq data promise to allow identification and quantification of transcriptome at unprecedented level of resolution, accuracy and low cost. Several computational methods have been proposed to achieve such purposes. However, it is still not clear which promises are already met and which challenges are still open and require further methodological developments.
We carried out a simulation study to assess the performance of 5 widely used tools, such as: CEM, Cufflinks, iReckon, RSEM, and SLIDE. All of them have been used with default parameters. In particular, we considered the effect of the following three different scenarios: the availability of complete annotation, incomplete annotation, and no annotation at all. Moreover, comparisons were carried out using the methods in three different modes of action. In the first mode, the methods were forced to only deal with those isoforms that are present in the annotation; in the second mode, they were allowed to detect novel isoforms using the annotation as guide; in the third mode, they were operating in fully data driven way (although with the support of the alignment on the reference genome). In the latter modality, precision and recall are quite poor. On the contrary, results are better with the support of the annotation, even though it is not complete. Finally, abundance estimation error often shows a very skewed distribution. The performance strongly depends on the true real abundance of the isoforms. Lowly (and sometimes also moderately) expressed isoforms are poorly detected and estimated. In particular, lowly expressed isoforms are identified mainly if they are provided in the original annotation as potential isoforms.
Both detection and quantification of all isoforms from RNA-seq data are still hard problems and they are affected by many factors. Overall, the performance significantly changes since it depends on the modes of action and on the type of available annotation. Results obtained using complete or partial annotation are able to detect most of the expressed isoforms, even though the number of false positives is often high. Fully data driven approaches require more attention, at least for complex eucaryotic genomes. Improvements are desirable especially for isoform quantification and for isoform detection with low abundance.
全转录组分析的主要目标是正确识别特定细胞/组织中特定阶段和条件下所有表达的转录本,确定它们的结构并测量它们的丰度。RNA-seq 数据有望以空前的分辨率、准确性和低成本实现转录组的鉴定和定量。已经提出了几种计算方法来实现这些目的。然而,尚不清楚哪些承诺已经得到满足,哪些挑战仍然存在,需要进一步的方法发展。
我们进行了一项模拟研究,以评估 5 种广泛使用的工具的性能,例如:CEM、Cufflinks、iReckon、RSEM 和 SLIDE。它们都使用默认参数进行了测试。特别是,我们考虑了以下三种不同情况的影响:完全注释、不完全注释和完全没有注释。此外,还使用三种不同作用模式的方法进行了比较。在第一种模式下,方法被迫仅处理注释中存在的那些异构体;在第二种模式下,它们被允许使用注释作为指导来检测新的异构体;在第三种模式下,它们以完全数据驱动的方式(尽管得到了参考基因组上对齐的支持)运行。在后一种模式下,精度和召回率都很差。相反,在注释的支持下,即使不完整,结果也会更好。最后,丰度估计误差通常呈非常偏态分布。性能强烈依赖于异构体的真实真实丰度。低表达(有时也中度表达)的异构体检测和估计效果较差。特别是,如果低表达的异构体作为潜在异构体在原始注释中提供,则主要识别它们。
从 RNA-seq 数据中检测和定量所有异构体仍然是一个难题,并且受到许多因素的影响。总体而言,性能变化很大,因为它取决于作用模式和可用注释的类型。使用完整或部分注释可以检测到大多数表达的异构体,尽管假阳性数量通常很高。完全数据驱动的方法需要更多关注,至少对于复杂的真核基因组而言。需要改进,特别是在异构体定量和低丰度异构体检测方面。