RNAontheBENCH: Computational and empirical resources for benchmarking RNAseq quantification and differential expression methods

Pierre Luc Germain, Alessandro Vitriolo, Antonio Adamo, Pasquale Laise, Vivek Das, Giuseppe Testa*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

28 Scopus citations


RNA sequencing (RNAseq) has become the method of choice for transcriptome analysis, yet no consensus exists as to the most appropriate pipeline for its analysis, with current benchmarks suffering important limitations. Here, we address these challenges through a rich benchmarking resource harnessing (i) two RNAseq datasets including ERCC ExFold spike-ins; (ii) Nanostring measurements of a panel of 150 genes on the same samples; (iii) a set of internal, genetically-determined controls; (iv) a reanalysis of the SEQC dataset; and (v) a focus on relative quantification (i.e. across-samples). We use this resource to compare different approaches to each step of RNAseq analysis, from alignment to differential expression testing. We show that methods providing the best absolute quantification do not necessarily provide good relative quantification across samples, that count-based methods are superior for gene-level relative quantification, and that the new generation of pseudo-alignment-based software performs as well as established methods, at a fraction of the computing time. We also assess the impact of library type and size on quantification and differential expression analysis. Finally, we have created a R package and a web platform to enable the simple and streamlined application of this resource to the benchmarking of future methods.

Original languageEnglish (US)
Pages (from-to)5054-5067
Number of pages14
Issue number11
StatePublished - Jun 20 2016
Externally publishedYes

Bibliographical note

Publisher Copyright:
© The Author(s) 2016. Published by Oxford University Press on behalf of Nucleic Acids Research.

ASJC Scopus subject areas

  • Genetics


Dive into the research topics of 'RNAontheBENCH: Computational and empirical resources for benchmarking RNAseq quantification and differential expression methods'. Together they form a unique fingerprint.

Cite this