A comprehensive assessment of methods for de-novo reverse-engineering of genome-scale regulatory networks

Varun Narendra; Nikita I. Lytkin; Constantin F. Aliferis; Alexander Statnikov

doi:10.1016/j.ygeno.2010.10.003

A comprehensive assessment of methods for de-novo reverse-engineering of genome-scale regulatory networks

Varun Narendra, Nikita I. Lytkin, Constantin F. Aliferis, Alexander Statnikov

Institute for Health Informatics

Research output: Contribution to journal › Article › peer-review

33 Scopus citations

Abstract

De-novo reverse-engineering of genome-scale regulatory networks is an increasingly important objective for biological and translational research. While many methods have been recently developed for this task, their absolute and relative performance remains poorly understood. The present study conducts a rigorous performance assessment of 32 computational methods/variants for de-novo reverse-engineering of genome-scale regulatory networks by benchmarking these methods in 15 high-quality datasets and gold-standards of experimentally verified mechanistic knowledge. The results of this study show that some methods need to be substantially improved upon, while others should be used routinely. Our results also demonstrate that several univariate methods provide a "gatekeeper" performance threshold that should be applied when method developers assess the performance of their novel multivariate algorithms. Finally, the results of this study can be used to show practical utility and to establish guidelines for everyday use of reverse-engineering algorithms, aiming towards creation of automated data-analysis protocols and software systems.

Original language	English (US)
Pages (from-to)	7-18
Number of pages	12
Journal	Genomics
Volume	97
Issue number	1
DOIs	https://doi.org/10.1016/j.ygeno.2010.10.003
State	Published - Jan 2011

Bibliographical note

Funding Information:
Alexander Statnikov and Constantin F. Aliferis are acknowledging support from grants R56 LM007948-04A1 from the National Library of Medicine, National Institute of Health and 1UL1RR029893 from the National Center for Research Resources, National Institutes of Health . Varun Narendra was supported by the New York University Medical Science Training Program . We would also like to acknowledge Dimitris Anastassiou and John Watkinson for modifying the SA-CLR algorithm for our experiments and for running it on the Columbia University high performance computing facility; Boris Hayete for providing us with details on reproducing results of [21] ; Robert Castelo for providing us with details on reproducing results of [13] ; Peng Qiu for providing us with codes for fast computation of pairwise mutual information as in [41] ; and Thomas Schaffter and Daniel Marbach for assistance with GeneNetWeaver gene network simulator.

Keywords

Computational methods
Evaluation
Gene expression microarray analysis
Regulatory network de-novo reverse-engineering

Access

10.1016/j.ygeno.2010.10.003

OpenUrl availability

Full text

Cite this

@article{b5e24c69a6eb4f778120ba30a406ed14,

title = "A comprehensive assessment of methods for de-novo reverse-engineering of genome-scale regulatory networks",

abstract = "De-novo reverse-engineering of genome-scale regulatory networks is an increasingly important objective for biological and translational research. While many methods have been recently developed for this task, their absolute and relative performance remains poorly understood. The present study conducts a rigorous performance assessment of 32 computational methods/variants for de-novo reverse-engineering of genome-scale regulatory networks by benchmarking these methods in 15 high-quality datasets and gold-standards of experimentally verified mechanistic knowledge. The results of this study show that some methods need to be substantially improved upon, while others should be used routinely. Our results also demonstrate that several univariate methods provide a {"}gatekeeper{"} performance threshold that should be applied when method developers assess the performance of their novel multivariate algorithms. Finally, the results of this study can be used to show practical utility and to establish guidelines for everyday use of reverse-engineering algorithms, aiming towards creation of automated data-analysis protocols and software systems.",

keywords = "Computational methods, Evaluation, Gene expression microarray analysis, Regulatory network de-novo reverse-engineering",

author = "Varun Narendra and Lytkin, {Nikita I.} and Aliferis, {Constantin F.} and Alexander Statnikov",

note = "Funding Information: Alexander Statnikov and Constantin F. Aliferis are acknowledging support from grants R56 LM007948-04A1 from the National Library of Medicine, National Institute of Health and 1UL1RR029893 from the National Center for Research Resources, National Institutes of Health . Varun Narendra was supported by the New York University Medical Science Training Program . We would also like to acknowledge Dimitris Anastassiou and John Watkinson for modifying the SA-CLR algorithm for our experiments and for running it on the Columbia University high performance computing facility; Boris Hayete for providing us with details on reproducing results of [21] ; Robert Castelo for providing us with details on reproducing results of [13] ; Peng Qiu for providing us with codes for fast computation of pairwise mutual information as in [41] ; and Thomas Schaffter and Daniel Marbach for assistance with GeneNetWeaver gene network simulator. ",

year = "2011",

month = jan,

doi = "10.1016/j.ygeno.2010.10.003",

language = "English (US)",

volume = "97",

pages = "7--18",

journal = "Genomics",

issn = "0888-7543",

publisher = "Academic Press Inc.",

number = "1",

}

TY - JOUR

T1 - A comprehensive assessment of methods for de-novo reverse-engineering of genome-scale regulatory networks

AU - Narendra, Varun

AU - Lytkin, Nikita I.

AU - Aliferis, Constantin F.

AU - Statnikov, Alexander

N1 - Funding Information: Alexander Statnikov and Constantin F. Aliferis are acknowledging support from grants R56 LM007948-04A1 from the National Library of Medicine, National Institute of Health and 1UL1RR029893 from the National Center for Research Resources, National Institutes of Health . Varun Narendra was supported by the New York University Medical Science Training Program . We would also like to acknowledge Dimitris Anastassiou and John Watkinson for modifying the SA-CLR algorithm for our experiments and for running it on the Columbia University high performance computing facility; Boris Hayete for providing us with details on reproducing results of [21] ; Robert Castelo for providing us with details on reproducing results of [13] ; Peng Qiu for providing us with codes for fast computation of pairwise mutual information as in [41] ; and Thomas Schaffter and Daniel Marbach for assistance with GeneNetWeaver gene network simulator.

PY - 2011/1

Y1 - 2011/1

N2 - De-novo reverse-engineering of genome-scale regulatory networks is an increasingly important objective for biological and translational research. While many methods have been recently developed for this task, their absolute and relative performance remains poorly understood. The present study conducts a rigorous performance assessment of 32 computational methods/variants for de-novo reverse-engineering of genome-scale regulatory networks by benchmarking these methods in 15 high-quality datasets and gold-standards of experimentally verified mechanistic knowledge. The results of this study show that some methods need to be substantially improved upon, while others should be used routinely. Our results also demonstrate that several univariate methods provide a "gatekeeper" performance threshold that should be applied when method developers assess the performance of their novel multivariate algorithms. Finally, the results of this study can be used to show practical utility and to establish guidelines for everyday use of reverse-engineering algorithms, aiming towards creation of automated data-analysis protocols and software systems.

AB - De-novo reverse-engineering of genome-scale regulatory networks is an increasingly important objective for biological and translational research. While many methods have been recently developed for this task, their absolute and relative performance remains poorly understood. The present study conducts a rigorous performance assessment of 32 computational methods/variants for de-novo reverse-engineering of genome-scale regulatory networks by benchmarking these methods in 15 high-quality datasets and gold-standards of experimentally verified mechanistic knowledge. The results of this study show that some methods need to be substantially improved upon, while others should be used routinely. Our results also demonstrate that several univariate methods provide a "gatekeeper" performance threshold that should be applied when method developers assess the performance of their novel multivariate algorithms. Finally, the results of this study can be used to show practical utility and to establish guidelines for everyday use of reverse-engineering algorithms, aiming towards creation of automated data-analysis protocols and software systems.

KW - Computational methods

KW - Evaluation

KW - Gene expression microarray analysis

KW - Regulatory network de-novo reverse-engineering

UR - http://www.scopus.com/inward/record.url?scp=78650773077&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78650773077&partnerID=8YFLogxK

U2 - 10.1016/j.ygeno.2010.10.003

DO - 10.1016/j.ygeno.2010.10.003

M3 - Article

C2 - 20951196

AN - SCOPUS:78650773077

SN - 0888-7543

VL - 97

SP - 7

EP - 18

JO - Genomics

JF - Genomics

IS - 1

ER -

A comprehensive assessment of methods for de-novo reverse-engineering of genome-scale regulatory networks

Abstract

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this