2019
DOI: 10.1101/845693
|View full text |Cite
Preprint
|
Sign up to set email alerts
|

Evaluation of Connectivity Map shows limited reproducibility in drug repositioning

Abstract: The Connectivity Map (CMap) is a popular resource designed for data-driven drug repositioning using a large transcriptomic compendium. However, evaluations of its performance are limited. We used two iterations of CMap (CMap 1 and 2) to assess their comparability and reliability. We queried CMap 2 with CMap 1-derived signatures, expecting CMap 2 would highly prioritize the queried compounds; success rate was 17%. Analysis of previously published prioritizations yielded similar results. Low recall is caused by … Show more

Help me understand this report
View published versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

2
16
0

Year Published

2020
2020
2023
2023

Publication Types

Select...
6
1

Relationship

0
7

Authors

Journals

citations
Cited by 12 publications
(18 citation statements)
references
References 26 publications
(33 reference statements)
2
16
0
Order By: Relevance
“…However, TMPRSS2 was not well-imputed by the Connectivity Map (self-correlation = 0.56 between RNA-seq expression and imputed expression). Consistent with a recent preprint on the lack of reproducibility for L1000-based gene imputation values 28 , we did not observe a significant difference in TMPRSS2 expression following estradiol treatment in MCF7 breast cancer cells or PC3 prostate cancer cells (breast cancer and prostate cancer cells were used in RNA-seq studies from above).…”
Section: Literature-wide Screen For Transcriptional Inhibitors Of Sarsupporting
confidence: 91%
“…However, TMPRSS2 was not well-imputed by the Connectivity Map (self-correlation = 0.56 between RNA-seq expression and imputed expression). Consistent with a recent preprint on the lack of reproducibility for L1000-based gene imputation values 28 , we did not observe a significant difference in TMPRSS2 expression following estradiol treatment in MCF7 breast cancer cells or PC3 prostate cancer cells (breast cancer and prostate cancer cells were used in RNA-seq studies from above).…”
Section: Literature-wide Screen For Transcriptional Inhibitors Of Sarsupporting
confidence: 91%
“…Second, as the previous studies showed, the consistency between prioritization results from the CMap dataset and other connectivity map libraries such as the LINCS library is low ( Lim and Pavlidis, 2019 ). Therefore, LINCS does not reproduce CMap dataset drug prioritization.…”
Section: Discussionmentioning
confidence: 98%
“…Despite this increased throughput, screening campaigns still need to be performed in discrete batches. Batch effects (and, more generally, technical factors affecting reproducibility) remain the major analytical hurdle in extracting insight from any drug-profiling dataset, either based on transcriptomics [ 33 , 34 ] or other readouts (WEB: ). Proprietary drug profiling endeavors can be modeled after large public efforts such as LINCS Connectivity Map 2.0, which, in addition to releasing openly accessible datasets, sets best practices and provides analytical tools (WEB: ).…”
Section: Transcriptomics—bulk and Single-cell Sequencingmentioning
confidence: 99%