Shambhala: a platform-agnostic data harmonizer for gene expression data

Abstract

BackgroundHarmonization techniques make different gene expression profiles and their sets compatible and ready for comparisons. Here we present a new bioinformatic tool termed Shambhala for harmonization of multiple human gene expression datasets obtained using different experimental methods and platforms of microarray hybridization and RNA sequencing.ResultsUnlike previously published methods enabling good quality data harmonization for only two datasets, Shambhala allows conversion of multiple datasets into the universal form suitable for further comparisons. Shambhala harmonization is based on the calibration of gene expression profiles using the auxiliary standardization dataset. Each profile is transformed to make it similar to the output of microarray hybridization platform Affymetrix Human Gene. This platform was chosen because it has the biggest number of human gene expression profiles deposited in public databases. We evaluated Shambhala ability to retain biologically important features after harmonization. The same four biological samples taken in multiple replicates were profiled independently using three and four different experimental platforms, respectively, then Shambhala-harmonized and investigated by hierarchical clustering.ConclusionOur results showed that unlike other frequently used methods: quantile normalization and DESeq/DESeq2 normalization, Shambhala harmonization was the only method supporting sample-specific and platform-independent biologically meaningful clustering for the data obtained from multiple experimental platforms.Electronic supplementary materialThe online version of this article (10.1186/s12859-019-2641-8) contains supplementary material, which is available to authorized users.

Flexible Data Trimming Improves Performance of Global Machine Learning Methods in Omics-Based Personalized Oncology

“…Another possibility is to aggregate different smaller datasets into bigger ones. For such aggregation, a new harmonizing technique, which is capable to merge arbitrary number of datasets obtained using arbitrary experimental platforms [46], may be applied.…”

CuBlock: A cross-platform normalization method for gene-expression microarrays

“…We selected two benchmark data sets previously used in similar studies (Rudy and Valafar, 2011;Borisov et al, 2019). The first set (here called the reference data set) originates from projects MAQC (MAQC-I) (MAQC Consortium, 2006) and SEQC/MAQC-III (SEQC/MAQC-III Consortium, 2014), which made use of reference RNA samples to assess repeatability of gene-expression microarray data within a specific site, reproducibility across multiple sites and comparability across multiple platforms.…”

“…These biosamples had been analyzed using different platforms and in different sites, as described (MAQC Consortium, 2006;SEQC/MAQC-III Consortium, 2014). Following the work from Rudy and Valafar (2011) and Borisov et al (2019), we selected data from six of the platforms (between parentheses, data-set identifier in this study, GEO platform ID and project of origin): Note that in the MAQC-I study the following microarrays from AG1 were discarded as outliers after the Agilent's Feature Extraction QC Report: AG1_1_A1, AG1_2_A3, AG1_2_D2, AG1_3_B3. Since the data for these microarrays is nevertheless deposited and we wanted our analysis to be as independent as possible of platform-dependent data-preprocessing steps, we considered also their inclusion.…”

“…In addition to involving the normalization of a large joined data set, the eventual addition of new microarray data requires global renormalization. This led to the more recent development of sample-wise, cross-platform normalization methods such as SCAN (Piccolo et al, 2012), YuGene (Lê Cao et al, 2014), DBNorm (Meng et al, 2017) -which can operate sample or platform wise-and Shambhala (Borisov et al, 2019). SCAN performs a sample-wise normalization assuming a double Gaussian mixture distribution.…”

RNA sequencing profiles and diagnostic signatures linked with response to ramucirumab in gastric cancer

“…However, RNA sequencing datasets obtained using different equipment, reagents and protocols may be poorly compatible with each other (Buzdin et al 2014;Borisov et al 2019) and ideally the same experimental platform should be used to compare the results (Borisov et al 2019). We recently published an annotated database of RNA sequencing profiles termed Oncobox Atlas of Normal Tissue Expression (ANTE) (Suntsova et al 2019) that represents 142 solid tissue samples from human healthy donors killed in road accidents, and seventeen blood samples from healthy volunteers.…”