Defining diversity, specialization, and gene specificity in transcriptomes through information theory

Abstract

The transcriptome is a set of genes transcribed in a given tissue under specific conditions and can be characterized by a list of genes with their corresponding frequencies of transcription. Transcriptome changes can be measured by counting gene tags from mRNA libraries or by measuring light signals in DNA microarrays. In any case, it is difficult to completely comprehend the global changes that occur in the transcriptome, given that thousands of gene expression measurements are involved. We propose an approach to define and estimate the diversity and specialization of transcriptomes and gene specificity. We define transcriptome diversity as the Shannon entropy of its frequency distribution. Gene specificity is defined as the mutual information between the tissues and the corresponding transcript, allowing detection of either housekeeping or highly specific genes and clarifying the meaning of these concepts in the literature. Tissue specialization is measured by average gene specificity. We introduce the formulae using a simple example and show their application in two datasets of gene expression in human tissues. Visualization of the positions of transcriptomes in a system of diversity and specialization coordinates makes it possible to understand at a glance their interrelations, summarizing in a powerful way which transcriptomes are richer in diversity of expressed genes, or which are relatively more specialized. The framework presented enlightens the relation among transcriptomes, allowing a better understanding of their changes through the development of the organism or in response to environmental stimuli.biological complexity ͉ gene expression ͉ microarrays ͉ serial analysis of gene expression (SAGE) ͉ Shannon entropy

Diagnostic yield of targeted next generation sequencing in various cancer types: An information-theoretic approach

“…In the life sciences, Shannon entropy has been used to measure cellular diversity (12,13) and phylogenetic variation (14), and to model molecular interactions (15). This concept has previously been applied to singleanalyte laboratory testing by Rudolph (16)(17)(18) and, more recently, by Benish (19)(20)(21)(22)(23) and Vollmer (24).…”

A novel reannotation strategy for dissecting DNA methylation patterns of human long intergenic non-coding RNAs in cancers

“…RE insertion close to a lincRNA promoter or RE hypermethylation might interrupt the transcription factors or other regulatory elements binding to lincRNA promoters, which could contribute to lincRNAs tissue-specific expression. We quantified the tissue specificity of lincRNA expression in 16 normal tissues (SRA, E-MTAB-513) and six cell lines (GEO, GSE23316) using an information theory method (Supplementary file) (44). CM lincRNAs had significantly higher tissue-specific expression than RM lincRNAs, which was consistent with our hypothesis (Figure 3B).…”

Energetic loads and informational entropy during insect metamorphosis: Measuring structural variability and self-organization

“…Concepts from the information theory have been introduced as natural tools to quantify the uncertainty in ensemble predictions for several types of complex dynamical systems and information theory comprises potentials for application in genetics (Conrad and Liberman, 1982;Schmitt and Hertzel, 1997;Martinez and Reyes-Valdé s, 2008), physiology and neural science (Panzeri et al, 1999;Mazza et al, 2004;Yue et al, 2006;Lüdtke et al, 2008;Martinez and Reyes-Valdé s, 2008), evolution theory (Tonnelat, 1982;Brooks et al, 1989), ecology (Jørgensen and Marques, 2001;Fath et al, 2003) and as measure for the biological complexity (Dancoff and Quastler, 1953;Apter and Wolpert, 1965;Papentin, 1980;Schneider, 1991;Rojdestvenski and Cottam, 2000).…”