Classifier design given an uncertainty class of feature distributions via regularized maximum likelihood and the incorporation of biological pathway knowledge in steady-state phenotype classification

Abstract

Contemporary high-throughput technologies provide measurements of very large numbers of variables but often with very small sample sizes. This paper proposes an optimization-based paradigm for utilizing prior knowledge to design better performing classifiers when sample sizes are limited. We derive approximate expressions for the first and second moments of the true error rate of the proposed classifier under the assumption of two widely-used models for the uncertainty classes; ε-contamination and p-point classes. The applicability of the approximate expressions is discussed by defining the problem of finding optimal regularization parameters through minimizing the expected true error. Simulation results using the Zipf model show that the proposed paradigm yields improved classifiers that outperform traditional classifiers that use only training data. Our application of interest involves discrete gene regulatory networks possessing labeled steady-state distributions. Given prior operational knowledge of the process, our goal is to build a classifier that can accurately label future observations obtained in the steady state by utilizing both the available prior knowledge and the training data. We examine the proposed paradigm on networks containing NF-κB pathways, where it shows significant improvement in classifier performance over the classical data-only approach to classifier design. Companion website: http://gsp.tamu.edu/Publications/supplementary/shahrokh12a.

A Nonmathematical Review of Optimal Operator and Experimental Design for Uncertain Scientific Models with Application to Genomics

“…The more a prior is constrained by scientific knowledge, the more confident one can be that the prior distribution is concentrated around the correct model; however, as noted previously, one must be prudent, since concentrating the prior away from the true model can result in very poor results. With optimal Bayesian classification in the context of phenotype classification, knowledge concerning genetic signaling pathways has been integrated into prior construction [29, 30]. In [17, 18], a hierarchical Poisson prior is employed that models cellular mRNA concentrations using a log-normal distribution and then models the sequencing as sampling the RNA concentrations through a Poisson process.…”

Extraction Method of Offshore Mariculture Area under Weak Signal based on Multisource Feature Fusion

“…At present, the target recognition and classification methods of remote sensing images can be divided into traditional statistical methods [1][2][3][4][5][6][7][8], machine learning methods [9][10][11], and deep learning algorithms [12][13][14]. The traditional statistical methods realize the classification by using statistical analysis of the gray value and texture of image.…”

Optimal cancer prognosis under network uncertainty

“…While the authors demonstrate that some of the best methods for prognosis prediction incorporate molecular features selected by expert prior knowledge along with both molecular and clinical data, all methods used are based on data-driven machine learning rather than optimal prediction and error estimation and do not take full advantage of network structure to improve prediction. In [ 11 , 12 ], the authors present methods of constructing uncertainty classes of gene expression distributions in the OBC framework that are consistent with available pathway information to improve classification. However, the focus is on diagnosis rather than prognosis, and these works treat network uncertainty as stemming from ignorance.…”