Sparse learning of maximum likelihood model for optimization of complex loss function

Abstract

Traditional machine learning methods usually minimize a simple loss function to learn a predictive model and then use a complex performance measure to measure the prediction performance. However, minimizing a simple loss function cannot guarantee an optimal performance. In this paper, we study the problem of optimizing the complex performance measure directly to obtain a predictive model. We proposed to construct a maximum likelihood model for this problem, and to learn the model parameter, we minimize a complex loss function corresponding to the desired complex performance measure. To optimize the loss function, we approximate the upper bound of the complex loss. We also propose to impose the sparsity to the model parameter to obtain a sparse model. An objective was constructed by combining the upper bound of the loss function and the sparsity of the model parameter, and we develop an iterative algorithm to minimize it by using the fast iterative shrinkage-thresholding algorithm framework. The experiments on optimization on three different complex performance measures, including F-score, receiver operating characteristic curve, and recall precision curve break-even point, over three real-world applications, aircraft event recognition of civil aviation safety, intrusion detection in wireless mesh networks, and image classification, show the advantages of the proposed method over state-of-the-art methods.

Factors influencing charter flight departure delay

“…Flight operations translate into complex problems to solve, highlighted by a myriad of possible scenarios with many internal (e.g., traffic management) and external variables (e.g., weather). The studied problems include planning of flight routes [28], detecting flight trajectory anomalies [29], air traffic management [30], recognizing aircraft events such as landing [31], among others. Given the chained nature of air transportation business processes, most of those problems are interconnected, making it challenging to narrow the research focus in a specific problem.…”