Constrained Multi-Objective Optimization for Automated Machine Learning

Abstract

Automated machine learning has gained a lot of attention recently. Building and selecting the right machine learning models is often a multi-objective optimization problem. General purpose machine learning software that simultaneously supports multiple objectives and constraints is scant, though the potential benefits are great. In this work, we present a framework called Autotune that effectively handles multiple objectives and constraints that arise in machine learning problems. Autotune is built on a suite of derivative-free optimization methods, and utilizes multi-level parallelism in a distributed computing environment for automatically training, scoring, and selecting good models. Incorporation of multiple objectives and constraints in the model exploration and selection process provides the flexibility needed to satisfy trade-offs necessary in practical machine learning applications. Experimental results from standard multi-objective optimization benchmark problems show that Autotune is very efficient in capturing Pareto fronts. These benchmark results also show how adding constraints can guide the search to more promising regions of the solution space, ultimately producing more desirable Pareto fronts. Results from two real-world case studies demonstrate the effectiveness of the constrained multiobjective optimization capability offered by Autotune.

Beyond AutoML: Mindful and Actionable AI and AutoAI With Mind and Action

“…› Bounded automation: The automation of AutoML and AutoAI systems is bounded or constrained with boundaries, limitations, or constraints. 16 › Governed automation: The methodologies, design, implementation, operation, or exception handling, etc. of AutoML and AutoAI systems are governed and regulated by humans and authorities following governance specifications.…”

MultiETSC: automated machine learning for early time series classification

“…The authors show competitive performance compared to only Bayesian optimisation and the Spearmint package. Gardner et al (2019) extended the work on Autotune to address multi-objective optimisation. They reduced their hybrid search to only employ LHS, GA and Generating Set Search, a local search strategy.…”

Automated machine learning structure-composition-property relationships of perovskite materials for energy conversion and storage

“…In this paper, the structure-composition-property connections between stability and other features of perovskite compounds was investigated via a high-effective approach of extreme feature engineering and automated machine learning [19][20][21][22][23][24][25][26][27] . The feature engineering approach was used to remove redundant features while generating many fresh descriptors [28] .…”