Data-Efficient Autotuning With Bayesian Optimization: An Industrial Control Study

Abstract

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a user-defined cost. The probabilistic model is updated with data, which is obtained by testing a set of parameters on the physical system and evaluating the cost. In order to learn fast, the Bayesian optimization algorithm selects the next parameters to evaluate in a systematic way, for example, by maximizing information gain about the optimum. The algorithm thus iteratively finds the globally optimal parameters with only few experiments. Taking throttle valve control as a representative industrial control example, the proposed auto-tuning method is shown to outperform manual calibration: it consistently achieves better performance with a low number of experiments. The proposed auto-tuning framework is flexible and can handle different control structures and objectives.

Learning-Based Model Predictive Control: Toward Safe Learning in Control

“…While this scheme can be applied to most parameterized controllers (102,103), only a few techniques explicitly consider the parameterization of optimal control formulations. In the context of unconstrained optimal control, Marco et al (104) introduced a parametric cost function l(x, u, θ l ) = x T Q(θ l )x + u T R(θ l )u and optimized the parameters θ l in order to compensate for deviations of the true dynamics f t from linear prediction dynamics f, such that the performance metric in closed loop is improved.…”

Precision Motion Control of Robotized Industrial Hydraulic Excavators via Data-Driven Model Inversion

“…Some possible future research directions include: 1) generalization of the excavator plant model using the state-dependent delaying system; 2) incorporation of the expert-emulating planning [15]; 3) implementation of the over-the-air programming to effectively collect the measurements and update the control; 4) rigorous comparison with other control strategies (e.g., [17]); and 5) application of our framework to other systems with delays and dead-zones.…”

Closed-Loop Cognitive Stress Regulation Using Fuzzy Control in Wearable-Machine Interface Architectures

“…According to the state-space model (1) and nonlinear stochastic observations (2), similar to any control technique, global stability could not be guaranteed via our proposed control approach [70]. However, by following the recent approaches that handle the stability analysis for control of probabilistic models [71], we aim to calculate a stability region.…”