Enhanced particle swarm optimisation algorithms for multiple-input multiple-output system modelling using convolved Gaussian process models

Abstract

Convolved Gaussian Process (CGP) is able to capture the correlations not only between inputs and outputs but also among the outputs. This allows a superior performance of using CGP than standard Gaussian Process (GP) in the modelling of Multiple-Input Multiple-Output (MIMO) systems when observations are missing for some of outputs. Similar to standard GP, a key issue of CGP is the learning of hyperparameters from a set of input-output observations. It typically performed by maximizing the Log-Likelihood (LL) function which leads to an unconstrained nonlinear and non-convex optimization problem. Algorithms such as Conjugate Gradient (CG) or Broyden-Fletcher-Goldfarb-Shanno (BFGS) are commonly used but they often get stuck in local optima, especially for CGP where there are more hyperparameters. In addition, the LL value is not a reliable indicator for judging the quality intermediate models in the optimization process. In this paper, we propose to use enhanced Particle Swarm Optimization (PSO) algorithms to solve this problem by minimizing the model output error instead. This optimization criterion enables the quality of intermediate solutions to be directly observable during the optimization process. Two enhancements to the standard PSO algorithm which make use of gradient information and the multistart technique are proposed. Simulation results on the modelling of both linear and nonlinear systems demonstrate the effectiveness of minimizing the model output error to learn hyperparameters and the performance of using enhanced algorithms.

Artificial Intelligence of Things-Based Optimal Finite-Time Terminal Attractor and Its Application to Maximum Power Point Tracking of Photovoltaic Arrays in Smart Cities

“…The proposed algorithm converges fast as well as the searching of the gradient at the global best position. Because there is a constant or minor variation in its fitness value depending on a prescribed iteration number, the computational burden of the proposed algorithm diminishes [46][47][48]. It is important to note that the voltage, current, and power of the PV array vary with the strength of daylight as well as climate, which impacts both the power output and energy efficiency of the system.…”