No abstract

Intrigued by some recent results on impulse response estimation by kernel and nonparametric techniques, we revisit the old problem of transfer function estimation from input-output measurements. We formulate a classical regularization approach, focused on finite impulse response (FIR) models, and find that regularization is necessary to cope with the high variance problem. This basic, regularized least squares approach is then a focal point for interpreting other techniques, like Bayesian inference and Gaussian process regression. The main issue is how to determine a suitable regularization matrix (Bayesian prior or kernel). Several regularization matrices are provided and numerically evaluated on a data bank of test systems and data sets. Our findings based on the data bank are as follows: The classical regularization approach with carefully chosen regularization matrices shows slightly better accuracy and clearly better robustness in estimating the impulse response than the standard approach -the prediction error method/maximum likelihood (PEM/ML) approach. If the goal is to estimate a model of given order as well as possible, a low order model is often better estimated by the PEM/ML approach, and a higher order model is often better estimated by model reduction on a high order regularized FIR model estimated with careful regularization. Moreover, an optimal regularization matrix that minimizes the mean square error matrix is derived and studied. The importance of this result lies in that it gives the theoretical upper bound on the accuracy that can be achieved for this classical regularization approach.

Technical reports from the Automatic Control group in Linkping are available by anonymous ftp at the address 130.236.20.24 (ftp.control.isy.liu.se). This report is contained in the compressed postscript le 1959.ps.Z. Closed-loop Identi cation Revisited ?

Two noniterative subspace-based algorithms which identify linear, time-invariant MIMO (multi-inpuUmultioutput) systems from frequency response data are presented. The algorithms are related to the recent time-domain subspace identification techniques. The first algorithm uses equidistantly, in frequency, spaced data and is strongly consistent under weak noise assumptions. The second algorithm uses arbitrary frequency spacing and is strongly consistent under more restrictive noise assumptions. Promising results are obtained when the algorithms are applied to real frequency data originating from a large flexible structure.

Abstract:System identification is the art and science of building mathematical models of dynamic systems from observed input-output data. It can be seen as the interface between the real world of applications and the mathematical world of control theory and model abstractions. As such, it is an ubiquitous necessity for successful applications. System identification is a very large topic, with different techniques that depend on the character of the models to be estimated: linear, nonlinear, hybrid, nonparametric etc. At the same time, the area can be characterized by a small number of leading principles, e.g. to look for sustainable descriptions by proper decisions in the triangle of model complexity, information contents in the data, and effective validation. The area has many facets and there are many approaches and methods. A tutorial or a survey in a few pages is not quite possible. Instead, this presentation aims at giving an overview of the "science" side, i.e. basic principles and results and at pointing to open problem areas in the practical, "art", side of how to approach and solve a real problem.