Predicting Chaotic Time Series Using Neural and Neurofuzzy Models: A Comparative Study

Abstract

The prediction accuracy and generalization ability of neural/neurofuzzy models for chaotic time series prediction highly depends on employed network model as well as learning algorithm. In this study, several neural and neurofuzzy models with different learning algorithms are examined for prediction of several benchmark chaotic systems and time series. The prediction performance of locally linear neurofuzzy models with recently developed Locally Linear Model Tree (LoLiMoT) learning algorithm is compared with that of Radial Basis Function (RBF) neural network with Orthogonal Least Squares (OLS) learning algorithm, MultiLayer Perceptron neural network with error back-propagation learning algorithm, and Adaptive Network based Fuzzy Inference System. Particularly, cross validation techniques based on the evaluation of error indices on multiple validation sets is utilized to optimize the number of neurons and to prevent over fitting in the incremental learning algorithms. To make a fair comparison between neural and neurofuzzy models, they are compared at their best structure based on their prediction accuracy, generalization, and computational complexity. The experiments are basically designed to analyze the generalization capability and accuracy of the learning techniques when dealing with limited number of training samples from deterministic chaotic time series, but the effect of noise on the performance of the techniques is also considered. Various chaotic systems and time series including Lorenz system, Mackey-Glass chaotic equation, Henon map, AE geomagnetic activity index, and sunspot numbers are examined as case studies. The obtained results indicate the superior performance of incremental learning algorithms and their respective networks, such as, OLS for RBF network and LoLiMoT for locally linear neurofuzzy model.

A New Approach for Time Series Forecasting: Bayesian Enhanced by Fractional Brownian Motion with Application to Rainfall Series

“…Lorenz found three ordinary differential equations which closely approximate a model for thermal convection [26]. These equations have also become a popular benchmark for testing non-linear predictors.…”

Modeling the thermal behavior of fluid flow inside channels using an artificial locally linear neuro-fuzzy approach

“…In this way, there are some individual studies especially on prediction of space weather indices [10] based on pipelined recurrent neural network [11,12,13] based on locally linear neuron-fuzzy model [14] based on new learning approach to Takagi Sugeno neurofuzzy models [15] based on a new spectral approach to analysis of data. The success of the intellectual methods based on brain learning in purposeful modeling of nonlinearities of different patterns motivated us to use the same approach to construct an advanced architecture for modeling nonlinear behavior of temperature of a fluid flowing in a channel with a particular geometry.…”

Local Prediction of Chaotic Time Series Based on Polynomial Coefficient Autoregressive Model

“…By using those combining techniques, the parameters can be obtained faster and the analysis of residual can be underestimated if residuals are not randomness. Such as SVM combined with neurofuzzy model [21], SVM combined with PCA [26], ARMA combined with RESN [8], and neural network combined with neurofuzzy model [34]. Those methods can obtain generally better results than those obtained with single model, but they are complex, affected by personal experience and easy to be overfitted.…”