Generalized redundancies for time series analysis

Abstract

Extensions to various information theoretic quantities used for nonlinear time series analysis are discussed, as well as their relationship to the generalized correlation integral. It is shown that calculating redundancies from the correlation integral can be more accurate and more efficient than direct box counting methods. It is also demonstrated that many commonly used nonlinear statistics have information theory based analogues. Furthermore, the relationship between the correlation integral and information theoretic statistics allows us to define ``local'' versions of many information theory based statistics; including a local version of the Kolmogorov-Sinai entropy, which gives an estimate of the local predictability.Comment: 19 pages uuencoded compressed postscript file (using uufiles script

Inferences about information flow and dispersal for spatially extended population systems using time-series data

“…In the present work, inferences are based on an information-theoretic approach in which dynamic systems are viewed as generators of information (e.g. Prichard & Theiler 1995). The use of information theory in ecology is not new and ranges from species diversity metrics and inferences about diversitystability relationships (e.g.…”

“…Following the work of Liebert & Schuster (1989) and Prichard & Theiler (1995), the relevant quantities required by equation (2.1) can be given by…”

Deterministic Prediction of the Entropy Increase in a Sudden Expansion

“…Note that this forcing function is internal to the set of six equations describing the overall flow, but represent an externally applied forcing function for the three equations describing the equations of motion. It is interesting to note that Prichard and Theiler [30], in a study of the behavior of the Rössler attractor, observed that the local entropy is apparently large when the particular parameter is large. We, however, find that the spectral entropy is dependent on the degree of order within the flow element, with lower values of the spectral entropy representing a higher degree of order within the element.…”

“…Note that these values of the spectral entropy occur when the fluctuating axial velocity is in the negative range and produces the most vigorous part of the aperiodic motion. Prichard and Theiler [30] indicate that the most energetic of the fluctuating components of velocity will contribute to the spectral entropy through this region and that they will be subjected to the folding and stretching of the flow elements as they lose information to spectral entropy. This region is thus a region of "dissolution" where the incoming low spectral entropy flow is transformed into a high spectral entropy region.…”

Network Decomposition and Complexity Measures: An Information Geometrical Approach

“…One of the most classical statistical complexities is the mutual information between two stochastic variables, and its generalized form to measure dependence between n variables is proposed (e.g., [13]) and explored in relevance to statistical models and theories by several authors [14][15][16].…”