Timescale and Stability in Adaptive Behaviour

Abstract

Abstract. Recently, in both the neuroscience and adaptive behaviour communities, there has been growing interest in the interplay of multiple timescales within neural systems. In particular, the phenomenon of neuromodulation has received a great deal of interest within neuroscience and a growing amount of attention within adaptive behaviour research. This interest has been driven by hypotheses and evidence that have linked neuromodulatory chemicals to a wide range of important adaptive processes such as regulation, reconfiguration, and plasticity.Here, we first demonstrate that manipulating timescales can qualitatively alter the dynamics of a simple system of coupled model neurons. We go on to explore this effect in larger systems within the framework employed by Gardner, Ashby and May in their seminal studies of stability in complex networks. On the basis of linear stability analysis, we conclude that, despite evidence that timescale is important for stability, the presence of multiple timescales within a single system has, in general, no appreciable effect on the May-Wigner stability/connectance relationship. Finally we address some of the shortcomings of linear stability analysis and conclude that more sophisticated analytical approaches are required in order to explore the impact of multiple timescales on the temporally extended dynamics of adaptive systems.

On the interaction of adaptive timescales on networks

“…Artificial life has typically considered multiple adaptive timescales in the context of interactions between learning and evolution (Ackley and Littman, 1992;Belew and Mitchell, 1996), such as the Baldwin effect (Hinton and Nowlan, 1987). Further examples where the separation of timescales is critical to adaptive dynamics include the interaction between processes of neurotransmission and (much slower) neuromodulation (Buckley et al, 2004(Buckley et al, , 2005Buckley, 2008;Husbands et al, 2010), and the interaction between the evolution of individual behaviours and ecological relationships (e.g., Powers et al, in press;Watson et al, in press;Van Der Laan and Hogeweg, 1995).…”