Theoretical limits on the speed of learning inverse models explain the rate of adaptation in arm reaching tasks

Abstract

An essential aspect of human motor learning is the formation of inverse models, which map desired actions to motor commands. Inverse models can be learned by adjusting parameters in neural circuits to minimize errors in the performance of motor tasks through gradient descent. However, the theory of gradient descent establishes an upper limit on the learning speed, above which learning becomes unstable. Specifically, the eigenvalues of the Hessian of the error surface around a minimum determine the maximum speed of learning in a given task. Here, we use this theoretical framework to analyze the speed of learning in different inverse model learning architectures in a set of isometric arm-reaching tasks. We show theoretically that, for these isometric tasks, the error surface and, thus the speed of learning, are determined by the shapes of 1) the force manipulability ellipsoid of the arm and 2) the distribution of targets in the task. In particular, rounder manipulability ellipsoids generate a rounder error surface, allowing for faster learning of the inverse model. Rounder target distributions have a similar effect. We tested these predictions experimentally in a virtual quasi-isometric reaching task with a visuomotor transformation. The experimental results were consistent with our theoretical predictions. Furthermore, our analysis accounts for the speed of learning in previous experiments with incompatible and compatible virtual surgery tasks, and in visuomotor rotation tasks with different numbers of targets. By identifying aspects of a task that influence the speed of learning, our results provide theoretical principles for the design of motor tasks that allow for faster learning.