Deep learning based animal pose estimation tools have greatly improved animal behaviour quantification. However, those tools all make predictions on individual video frames and do not account for variability of animal body shape in their model designs. Here, we introduce the first video-based animal pose estimation architecture, referred to as OptiFlex, which integrates a flexible base model to account for variability in animal body shape with an optical flow model to incorporate temporal context from nearby video frames. This approach can be combined with multi-view information, generating prediction enhancement using all four dimensions (3D space and time). To evaluate OptiFlex, we adopted datasets of four different lab animal species (mouse, fruit fly, zebrafish, and monkey) and proposed a more intuitive evaluation metric -percentage of correct key points (aPCK). Our evaluations show that OptiFlex provides the best prediction accuracy amongst current deep learning based tools, and that it can be readily applied to analyse a wide range of behaviours.

Animal pose estimation tools based on deep learning have greatly improved animal behaviour quantification. These tools perform pose estimation on individual video frames, but do not account for variability of animal body shape in their prediction and evaluation. Here, we introduce a novel multi-frame animal pose estimation framework, referred to as OptiFlex. This framework integrates a flexible base model (i.e., FlexibleBaseline), which accounts for variability in animal body shape, with an OpticalFlow model that incorporates temporal context from nearby video frames. Pose estimation can be optimised using multi-view information to leverage all four dimensions (3D space and time). We evaluate FlexibleBaseline using datasets of four different lab animal species (mouse, fruit fly, zebrafish, and monkey) and introduce an intuitive evaluation metric—adjusted percentage of correct key points (aPCK). Our analyses show that OptiFlex provides prediction accuracy that outperforms current deep learning based tools, highlighting its potential for studying a wide range of behaviours across different animal species.

Conscious control of actions helps us to reach our goals by suppressing responses to distracting external stimuli. The cerebellum has been suggested to complement cerebral control of inhibition of targeted movements (conscious control), though by what means, remains unclear. By measuring Purkinje cell (PC) responses during antisaccades, we show that the cerebellum not only plays a role in the execution of eye movements, but also in during the volitional inhibition thereof. We found that simple spike (SS) modulation during instruction and execution of prosaccades and antisaccades was prominent in PCs of both medial and lateral cerebellum, showing distinct, time- ordered sequences, but each with different sensitivities for execution and trial-history. SS activity in both regions modulated bidirectionally, with both facilitation (increasing SS firing) and suppression (decreasing SS firing) PCs showing firing-rate changes associated with instruction and execution, respectively. These findings show that different cerebellar regions can contribute to behavioral control and inhibition, but with different propensities, enriching the cerebellar machinery in executive control.

No abstract

Saccadic eye movements enable fast and precise scanning of the visual field, which is partially controlled by the posterior cerebellar vermis. Textbook saccades have a straight trajectory and a unimodal velocity profile, and hence have well-defined epochs of start and end. However, in practice only a fraction of saccades matches this description. One way in which a saccade can deviate from its trajectory is the presence of an overshoot or undershoot at the end of a saccadic eye movement just before fixation. This additional movement, known as a glissade, is regarded as a motor command error and was characterized decades ago but was almost never studied. Using rhesus macaques, we investigated the properties of glissades and changes to glissade kinematics following cerebellar lesions. Additionally, in monkeys with an intact cerebellum, we investigated whether the glissade amplitude can be modulated using multiple adaptation paradigms. Our results show that saccade kinematics are altered by the presence of a glissade, and that glissades do not appear to have any adaptive function as they do not bring the eye closer to the target. Quantification of these results establishes a detailed description of glissades. Further, we show that lesions to the posterior cerebellum have a deleterious effect on both saccade and glissade properties, which recovers over time. Finally, the saccadic adaptation experiments reveal that glissades cannot be modulated by this training paradigm. Together our work offers a functional study of glissades and provides new insight into the cerebellar involvement in this type of motor error.

Volitional suppression of responses to distracting external stimuli enables us to achieve our goals. This volitional inhibition of a specific behavior is supposed to be mainly mediated by the cerebral cortex. However, recent evidence supports the involvement of the cerebellum in this process. It is currently not known whether different parts of the cerebellar cortex play differential or synergistic roles in the planning and execution of this behavior. Here, we measured Purkinje cell (PC) responses in the medial and lateral cerebellum in two rhesus macaques during pro- and anti-saccade tasks. During an antisaccade trial, non-human primates (NHPs) were instructed to make a saccadic eye movement away from a target, rather than toward it, as in prosaccade trials. Our data show that the cerebellum plays an important role not only during the execution of the saccades but also during the volitional inhibition of eye movements toward the target. Simple spike (SS) modulation during the instruction and execution periods of pro- and anti-saccades was prominent in PCs of both the medial and lateral cerebellum. However, only the SS activity in the lateral cerebellar cortex contained information about stimulus identity and showed a strong reciprocal interaction with complex spikes (CSs). Moreover, the SS activity of different PC groups modulated bidirectionally in both of regions, but the PCs that showed facilitating and suppressive activity were predominantly associated with instruction and execution, respectively. These findings show that different cerebellar regions and PC groups contribute to goal-directed behavior and volitional inhibition, but with different propensities, highlighting the rich repertoire of the cerebellar control in executive functions.

No abstract