Progress in science requires standardized assays whose results can be readily shared, compared, and reproduced across laboratories. Reproducibility, however, has been a concern in neuroscience, particularly for measurements of mouse behavior. Here, we show that a standardized task to probe decision-making in mice produces reproducible results across multiple laboratories. We adopted a task for head-fixed mice that assays perceptual and value-based decision making, and we standardized training protocol and experimental hardware, software, and procedures. We trained 140 mice across seven laboratories in three countries, and we collected 5 million mouse choices into a publicly available database. Learning speed was variable across mice and laboratories, but once training was complete there were no significant differences in behavior across laboratories. Mice in different laboratories adopted similar reliance on visual stimuli, on past successes and failures, and on estimates of stimulus prior probability to guide their choices. These results reveal that a complex mouse behavior can be reproduced across multiple laboratories. They establish a standard for reproducible rodent behavior, and provide an unprecedented dataset and open-access tools to study decision-making in mice. More generally, they indicate a path toward achieving reproducibility in neuroscience through collaborative open-science approaches.

A highly versatile Electrical Impedance Tomography (EIT) system, nicknamed the ScouseTom, has been developed. The system allows control over current amplitude, frequency, number of electrodes, injection protocol and data processing. Current is injected using a Keithley 6221 current source, and voltages are recorded with a 24-bit EEG system with minimum bandwidth of 3.2 kHz. Custom PCBs interface with a PC to control the measurement process, electrode addressing and triggering of external stimuli. The performance of the system was characterised using resistor phantoms to represent human scalp recordings, with an SNR of 77.5 dB, stable across a four hour recording and 20 Hz to 20 kHz. In studies of both haeomorrhage using scalp electrodes, and evoked activity using epicortical electrode mats in rats, it was possible to reconstruct images matching established literature at known areas of onset. Data collected using scalp electrode in humans matched known tissue impedance spectra and was stable over frequency. The experimental procedure is software controlled and is readily adaptable to new paradigms. Where possible, commercial or open-source components were used, to minimise the complexity in reproduction. The hardware designs and software for the system have been released under an open source licence, encouraging contributions and allowing for rapid replication.

Progress in neuroscience is hindered by poor reproducibility of mouse behavior. Here we show that in a visual decision making task, reproducibility can be achieved by automating the training protocol and by standardizing experimental hardware, software, and procedures. We trained 101 mice in this task across seven laboratories at six different research institutions in three countries, and obtained 3 million mouse choices. In trained mice, variability in behavior between labs was indistinguishable from variability within labs. Psychometric curves showed no significant differences in visual threshold, bias, or lapse rates across labs. Moreover, mice across laboratories adopted similar strategies when stimulus location had asymmetrical probability that changed over time. We provide detailed instructions and open-source tools to set up and implement our method in other laboratories. These results establish a new standard for reproducibility of rodent behavior and provide accessible tools for the study of decision making in mice.