Time elapsed between choices in a probabilistic task correlates with repeating the same decision

Abstract

Reinforcement learning causes an action that yields a positive outcome more likely to be taken in the future. Here, we investigate how the time elapsed from an action affects subsequent decisions. Groups of C57BL6/J mice were housed in IntelliCages with access to water and chow ad libitum; they also had access to bottles with a reward: saccharin solution, alcohol, or a mixture of the two. The probability of receiving a reward in two of the cage corners changed between 0.9 and 0.3 every 48 hr over a period of ~33 days. As expected, in most animals, the odds of repeating a corner choice were increased if that choice was previously rewarded. Interestingly, the time elapsed from the previous choice also influenced the probability of repeating the choice, and this effect was independent of previous outcome. Behavioral data were fitted to a series of reinforcement learning models. Best fits were achieved when the reward prediction update was coupled with separate learning rates from positive and negative outcomes and additionally a “fictitious” update of the expected value of the nonselected choice. Additional inclusion of a time‐dependent decay of the expected values improved the fit marginally in some cases.

Non-motor symptoms associated with progressive loss of dopaminergic neurons in a mouse model of Parkinson’s disease

“…The probabilistic reversal learning task was performed as described previously ( Jabłońska et al, 2021 ). Briefly, female TIF-IA DATCreERT2 mice were implanted subcutaneously with PICO UNO radio-frequency identification (RFID) transponders 4 weeks after mutation induction and placed in groups of 11 in two automated IntelliCage systems (TSE Systems, Germany).…”

Nonmotor symptoms associated with progressive loss of dopaminergic neurons in a mouse model of Parkinson’s disease

“…The probabilistic reversal learning task was performed as described previously 48 . Briefly, female TIF-IA DATCreERT2 mice were implanted subcutaneously with PICO UNO radio-frequency identification (RFID) transponders 4 weeks after mutation induction and placed in groups of 11 in two automated IntelliCage systems (TSE Systems, Germany).…”