Four experiments with rats examined partial reinforcement in appetitive conditioning. In Experiment 1, adding nonreinforced trials to a continuous reinforcement schedule slowed acquisition, whereas deleting reinforcers did not. Trial massing suppressed performance and learning. In Experiment 2, conditioning with a short conditioned stimulus (CS) was rapid, and partial reinforcement with a short CS was as effective as continuous reinforcement with equal accumulated time in the CS. In Experiment 3, conditioning was nevertheless influenced by the probability of reinforcement. In Experiments 3 and 4, conditioning was especially disrupted when nonreinforced trials preceded reinforced trials closely in time. The results underscore the importance of temporal variables in conditioning but are more consistent with trial-based accounts than time-accumulation accounts of conditioning.

No abstract

Four experiments with rats studied the effects of switching the context after Pavlovian conditioning. In three conditioned suppression experiments, a large number of conditioning trials created "inhibition with reinforcement" (IWR), in which fear of the conditional stimulus (CS) reached a maximum and then declined despite continued CS-unconditional stimulus pairings. When IWR occurred, a context switch augmented fear of the CS; IWR and augmentation were highly correlated. Neither IWR nor augmentation resulted from inhibition of delay (IOD): In conditioned suppression, IWR and augmentation occurred without IOD (Experiment 3), and in appetitive conditioning (Experiment 4), IOD occurred without IWR or augmentation. IWR may occur in conditioned suppression because the animal adapts to fear of the CS in a context-specific manner. The authors discuss several implications.

It is reasonably well established that extinction involves new learning rather than merely destruction of the old (e.g., Bouton, 2002Bouton, , 2004 Myers & Davis, 2002), and several chapters in this book further attest to this (chaps. 8, 10, 11, this volume). In the animal laboratory, after tone-shock pairings have caused the tone to evoke fear, repeated presentations of the tone alone can eliminate that fear. Although fear behavior goes away, the result does not imply that extinction has destroyed the original learning, which remains in the memory system and brain, ready to return to performance under the right conditions. The fact that the original performance can recover after extinction may be an important insight into understanding relapse after therapy (e.g.

Three experiments with rat subjects examined the effects of a context switch after conditioning treatments in which the conditioned stimulus (CS) was either paired with food on every presentation (continuous reinforcement) or on some of its presentations (partial reinforcement). In each experiment, a target CS was given one of these treatments in Context A, and another CS was given a treatment during sessions that were intermixed in Context B. Final tests of the target CS in Context A and Context B often revealed no loss of responding with the switch to B. However, a loss was observed when partial reinforcement had been associated with Context A and continuous reinforcement had been associated with Context B. Those conditions caused equal decrements in responding to partially reinforced and continuously reinforced targets. The results suggest that under the present conditions partial reinforcement can generate a contextual stimulus that becomes associated with the physical context and controls responding to the CS.

No abstract

Previous research in this laboratory suggests that priming of the conditional stimulus (CS) in short-term memory may play a role in the trial-spacing effects in appetitive conditioning. For example, a non-reinforced presentation of a CS 60 s before a reinforced trial with the same CS produced slower acquisition than a CS presentation that occurred 240 s before the reinforced trial. The results were consistent with the self-generated priming mechanism proposed by Wagner (e.g., Wagner 1978, 1981). The present experiments extended the earlier work by examining the effects of trial spacing in extinction rather than acquisition. After conditioning with a mixture of intertrial intervals (ITIs), rats received extinction with ITIs of 60 or 240 s, longer or shorter values, or different ways of "chunking" extinction trials in time. Although trial spacing produced effects on extinction performance that were consistent with our previous research on acquisition, there were few long-term differences in spontaneous recovery or in reinstatement. Short ITIs in extinction appear to affect extinction performance more than they affect extinction learning. Mechanisms of trial spacing in conditioning and extinction are discussed.

To assess the role of dopamine input to the nucleus accumbens core in anticipatory learning, fast-scan cyclic voltammetry was combined with appetitive Pavlovian conditioning. One group of rats (Paired) received 16 tone-food pairings for at least four daily sessions while the control group (Unpaired) received the same number of unpaired tone and food presentations. Both groups showed transient dopamine responses during food presentation throughout training, confirming dopamine involvement in reward processing. Only the Paired Group, however, showed consistently timed dopamine transients during the 10-s tone presentation. Transients first appeared near the end of the tone period as each animal acquired the tone-food association and then occurred progressively sooner on subsequent sessions. Later sessions also revealed a consistently timed dopamine response soon after food delivery in Paired animals. Collectively, these results implicate phasic dopamine release in the acquisition of Pavlovian learning and also suggest an early dopamine response to the unconditioned stimulus as training continues.