Operant Conditioning

Staddon, J. E. R.; Cerutti, Daniel T.

doi:10.1146/annurev.psych.54.101601.145124

Cited by 336 publications

(231 citation statements)

References 124 publications

Supporting

Mentioning

213

Contrasting

Order By: Relevance

“…Experiments have shown that the contingency makes surprising little difference to performance (see Catania, Yohalem &Silverman, 1980, andreview in Staddon &Cerutti, 2003). Providing the response contingency for food in the terminal link is maintained, it can be omitted in earlier links with little effect on key pecking, as long as stimulus changes continue to take place as before (i.e., the fixed-interval contingency is replaced with a fixed-time contingency -this is termed a fixedinterval clock, because the successive stimulus changes signal the lapse of postfood time).…”

Section: Conditioned Reinforcementmentioning

confidence: 99%

See 1 more Smart Citation

Adaptive Behavior and Learning

Staddon

2016

Self Cite

View full text Add to dashboard Cite

Every day at about 4:30, Jazz, a Hungarian Vizsla dog, leaps up on the sofa and looks out for his owner who always comes home at 5:00. He doesn't need an internal clock because he has an acute sense of smell that allows him to measure how long his master has been absent. Explaining complex behavior in simple ways, this book is a fascinating exploration of the evolution, development and processes of learning in animals. Now in its second edition, there is increased emphasis on development, evolution and dynamics; new accounts of taxic orientation, reflex induction, habituation and operant learning in organisms; more discussion of spatial learning and the processes underlying it; expanded chapters on choice and completely new chapters on molar laws, classical conditioning theories and comparative cognition. J. E. R. Staddon provides a definitive summary of contemporary theoretical understanding suitable for graduates and advanced undergraduates.

show abstract

Section: Conditioned Reinforcementmentioning

confidence: 99%

“…There are several papers deriving matching from various maximizing principles, e.g., Rachlin (1978) and Staddon and Motheral (1978), although these have not gone unchallenged (Herrnstein & Heyman 1979;Heyman, 1979;Staddon & Motheral, 1979). Reviews are Williams (1988) and Staddon & Cerutti (2003).…”

mentioning

confidence: 99%

Adaptive Behavior and Learning

Staddon

2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…In the study reported here, we selected and studied neurobehavioral functions using the so-called schedule-controlled operant behavior (SCOB) procedure. This procedure has been widely used in the fields of behavioral pharmacology and toxicology because it is highly sensitive in detecting a subtle alterations (see reviews in [15][16][17][18]). …”

Section: Introductionmentioning

confidence: 99%

Learning behavior in rat offspring after in utero and lactational exposure to either TCDD or PCB126

Hojo

Kakeyama

Kurokawa

et al. 2008

Environ Health Prev Med

View full text Add to dashboard Cite

Objectives We studied and compared the possible effects of in utero and lactational exposure to 2, 3, 7, 8-tetrachlorodibenzo-p-dioxin (TCDD) or 3, 3 0 , 4, 4 0 , 5-pentachlorobiphenyl (PCB126) on learning behavior in offspring. MethodsPregnant Long-Evans Hooded rats were administered either TCDD (50, 200, or 800 ng/kg) or PCB126 (500, 2,000 or 8,000 ng/kg) on gestational day 15. A procedure of schedule-controlled operant behavior was applied to examine learning behavior in the male and female offspring at 11 weeks of age for 30 days. Three indices, namely, response rates in a fixed ratio (FR) and in a differential reinforcement of low rates (DRL), and reward rate in the DRL component in multiple FR 20 DRL 20 s (mult-FR 20 DRL 20-s) test sessions, were used for the evaluation of learning behavior. Results Toxic effects on learning behavior in male and female pups following in utero and lactational exposure to TCDD or PCB126 were observed mainly in the FR learning component. However, no linear dose-dependent effects of either of the two compounds were observed for the above three indices. The response rates of animals in the low-dose TCDD and PCB126 groups decreased and those in medium-dose TCDD and PCB126 groups appeared to induce hyperactive behavior. The high dose of PCB126 appeared to have a distinct toxicity from that of TCDD in terms of the acquisition of learning behavior. Conclusions Toxicities of PCB126 and TCDD in learning behavior might be similar to each other and the current toxic equivalency factor (TEF) of 0.1 for PCB126 can be considered to be appropriate for this endpoint.

show abstract

“…When events that function as reinforcers for certain organisms under certain conditions are identified, for example, food for a deprived rat, empirical and practical investigations can be conducted. The study of reinforcement schedules is a good example of empirical research ensuing from such conceptualizations and represents one of the novelties in Skinner's proposal (Staddon & Cerutti, 2003). Reinforcement schedules are arrangements of reinforcement based on certain rules, such as time intervals (e.g., for each response after each period of 30 s since the previous reinforcement) or response requirements (e.g., for each 10th response), which can be varied and combined to form a wide range of complex schedules (Ferster & Skinner, 1957).…”

mentioning

confidence: 99%

“…The other pattern is a constant-responding pattern, in which responding resumes after the postreinforcement pause and occurs with a constant rate until the end of the interval. Considering that the pause may also be influenced by other factors, such as degree of food deprivation, which may decrease after reinforcement, special procedures have been developed to investigate interval timing more accurately (Staddon & Cerutti, 2003). That postreinforcement pauses are also observed in ratio schedules, where reinforcement is dependent on the emission of a given fixed or variable number of responses, suggests that factors other than timing are involved in the production of postreinforcement pauses.…”

mentioning

confidence: 99%

Postreinforcement Pause in Grocery Shopping: Comparing Interpurchase Times Across Products and Consumers

2007

View full text Add to dashboard Cite

Purchase probability as a function of interpurchase time was examined through comparison of findings from laboratory experiments on reinforcement schedules and from marketing investigations of consumers' interpurchase time. Panel data, based on a sample of 80 consumers who purchased nine supermarket food products during 16 weeks, were used. For each product category, interpurchase time was similar for each shopping occasion and cumulative purchase probability increased as a Gamma function of the time since the last purchase. A comparison of interpurchase times across products and consumers showed that average interpurchase time differed across four subsets of products and across seven groups of consumers, with a significant interaction effect. Interpurchase times tended to be longer after larger purchases, as would be predicted from laboratory results. A correlation between individual interpurchase time and number of products bought on each shopping occasion indicated that consumers who shop more frequently buy larger numbers of products per occasion. These results have several managerial implications and demonstrate the usefulness of a behavior-analytic framework in the interpretation of consumer behavior.The concept of reinforcement is central to operant theory. When interpreted as an operation rather than a process, it has been usually defined as the delivery of a reinforcer when a response occurs (Catania, 1998;Skinner, 1953). A reinforcer, in turn, is commonly defined as any event that when produced by a response increases its likelihood under similar conditions. So, by definition, reinforcement of a response increases the probability of the response occurring under similar circumstances. When events that function as reinforcers for certain organisms under certain conditions are identified, for example, food for J. M. Oliveira-Castro thanks the Brazilian institutions CAPES (Ministry of Education),

show abstract

Operant Conditioning

Cited by 336 publications

References 124 publications

Adaptive Behavior and Learning

Adaptive Behavior and Learning

Learning behavior in rat offspring after in utero and lactational exposure to either TCDD or PCB126

Postreinforcement Pause in Grocery Shopping: Comparing Interpurchase Times Across Products and Consumers

Contact Info

Product

Resources

About