The structure of choice.

Silberberg, Alan; Hamilton, B.; Ziriax, John M.; Casey, Jay

doi:10.1037/0097-7403.4.4.368

Cited by 84 publications

(89 citation statements)

References 25 publications

(69 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To see this, assume, as Silberberg et al (1978) have argued, that the bird either remembers where it is in the stable pattern and responds correctly, or forgets where it is and therefore "guesses." For example, when the stable pattern is RRL after pecking RR, the bird always pecks L if it remembers its position in the sequence; if the bird forgets, then it pecks L with probability Va.…”

Section: Molecular Analysismentioning

confidence: 99%

See 1 more Smart Citation

Polymorphic response patterns under frequency-dependent selection

Machado

1994

Animal Learning & Behavior

View full text Add to dashboard Cite

In a discrete-trials procedure, a frequency-dependent schedule shaped left-right choice proportion toward various equilibrium values between 0 and 1. At issue was (1) whether pigeons match when the overall reinforcement probabilities for two responses depend inversely on their recent frequency, and (2)how pigeons meet the schedule constraint in terms of local responding. That is, do they respond quasi-randomly (Bernoulli mode), or do they learn the stable pattern of the schedule (stable-pattern mode)? Molar choice behavior always tracked the equilibrium solution ofthe schedule, but the molecular response patterns varied substantially. Markov chains applied to the data revealed that responding was generally intermediate between the memoryless Bernoulli mode, and the perfect memory stable-pattern mode. The polymorphism of molecular patterns, despite molar regularities in behavior, suggests that (1) in order to engender the Bernoulli or stable-pattern modes, the reinforcement rule must strongly discourage competing response patterns (e.g., perseveration), and (2) under frequency-dependent schedules, molar matching is apparently not the outcome of momentary maximizing.Laboratory studies have shownthat frequency-dependent selection, the differential reinforcement of infrequent responses, sometimes engenders high degrees of behavioral variability. For example, when Page and Neuringer (1985) rewarded pigeons for generating sequences of eight left or right pecks that differed from the sequences generated on the last 50 trials, they obtained highly variable, random-like behavior. That is, the birds not only pecked each key equally often, but also showed few or no sequential dependencies between consecutive responses (see also Hest, Haaren, & Van De Poll, 1989;Morgan & Neuringer, 1990;Machado, 1989Machado, , 1992Morris, 1987Morris, , 1989Neuringer, 1991Neuringer, , 1992. However, frequencydependent selection may also engender stereotypical behavior. In a previous study (Machado, 1992), a frequencydependent schedule differentially reinforced the momentarily least likely of two responses-the more a pigeon preferred the right key, the less food it received from that key and the more food it received from the left key. Similar contingencies operated when preference shifted to the left; the probability of food for left (L) and right (R) pecks was equal only at indifference. Although the pigeons pecked each key on 50% of the trials, they did so by alternating rather than responding randomly.The preceding results illustrate two points. First, pigeons can track the overall probabilities of reinforcement for each of two responses when these probabilities I thank John Staddon and the other L.A.B. group members for their comments on earlier versions of the manuscript. The research was supported by grants to Duke University from NSF and NIMH (John Staddon, principal investigator). Correspondence concerning this article may be sent to A. Machado,

show abstract

Section: Molecular Analysismentioning

confidence: 99%

“…These results are in general agreement with sponding, and on how they relate to the Bernoulli and the findings reported in previous studies (e.g., Silberberg, stable-pattern modes. Hamilton, Ziriax, & Casey, 1978).…”

Section: Molecular Analysismentioning

confidence: 99%

Polymorphic response patterns under frequency-dependent selection

Machado

1994

Animal Learning & Behavior

View full text Add to dashboard Cite

show abstract

“…Subsequently, interest in this view revived. The simpler theoretical analysis described in the text has appeared and new experiments supporting momentary maximizing as a substantial component, at least, of operant choice have been published (Silberberg, Hamilton, Ziriax, & Casey 1978;Staddon l980b;Staddon, Hinson, & Kram, 1981;Hinson & Staddon, 1983) -although dissenting views are not lacking (e.g., Nevin, 1979a;de Villiers, 1977).…”

mentioning

confidence: 99%

Adaptive Behavior and Learning

Staddon

2016

View full text Add to dashboard Cite

Every day at about 4:30, Jazz, a Hungarian Vizsla dog, leaps up on the sofa and looks out for his owner who always comes home at 5:00. He doesn't need an internal clock because he has an acute sense of smell that allows him to measure how long his master has been absent. Explaining complex behavior in simple ways, this book is a fascinating exploration of the evolution, development and processes of learning in animals. Now in its second edition, there is increased emphasis on development, evolution and dynamics; new accounts of taxic orientation, reflex induction, habituation and operant learning in organisms; more discussion of spatial learning and the processes underlying it; expanded chapters on choice and completely new chapters on molar laws, classical conditioning theories and comparative cognition. J. E. R. Staddon provides a definitive summary of contemporary theoretical understanding suitable for graduates and advanced undergraduates.

show abstract

“…The molecular position anticipates an increase in this probability, whereas the molar position predicts that it should remain largely invariant. The molar expectation has consistently been supported (Heyman, 1979;Nevin, 1969;Silberberg, Hamilton, Ziriax, & Casey, 1978).…”

mentioning

confidence: 69%

Choice and the conditional probability of alternation: Some new data

Fetterman

Pliskoff

1981

Bull. Psychon. Soc.

View full text Add to dashboard Cite

Three pigeons were exposed to two independent concurrent variable-interval schedules of reinforcement, with a changeover key procedure. Relative reinforcement rate and the fixed-ratio changeover requirement were varied. The effects of these manipulations were assessed with respect to the conditional probability of alternation as a function of successive responses on the same schedule. Previous experiments employing this measure have found essentially unchanging probabilities of alternation. However, we found the probability of alternation to be an increasing function of successive choices of the same schedule, especially with the schedule providing the higher relative reinforcement rate. These findings were discussed with respect to the procedural variables we employed.

show abstract

The structure of choice.

Cited by 84 publications

References 25 publications

Polymorphic response patterns under frequency-dependent selection

Polymorphic response patterns under frequency-dependent selection

Adaptive Behavior and Learning

Choice and the conditional probability of alternation: Some new data

Contact Info

Product

Resources

About