Maximization theory in behavioral psychology

Rachlin, Howard; Battalio, Ray; Kagel, John H.; Green, Leonard

doi:10.1017/s0140525x00009407

Cited by 583 publications

(251 citation statements)

References 109 publications

Supporting

Mentioning

240

Contrasting

Unclassified

Order By: Relevance

“…Rachlin et al (1981) successfully applied to the findings obtained by Herrnstein and Heyman (1979). Here x1, x2, and y are positive constants, E represents total reinforcement time, and L represents total leisure.…”

Section: Discussionmentioning

confidence: 95%

“…These studies have produced evidence in favor of the melioration hypothesis and against reinforcement maximization. It (Green, Kagel, & Battalio, 1982;Rachlin, Battalio, Kagel, & Green, 1981). Such an optimization analysis applies well to the findings of Herrnstein and Heyman (1979), who studied performance in concurrent variable-interval (VI) variable-ratio (VR) schedules.…”

mentioning

confidence: 81%

See 1 more Smart Citation

Melioration and Maximization of Reinforcement Minus Costs of Behavior

Boelens

1984

J Exper Analysis Behavior

View full text Add to dashboard Cite

Eight pigeons were exposed to independent concurrent schedules. Concurrent variableinterval 60-second variable-interval 60-second schedules were presented to one group of four subjects. Following baseline training, a limited hold was added to one of the schedules and the duration of the hold was decreased in successive conditions. Concurrent variableinterval 120-second variable-interval 40-second schedules were presented to another group of four subjects. These subjects were first exposed to decreasing durations of a limited hold in the variable-interval 40-second component. After replication of the baseline, a limited hold in the variable-interval 120-second component was decreased in duration. The initial durations of the holds were determined from the subjects' responding in the baseline conditions. A duration was chosen such that approximately 25% of the scheduled reinforcers would be canceled if responding remained unchanged.Approximate matching of time proportions and reinforcement proportions was observed when the limited hold was added to the variable-interval 60-second schedule and when the limited hold was added to the variable-interval 40-second schedule. Time proportions were less extreme than reinforcement proportions when the limited hold operated in a variableinterval 120-second schedule. Overall reinforcement rates tended to decrease with continued training in concurrent schedules with a limited hold. Absolute deviations from time matching also decreased. The results provide evidence against the principle of reinforcement maximization, and support Herrnstein and Vaughan's (1980) melioration hypothesis.

show abstract

Section: Discussionmentioning

confidence: 95%

mentioning

confidence: 81%

Melioration and Maximization of Reinforcement Minus Costs of Behavior

Boelens

1984

J Exper Analysis Behavior

View full text Add to dashboard Cite

show abstract

“…Requests for reprints should be addressed to Leonard Green, Department of Psychology, Washington University, St. Louis, MO 63130. (see Baum, 1979;de Villiers, 1977;Myers & Myers, 1977;Weardon & Burgess, 1982). The matching law has been extended to situations in which qualitatively different reinforcers are delivered from the two alternatives (Hollard & Davison, 1971;Miller, 1976), although an , 'economic, " or behavioral maximization, interpretation has also been proposed (Elsmore, Fletcher, Conrad, & Sodetz, 1980;Hursh & Natelson, 1981;Rachlin, Battalio, Kagel, & Green, 1981). In almost all of the research on matching, however, the responses required to produce reinforcement have been topographically the same on the alternatives (e.g., pecking one of two keys or pressing one of two levers).…”

mentioning

confidence: 99%

Time and response matching with topographically different responses

Hanson

Green

1986

Animal Learning & Behavior

Self Cite

View full text Add to dashboard Cite

Four pigeons were exposed to several nonindependent concurrent variable-interval schedules of reinforcement. One schedule component required a keypecking response; the other component required a treadlepressing response. The birds matched the ratio of their behavior (as measured by responses and time) between the two topographically different responses to the ratio of reinforcement in those two components. When additional foods not contingent on a keypeck or treadlepress were then added, the birds matched time spent in the components to total rates of food delivered in those components; response matching was somewhat disrupted. The matching law, developed under concurrent variable-interval schedules requiring similar responses, can thus account for choice behavior involving topographically different responses.How organisms distribute their behavior among response alternatives is of considerable interest to psychologists, economists, and behavioral biologists. One of the more successful formulations of such choice behavior is the matching law (Herrnstein, 1961(Herrnstein, , 1970, which states that the ratio of responses, or the ratio of time, to two alternatives matches the ratio of the reinforcements obtained in those alternatives. That is, (1) where B1 and B2 are responses to or time on alternatives 1 and 2, respectively, and r, and r, are the reinforcements obtained from those alternatives.In his generalization of the matching equation, Baum (1974) noted that the logarithm of the ratio of behavior is a linear function of the logarithm of the ratio of reinforcement obtained:where a is the slope of the line and 10gb is the y intercept. When a subject matches, both a and b take on values of 1.0, and Equation 2 reduces to Equation 1. Undermatchingis represented by a slope less thanunity (a < 1); the subject overvalues the leaner schedule of reinforcement. Overmatching is represented by a slope greater than unity (a > 1); the subject overvalues the richer schedule of reinforcement. Bias, a systematic preference for one of the two alternatives, is represented in deviations of b from a value of one, seen as deviations in the y intercept from zero.Response and time matching have generally been supported by the results from studies of choice in which a variety of reinforcement schedules have been employedWe gratefully acknowledge the many contributions of the members of the Psychonomy Cabal in the running of these experiments. Requests for reprints should be addressed to

show abstract

“…driven substantially by consequences (Hamm & Shettleworth, 1987, Herrnstein, 1997Rachlin, Battalio, Kagel, & Green, 1981;Rachlin, Logue, Gibbon, & Frankel, 1986). In the risk and decision-making literature, this tenet is supported by data from nonhuman studies.…”

mentioning

confidence: 94%

Risk Aversion in Human Subjects under Conditions of Probabilistic Reward

Lane

Cherek

2000

Psychol Rec

View full text Add to dashboard Cite

This study examined the role of contingencies and experimental context in human decision making. Twelve subjects participated across a series of conditions that provided response alternatives of a small, high-probability reinforcer (non-risky alternative) or a larger, low-probability reinforcer (risky alternative). A range of reinforcer amounts and probabilities were used in a discrete trial design with repeated trials across multiple sessions. The conditions of this study more closely modeled studies with nonhumans responding for food than studies with humans making decisions about hypothetical monetary amounts. Consistent with previous data, subjl ects displayed a strong preference for the nonrisky response alternative, even when doing so resulted in lost earnings. The data support models of decision and risk that emphasize the subjective (rather than mathematically expected) value of reinforcers, and the data highlight the important role of reinforcement contingencies and context in risk-taking behavior.Risk is inherent in any choice involving probabilistic outcomes. In contexts with two or more response alternatives, both the probability and size of each alternative presumably influence decisions. Of particular interest, in areas ranging from psychology and behavioral ecology to economics and mathematics, is the manner in which organisms respond to risky alternatives

show abstract

Maximization theory in behavioral psychology

Cited by 583 publications

References 109 publications

Melioration and Maximization of Reinforcement Minus Costs of Behavior

Melioration and Maximization of Reinforcement Minus Costs of Behavior

Time and response matching with topographically different responses

Risk Aversion in Human Subjects under Conditions of Probabilistic Reward

Contact Info

Product

Resources

About