In multiple schedules of reinforcement, ratios of responses in successive components are relatively insensitive to ratios of obtained reinforcers. An analysis is proposed that attributes changes in absolute response rates to concurrent interactions between programmed reinforcement and extraneous reinforcement in other components. The analysis predicts that ratios of responses in successive components vary with reinforcer ratios, qualified by a term describing the reinforcement context, that is, programmed and extraneous reinforcers. Two main predictions from the analysis were confirmed in an experiment in which pigeons' responses were reinforced in the components of a multiple schedule and analog extraneous reinforcement was scheduled for an alternative response in each component. Sensitivity of response and time ratios to reinforcer ratios in the multiple schedules varied as a function of the rate of extraneous reinforcers. Bias towards responding in one component of the multiple schedule varied as an inverse function of the ratios of extraneous reinforcer rate in the two components. The data from this and previous studies of multiple-concurrent performance were accurately predicted by our analysis and supported our contention that the allocation of behavior in multiple-schedule components depends on the relative values of concurrently-available reinforcers within each component.
Two experiments asked whether resistance to change depended on variable-ratio as opposed to variable-interval contingencies of reinforcement and the different response rates they establish. In Experiment 1, pigeons were trained on multiple random-ratio random-interval schedules with equated reinforcer rates. Baseline response rates were disrupted by intercomponent food, extinction, and prefeeding. Resistance to change relative to baseline was greater in the interval component, and the difference was correlated with the extent to which baseline response rates were higher in the ratio component. In Experiment 2, pigeons were trained on multiple variable-ratio variable-interval schedules in one half of each session and on concurrent chains in the other half in which the terminal links corresponded to the multiple-schedule components. The schedules were varied over six conditions, including two with equated reinforcer rates. In concurrent chains, preference strongly overmatched the ratio of obtained reinforcer rates. In multiple schedules, relative resistance to response-independent food during intercomponent intervals, extinction, and intercomponent food plus extinction depended on the ratio of obtained reinforcer rates but was less sensitive than was preference. When reinforcer rates were similar, both preference and relative resistance were greater for the variable-interval schedule, and the differences were correlated with the extent to which baseline response rates were higher on the variable-ratio schedule, confirming the results of Experiment 1. These results demonstrate that resistance to change and preference depend in part on response rate as well as obtained reinforcer rate, and challenge the independence of resistance to change and preference with respect to response rate proposed by behavioral momentum theory.
Three experiments using multiple schedules of reinforcement explored the implications of resistanceto-change findings for the response-reinforcer relation described by the law of effect, using both steadystate responding and responding recorded in the first few sessions of conditions. In Experiment 1, when response-independent reinforcement was increased during a third component, response rate in Components 1 and 2 decreased. This response-rate reduction was proportionately greater in a component in which reinforcer magnitude was small (2-s access to wheat) than in the component in which it was large (6-s access to wheat). However, when reinforcer rates in the two components were varied together in Experiments 2 and 3, response-rate change was the same regardless of the magnitude of reinforcers used in the two components, so that sensitivity of response rates to reinforcer rates (Experiment 2) and of response-rate ratios to reinforcer-rate ratios (Experiment 3) was unaffected by the magnitude of the reinforcers. Therefore, the principles determining resistance to change, described by behavioral momentum theory, seem not to apply when the source of behavior change is the variation of reinforcement contingencies that maintain the behavior. The use of extinction as a manipulation to study resistance to change is questioned.Key words: resistance to change, quantitative law of effect, generalized matching law, sensitivity to reinforcement, behavioral momentum, multiple schedules, key peck, pigeons There are two main conceptions of response strength in schedule-control research, each deriving from a different style of experimental behavior analysis. One identifies response strength with the rate or probability of a response, and derives from research conducted in a tradition dominated by the law of effect. This type of work is characterized by studies in which the schedules maintaining responding are varied over conditions, and resulting changes in response rate are related to changes in the rate of the "strengthening" variable, reinforcement. Quantitative analysis indicates a hyperbolic relation between response rate and reinforcer rate, which is thought to depend on the availability of extraneous reinforcers obtained for behavior other than the target response (see e.g., de Villiers & Herrnstein, 1976;Herrnstein, 1970Herrnstein, , 1974. Thus, "strong" behavior is identified with a high response rate and is observed when high frequencies of reinforcement maintain the response. A feature of this research is that it analyzes steady-state behavior-that is, the level at which the re- sponse occurs after prolonged exposure to each schedule.A second area of study, and one enjoying a resurgence of interest, is research dealing with behavioral resistance to change. Resistance is measured using changes in the rate of a response following an alteration of the environmental context for that response; here, strong behavior is identified with high resistance. Early studies considered resistance to extinction. For example, Hear...
We report two experiments using a concurrent-chains procedure in which one terminal-link schedule was fixed-interval 8 s and the alternative schedule changed randomly from day to day. In Experiment 1, the alternative schedule varied between 4 s and 16 s according to a pseudorandom binary sequence similar to the one used by Hunter and Davison (1985). Similar to results with concurrent schedules, pigeons' response allocation in the initial link was most sensitive to the schedules arranged in the current session, although some effect of prior history was evident. Overall sensitivity was lower than for comparable data from steady-state research. In Experiment 2, a unique value between 2 s and 32 s was used for the alternative-schedule delay in each session. Sensitivity levels were similar to Experiment 1 and remained unchanged across 61 sessions of training. For all subjects, sensitivity was greater when the alternative-schedule delay was greater than 8 s compared with when it was less than 8 s. Generalized-matching plots revealed evidence of clustering of data points into two groups for some pigeons, suggesting that a process similar to a categorical discrimination may have at least partly determined response allocation. Overall, this research shows that pigeons' initial-link response allocation can adjust rapidly to frequent changes in the terminal links.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.