Impulsive choice refers to the selection of small immediate gains in preference to larger delayed gains, or the selection of large delayed penalties in preference to smaller immediate penalties. Current theoretical interpretations of impulsive choice are reviewed, and a synthesis of these ideas, the "multiplicative hyperbolic model of choice", is presented. The model assumes that the value of a positive reinforcer increases as a hyperbolic function of its size, and decreases as a hyperbolic function of its delay and the odds against its occurrence. Each hyperbolic function contains a single discounting parameter which quantifies the organism's sensitivity to the variable in question. The hyperbolic discounting functions combine multiplicatively to determine the overall value of the reinforcer. Equivalent functions are postulated to govern the (negative) value of aversive events, the net value of an outcome reflecting the algebraic sum of the positive and negative values. The model gives rise to a quantitative methodology for studying impulsive choice, based on a family of linear indifference (null) equations, which describe performance under conditions of indifference, when the values of the reinforcers are assumed to be equal. This methodology may be used to identify individual differences in sensitivity to the magnitude, delay and probability of reinforcement. The methodology is also suitable for the quantitative evaluation of the effects of some pharmacological interventions on discounting parameters. Recent psychopharmacological studies of impulsive choice are reviewed, and the utility of indifference equations for extending this work, and developing a quantitative psychopharmacology of impulsive choice is discussed.
Performance on progressive ratio schedules has been proposed as a means of assessing the effects of drugs on "reinforcer efficacy". It has been proposed that the effects of neuroleptic drugs on operant behaviour are mediated by a reduction of "reinforcer efficacy". We examined the effects of two "conventional" neuroleptics (haloperidol and chlorpromazine) and an "atypical" neuroleptic (clozapine) on progressive ratio schedule performance; d-amphetamine was used as a comparison compound. In experiment 1, rats responded for a sucrose reinforcer on a time-constrained progressive ratio schedule (75-min sessions). After 66 preliminary training sessions, the rats received single doses (IP) of haloperidol (0.05, 0.1 mg kg(-1)). chlorpromazine (2, 4 mg kg(-1)), clozapine (0.5, 1, 2, 4, 8 mg kg(-1)), and d-amphetamine (0.2, 0.4, 0.8 mg kg(-1)), and the corresponding vehicle solutions. The highest ratio completed was reduced by haloperidol and chlorpromazine, and increased by clozapine. All three neuroleptics reduced the peak response rate, at least at the highest doses administered. Response rates on the lower and intermediate ratios could be described by a three-parameter equation proposed to account for fixed ratio schedule performance. Haloperidol reduced, and clozapine dose-dependently increased the "motivational" parameter (a); d-amphetamine reduced it at low doses and increased it at high doses. The three neuroleptics increased the "response time" parameter (delta). Un-reinforced locomotor behaviour, measured in experiment 2, was not significantly altered by haloperidol, chlorpromazine or clozapine, but was increased by d-amphetamine. These results are consistent with a reduction of reinforcer efficacy produced by haloperidol and an increase produced by clozapine; clozapine's effect is unlikely to reflect a general increase in locomotion. All three neuroleptics induced some degree of motor debilitation. The quantitative analysis of progressive ratio schedule performance may provide a useful adjunct to existing methods for separating effects of drugs on motivational and motor processes.
These results provide additional evidence that central 5-HTergic mechanisms are involved in time discounting, but provide no evidence for a similar role of 5-HT in rats' sensitivity to probabilistic reinforcement.
The results indicate that dopaminergic afferents to the OPFC contribute to the regulation of inter-temporal choice behaviour due to their role in determining organisms' sensitivity both to reinforcer size and to delay of reinforcement.
The results show that lesions of the OPFC can promote preference for the smaller and more immediate, and the smaller and more certain of two reinforcers. The results are consistent with two interpretations: the lesion may have altered (i) the rates of delay and odds discounting, and/or (ii) sensitivity to the ratio of the sizes of the two reinforcers.
These results confirm the disruptive effect of d-amphetamine on timing. The results of experiment 1 are consistent with the proposal that the drug reduces the period of the hypothetical pacemaker. However, the results of experiment 2 do not support this suggestion. Taken together, the results support the notion that different neural mechanisms may be involved in timing tasks involving temporal distribution of responding and discrimination of the duration of exteroceptive stimuli.
According to the multiplicative hyperbolic model, parallel displacement of the linear indifference function uniquely specifies a change in time discounting. Thus these results indicate that central 5-HT depletion results in an increase in the rate of time discounting for food reinforcers.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.