The big idea
Behavioral economics treats reinforcers as goods, responses as the price paid for them, and choice as how a person spends limited time and effort. Hursh (1980) showed that concepts from economics (open and closed economies, elasticity, and substitutes and complements) explain results that schedules and the matching law alone could not.
The name is shared with a different field. In economics and psychology, “behavioral economics” usually means the study of heuristics and biases in human decision making. This guide covers the operant tradition, which grew out of the experimental analysis of behavior.
For practitioners, behavioral economics answers questions that come up every day. Will this reinforcer keep working when the task gets harder? Why did tokens lose their value? Why does a client always take the small reward now? The exam covers the foundations (schedules in B.9 and B.10, the matching law in B.23, motivating operations in B.16, and preference assessment in F.4); this guide builds on them.
Breaking it down
Unit price, demand and elasticity
- Unit price is the cost per unit of reinforcer: responses (or effort) divided by the amount received. FR 10 for one token and FR 20 for two tokens have the same unit price.
- A demand curve plots how much of a reinforcer is consumed as its unit price rises. Consumption usually falls as price rises.
- Elasticity describes how sharply it falls. When demand is inelastic, consumption drops only a little as price rises; when it is elastic, consumption drops faster than price rises. Many reinforcers are inelastic at low prices and become elastic at high ones.
- Essential value (Hursh & Silberberg, 2008) is a single measure of how well a reinforcer keeps consumption going as price rises, which lets very different reinforcers be compared.
Reinforcer assessment under rising demands
A progressive-ratio schedule raises the response requirement after each reinforcer until responding stops; the last requirement completed is the break point. Roane, Lerman and Vorndran (2001) found that stimuli that looked similar at low effort could differ sharply as requirements rose, and that the stimuli that maintained more responding were generally more effective in treating destructive behavior. A preference assessment ranks items at almost no cost; a demand assessment shows which ones will hold up when the work gets harder.
Open and closed economies
In a closed economy, a reinforcer is available only through the target behavior. In an open economy, it is also available elsewhere. Hursh (1980) showed that the type of economy can change results, and free access outside the session also works as an abolishing operation (B.16). Closing an economy must never mean depriving a person of basic needs, and it should be arranged with the family’s agreement and the client’s assent.
Substitutes, complements and independents
- Substitutes can replace each other: when one becomes more expensive, use of the other rises (two similar snacks, or attention for problem behavior and attention for a functional communication response).
- Complements are used together: raising the price of one reduces use of both (a tablet and its headphones).
- Independents do not affect each other.
Function-based treatment uses substitution. Functional communication training works when the new response becomes a cheaper, faster route to the same reinforcer than problem behavior (H.3).
Delay discounting and self-control
Delay discounting is the decline in a reinforcer’s value as the delay to it grows. Across species and populations, value falls steeply at short delays and more gradually at long ones, a hyperbolic pattern (Odum, 2011). Value is also discounted by uncertainty (probability discounting) and by effort.
- Choosing a smaller-sooner reinforcer over a larger-later one is called impulsive choice; choosing the larger-later one is self-control.
- Hyperbolic discounting explains preference reversals: someone prefers the larger-later reward when both are far away, then switches as the smaller one becomes available.
- Steep discounting is associated with substance use and other health and social problems (Odum, 2011).
- Delay fading builds self-control: both options start out immediate, and the delay to the larger reinforcer is lengthened gradually (Dixon et al., 1998). Activities during the wait and commitment responses also help.
Seeing it in practice
| Situation | Economic reading | What to do |
|---|---|---|
| A snack works for two-step tasks, but responding stops on ten-step tasks | Demand for this snack becomes elastic at higher prices | Run a progressive-ratio assessment and use the reinforcer with higher essential value for effortful work |
| Leo earns tablet time in clinic but has unlimited tablet time at home | Open economy, plus satiation | With the family’s agreement, keep one favorite activity for sessions only, or choose a reinforcer not freely available |
| Tokens buy one backup item, and that item is handed out at lunch | A free substitute outside the token store | Vary the backups and keep some available only through tokens (G.4) |
| A teen always takes the small reward now | Steep delay discounting | Delay fading, an activity during the wait, and praise for waiting |
| Problem behavior gets attention in seconds; the request gets it after a minute | Problem behavior has the lower unit price and shorter delay | Make the request cheaper and faster than problem behavior at first, then thin gradually |
Common mix-ups
- Two fields share the name. Operant behavioral economics is not the heuristics-and-biases research associated with Kahneman and Thaler.
- Preference is not demand. The most preferred item at zero cost may not sustain work at a high cost.
- Unit price is not the schedule value. FR 20 for two reinforcers costs the same per reinforcer as FR 10 for one.
- Elasticity is not fixed. It changes along the demand curve and with the type of economy.
- Steep discounting is not a character flaw. It is a measurable pattern that changes when contingencies change.
Exam tip: If a question asks why a reinforcer works for easy tasks but not hard ones, think response effort and reinforcer assessment rather than preference alone (F.4, G.1). If it asks about choosing between concurrent options, start with the matching law (B.23).
Quick recap
- Unit price is responses per unit of reinforcer; demand curves show consumption falling as unit price rises.
- Progressive-ratio assessments show which reinforcers hold up as requirements rise.
- Free access outside the session (an open economy) weakens a reinforcer.
- Substitutes replace each other; functional communication training succeeds by making the new response the cheaper substitute.
- Value falls hyperbolically with delay; delay fading builds self-control.
Further reading
- Dixon, M. R., Hayes, L. J., Binder, L. M., Manthey, S., Sigman, C., & Zdanowski, D. M. (1998). Using a self-control training procedure to increase appropriate behavior. Journal of Applied Behavior Analysis, 31(2), 203-210.
- Hursh, S. R. (1980). Economic concepts for the analysis of behavior. Journal of the Experimental Analysis of Behavior, 34(2), 219-238.
- Hursh, S. R., & Silberberg, A. (2008). Economic demand and essential value. Psychological Review, 115(1), 186-198.
- Odum, A. L. (2011). Delay discounting: I’m a k, you’re a k. Journal of the Experimental Analysis of Behavior, 96(3), 427-439.
- Reed, D. D., Niileksela, C. R., & Kaplan, B. A. (2013). Behavioral economics: A tutorial for behavior analysts in practice. Behavior Analysis in Practice, 6(1), 34-54.
- Roane, H. S., Lerman, D. C., & Vorndran, C. M. (2001). Assessing reinforcers under progressive schedule requirements. Journal of Applied Behavior Analysis, 34(2), 145-166.
Key terms
- Behavioral economics
- In behavior analysis, the application of economic concepts to reinforcement: reinforcers are treated as goods, responses as the price paid for them, and choice as the allocation of limited time and effort. Not to be confused with the heuristics-and-biases field of the same name in economics and psychology.
- Unit price
- The cost of one unit of a reinforcer: the responses or effort required divided by the amount of reinforcer received.
- Demand curve
- A graph of how much of a reinforcer is consumed as its unit price rises. Consumption usually falls as price rises; how sharply it falls is the elasticity of demand.
- Elasticity of demand
- How sensitive consumption of a reinforcer is to increases in its price. Demand is inelastic when consumption falls only a little as price rises and elastic when it falls faster than price rises. Many reinforcers are inelastic at low prices and elastic at high ones.
- Progressive-ratio schedule
- A schedule in which the response requirement increases after each reinforcer until responding stops. The last requirement completed is the break point, a measure of how much work a reinforcer will maintain.
- Closed economy
- An arrangement in which a reinforcer is available only through the target behavior. In an open economy, the same reinforcer is also available elsewhere, which usually reduces responding for it. Closing an economy must never deprive a person of basic needs.
- Substitutable reinforcers
- Reinforcers that can replace each other, so that making one more costly increases use of the other. Complements are used together, so raising the price of one reduces use of both; independents do not affect each other.
- Delay discounting
- The decline in a reinforcer's present value as the delay to receiving it grows, usually steep at short delays and shallower at long ones (a hyperbolic pattern). Choosing a smaller-sooner reinforcer over a larger-later one is called impulsive choice; choosing the larger-later one is self-control.
Check yourself
4 questions on J.8. Choose an answer to see whether you're right and why.
Show the answer
Answer: B. Unit price is the cost per unit of reinforcer: 5 ÷ 1 and 10 ÷ 2 are both 5 responses per token. The ratio requirement alone is misleading because the second program also pays twice as much.
Show the answer
Answer: A. Preference assessments rank items at almost no cost. The progressive-ratio results show chips maintain far more work as the price rises, which matters for long or effortful tasks (Roane, Lerman & Vorndran, 2001). Another preference assessment would only repeat the tie.
Show the answer
Answer: A. The reinforcer is freely available outside the session, which makes this an open economy, and free access also reduces the motivation to earn it. A closed economy would make game time available only through session work. Inelastic demand would mean responding holds up despite the price.
Show the answer
Answer: A. Delay fading starts with both rewards available immediately and gradually adds delay to the larger one, which increased self-controlled choices in Dixon et al. (1998). Removing the choice teaches nothing about waiting, matching the amounts removes the choice altogether, and punishing choices adds an aversive without building self-control.