cumulative

J.8 Behavioral economics: demand, unit price and delay discounting

In this guide: How economic concepts sharpen everyday ABA decisions: which reinforcers hold up as demands rise, why free access elsewhere weakens a reinforcer, and how to build self-control.

Beyond the Exam6 min read4 practice questionsNot on the exam

The big idea

Behavioral economics treats reinforcers as goods, responses as the price paid for them, and choice as how a person spends limited time and effort. Hursh (1980) showed that concepts from economics (open and closed economies, elasticity, and substitutes and complements) explain results that schedules and the matching law alone could not.

The name is shared with a different field. In economics and psychology, “behavioral economics” usually means the study of heuristics and biases in human decision making. This guide covers the operant tradition, which grew out of the experimental analysis of behavior.

For practitioners, behavioral economics answers questions that come up every day. Will this reinforcer keep working when the task gets harder? Why did tokens lose their value? Why does a client always take the small reward now? The exam covers the foundations (schedules in B.9 and B.10, the matching law in B.23, motivating operations in B.16, and preference assessment in F.4); this guide builds on them.

Breaking it down

Unit price, demand and elasticity

  • Unit price is the cost per unit of reinforcer: responses (or effort) divided by the amount received. FR 10 for one token and FR 20 for two tokens have the same unit price.
  • A demand curve plots how much of a reinforcer is consumed as its unit price rises. Consumption usually falls as price rises.
  • Elasticity describes how sharply it falls. When demand is inelastic, consumption drops only a little as price rises; when it is elastic, consumption drops faster than price rises. Many reinforcers are inelastic at low prices and become elastic at high ones.
  • Essential value (Hursh & Silberberg, 2008) is a single measure of how well a reinforcer keeps consumption going as price rises, which lets very different reinforcers be compared.
051015200246810Unit price (task steps per reinforcer)ToySnackInelastic: little changeElastic: sharp dropReinforcers earned
Demand curves for two reinforcers. Both hold up at low prices (inelastic). Consumption of the snack collapses once tasks pass about four steps (elastic), while the toy keeps responding going, so it has the higher essential value. Published demand curves usually use log axes; these are plain.

Reinforcer assessment under rising demands

A progressive-ratio schedule raises the response requirement after each reinforcer until responding stops; the last requirement completed is the break point. Roane, Lerman and Vorndran (2001) found that stimuli that looked similar at low effort could differ sharply as requirements rose, and that the stimuli that maintained more responding were generally more effective in treating destructive behavior. A preference assessment ranks items at almost no cost; a demand assessment shows which ones will hold up when the work gets harder.

Open and closed economies

In a closed economy, a reinforcer is available only through the target behavior. In an open economy, it is also available elsewhere. Hursh (1980) showed that the type of economy can change results, and free access outside the session also works as an abolishing operation (B.16). Closing an economy must never mean depriving a person of basic needs, and it should be arranged with the family’s agreement and the client’s assent.

Substitutes, complements and independents

  • Substitutes can replace each other: when one becomes more expensive, use of the other rises (two similar snacks, or attention for problem behavior and attention for a functional communication response).
  • Complements are used together: raising the price of one reduces use of both (a tablet and its headphones).
  • Independents do not affect each other.

Function-based treatment uses substitution. Functional communication training works when the new response becomes a cheaper, faster route to the same reinforcer than problem behavior (H.3).

Delay discounting and self-control

Delay discounting is the decline in a reinforcer’s value as the delay to it grows. Across species and populations, value falls steeply at short delays and more gradually at long ones, a hyperbolic pattern (Odum, 2011). Value is also discounted by uncertainty (probability discounting) and by effort.

  • Choosing a smaller-sooner reinforcer over a larger-later one is called impulsive choice; choosing the larger-later one is self-control.
  • Hyperbolic discounting explains preference reversals: someone prefers the larger-later reward when both are far away, then switches as the smaller one becomes available.
  • Steep discounting is associated with substance use and other health and social problems (Odum, 2011).
  • Delay fading builds self-control: both options start out immediate, and the delay to the larger reinforcer is lengthened gradually (Dixon et al., 1998). Activities during the wait and commitment responses also help.
TimePreference reversesSmaller-soonerLarger-laterLarger-later preferredPresent value
How hyperbolic discounting produces a preference reversal. Each curve is a reward's present value, rising steeply as its delivery nears. Early on the larger-later curve is higher; once the smaller reward is close, its curve crosses above and the choice flips.

Seeing it in practice

SituationEconomic readingWhat to do
A snack works for two-step tasks, but responding stops on ten-step tasksDemand for this snack becomes elastic at higher pricesRun a progressive-ratio assessment and use the reinforcer with higher essential value for effortful work
Leo earns tablet time in clinic but has unlimited tablet time at homeOpen economy, plus satiationWith the family’s agreement, keep one favorite activity for sessions only, or choose a reinforcer not freely available
Tokens buy one backup item, and that item is handed out at lunchA free substitute outside the token storeVary the backups and keep some available only through tokens (G.4)
A teen always takes the small reward nowSteep delay discountingDelay fading, an activity during the wait, and praise for waiting
Problem behavior gets attention in seconds; the request gets it after a minuteProblem behavior has the lower unit price and shorter delayMake the request cheaper and faster than problem behavior at first, then thin gradually

Common mix-ups

  • Two fields share the name. Operant behavioral economics is not the heuristics-and-biases research associated with Kahneman and Thaler.
  • Preference is not demand. The most preferred item at zero cost may not sustain work at a high cost.
  • Unit price is not the schedule value. FR 20 for two reinforcers costs the same per reinforcer as FR 10 for one.
  • Elasticity is not fixed. It changes along the demand curve and with the type of economy.
  • Steep discounting is not a character flaw. It is a measurable pattern that changes when contingencies change.

Exam tip: If a question asks why a reinforcer works for easy tasks but not hard ones, think response effort and reinforcer assessment rather than preference alone (F.4, G.1). If it asks about choosing between concurrent options, start with the matching law (B.23).

Quick recap

  • Unit price is responses per unit of reinforcer; demand curves show consumption falling as unit price rises.
  • Progressive-ratio assessments show which reinforcers hold up as requirements rise.
  • Free access outside the session (an open economy) weakens a reinforcer.
  • Substitutes replace each other; functional communication training succeeds by making the new response the cheaper substitute.
  • Value falls hyperbolically with delay; delay fading builds self-control.

Further reading

  • Dixon, M. R., Hayes, L. J., Binder, L. M., Manthey, S., Sigman, C., & Zdanowski, D. M. (1998). Using a self-control training procedure to increase appropriate behavior. Journal of Applied Behavior Analysis, 31(2), 203-210.
  • Hursh, S. R. (1980). Economic concepts for the analysis of behavior. Journal of the Experimental Analysis of Behavior, 34(2), 219-238.
  • Hursh, S. R., & Silberberg, A. (2008). Economic demand and essential value. Psychological Review, 115(1), 186-198.
  • Odum, A. L. (2011). Delay discounting: I’m a k, you’re a k. Journal of the Experimental Analysis of Behavior, 96(3), 427-439.
  • Reed, D. D., Niileksela, C. R., & Kaplan, B. A. (2013). Behavioral economics: A tutorial for behavior analysts in practice. Behavior Analysis in Practice, 6(1), 34-54.
  • Roane, H. S., Lerman, D. C., & Vorndran, C. M. (2001). Assessing reinforcers under progressive schedule requirements. Journal of Applied Behavior Analysis, 34(2), 145-166.

Key terms

Behavioral economics
In behavior analysis, the application of economic concepts to reinforcement: reinforcers are treated as goods, responses as the price paid for them, and choice as the allocation of limited time and effort. Not to be confused with the heuristics-and-biases field of the same name in economics and psychology.
Unit price
The cost of one unit of a reinforcer: the responses or effort required divided by the amount of reinforcer received.
Demand curve
A graph of how much of a reinforcer is consumed as its unit price rises. Consumption usually falls as price rises; how sharply it falls is the elasticity of demand.
Elasticity of demand
How sensitive consumption of a reinforcer is to increases in its price. Demand is inelastic when consumption falls only a little as price rises and elastic when it falls faster than price rises. Many reinforcers are inelastic at low prices and elastic at high ones.
Progressive-ratio schedule
A schedule in which the response requirement increases after each reinforcer until responding stops. The last requirement completed is the break point, a measure of how much work a reinforcer will maintain.
Closed economy
An arrangement in which a reinforcer is available only through the target behavior. In an open economy, the same reinforcer is also available elsewhere, which usually reduces responding for it. Closing an economy must never deprive a person of basic needs.
Substitutable reinforcers
Reinforcers that can replace each other, so that making one more costly increases use of the other. Complements are used together, so raising the price of one reduces use of both; independents do not affect each other.
Delay discounting
The decline in a reinforcer's present value as the delay to receiving it grows, usually steep at short delays and shallower at long ones (a hyperbolic pattern). Choosing a smaller-sooner reinforcer over a larger-later one is called impulsive choice; choosing the larger-later one is self-control.

Check yourself

4 questions on J.8. Choose an answer to see whether you're right and why.

  1. Question 1One program pays one token for every 5 correct responses (FR 5). Another pays two tokens for every 10 correct responses (FR 10). How do their unit prices compare?
    Show the answer

    Answer: B. Unit price is the cost per unit of reinforcer: 5 ÷ 1 and 10 ÷ 2 are both 5 responses per token. The ratio requirement alone is misleading because the second program also pays twice as much.

  2. Question 2Chips and pretzels tie for first place in an MSWO. On a progressive-ratio schedule, Mira stops working for pretzels after 12 responses but keeps working for chips until 40. Which should be used for long work periods?
    Show the answer

    Answer: A. Preference assessments rank items at almost no cost. The progressive-ratio results show chips maintain far more work as the price rises, which matters for long or effortful tasks (Roane, Lerman & Vorndran, 2001). Another preference assessment would only repeat the tie.

  3. Question 3Leo earns video game time during sessions, but at home he can play as much as he likes. His responding in session keeps falling. Which behavioral-economic term best describes the problem?
    Show the answer

    Answer: A. The reinforcer is freely available outside the session, which makes this an open economy, and free access also reduces the motivation to earn it. A closed economy would make game time available only through session work. Inelastic demand would mean responding holds up despite the price.

  4. Question 4In a work program, Andre always picks $5 today over $20 paid next week. Which intervention follows from the research on delay discounting?
    Show the answer

    Answer: A. Delay fading starts with both rewards available immediately and gradually adds delay to the larger one, which increased self-controlled choices in Dixon et al. (1998). Removing the choice teaches nothing about waiting, matching the amounts removes the choice altogether, and punishing choices adds an aversive without building self-control.

Type to search all 104 guides and the glossary.