The big idea
A schedule of reinforcement is the rule that says which responses get reinforced. Reinforcing every response is continuous reinforcement (CRF). Reinforcing only some responses is intermittent reinforcement. The four basic intermittent schedules come from two choices: count responses (ratio) or count time (interval), and keep the requirement fixed or let it vary.
Schedules matter because each produces its own pattern of responding, and because the schedule used in teaching shapes how well behavior holds up when reinforcement becomes less frequent. Teaching typically uses CRF to build a skill, then shifts to intermittent schedules to keep it going (see G.16).
Breaking it down
Continuous reinforcement
Under CRF (sometimes written FR 1), every correct response is reinforced. It is the best schedule for acquiring new behavior, because the learner contacts the contingency every time. Its drawbacks: satiation comes quickly, it is hard to keep up in natural settings, and behavior on CRF extinguishes quickly once reinforcement stops (see B.11).
Ratio schedules: count responses
- Fixed ratio (FR): reinforcement follows a set number of responses. On FR 5, every fifth response is reinforced. FR produces a high rate with a postreinforcement pause after each reinforcer, then a quick return to a high rate (a break-and-run pattern). Larger ratios tend to produce longer pauses.
- Variable ratio (VR): reinforcement follows a number of responses that varies around an average. On VR 10, reinforcement might come after 3 responses, then 16, then 11. VR produces high, steady rates with little or no pausing, because the very next response could be the one that pays off. Slot machines are the standard example.
Interval schedules: count time, then require a response
- Fixed interval (FI): the first response after a set amount of time has passed is reinforced. On FI 5 min, responses during the five minutes do nothing; the first response after the interval ends is reinforced. FI produces a pause after reinforcement, then a gradually accelerating rate as the interval nears its end. On a cumulative record this curve is the FI scallop.
- Variable interval (VI): the first response after a varying amount of time is reinforced, with intervals averaging a set value. VI produces a moderate, steady rate with few pauses. Refreshing a ticket site that releases seats at unpredictable times is a rough everyday example.
Interval schedules still require a response. If reinforcement is delivered when time passes regardless of behavior, it is a time-based schedule such as fixed time (FT) or variable time (VT), covered in G.3.
Limited hold
A limited hold adds a window to an interval schedule: once the interval ends, the reinforcer stays available only for a set period, and if no response occurs in that window the opportunity is lost. A bus that waits at the stop for two minutes works this way. Limited holds push interval responding toward higher, steadier rates.
Ratio strain
Ratio strain occurs when a ratio requirement is raised too quickly or becomes too large. Responding turns erratic, pauses lengthen, and the behavior may nearly stop. The fix is to thin the schedule gradually and, if strain appears, step back to a smaller ratio.
Rate-based schedules
Some schedules reinforce the pace of responding. Differential reinforcement of low rates (DRL) reinforces a response only if enough time has passed since the previous one, and differential reinforcement of high rates (DRH) reinforces only rapid responding. They are used mainly as procedures (see G.2).
General patterns
- Ratio schedules produce higher rates than interval schedules.
- Variable schedules produce steadier responding, with fewer pauses, than fixed ones.
- Intermittent schedules, especially variable ones, produce more resistance to extinction than CRF.
Seeing it in practice
| Situation | Schedule | Typical pattern |
|---|---|---|
| A learner earns a token for every correct label during new teaching. | CRF | Fast acquisition, quick satiation |
| A worker is paid for every 25 surveys completed. | FR 25 | High rate, pause after each payment |
| A teacher praises hand-raising unpredictably, about every fourth time. | VR 4 | High, steady rate |
| A baker checks a cake that is never ready before 30 minutes. | Roughly FI 30 min | Few checks early, many near the end |
| A fan refreshes a ticket site that releases seats at unpredictable times. | Roughly VI | Moderate, steady refreshing |
Everyday examples only approximate laboratory schedules. People use clocks and rules, so human performance on FI schedules often looks different from the classic scallop.
Common mix-ups
- Interval schedules need a response. Time passing makes reinforcement available; a response must still occur. If no response is needed, it is FT or VT.
- Variable is not random. The requirement varies, but around a set average.
- Pauses point to fixed schedules. Postreinforcement pauses are typical of FR and FI. VR and VI produce steady responding.
- A scallop means FI. Flat after reinforcement, then accelerating toward the end of the interval.
- CRF is for teaching, not maintaining. Behavior on CRF extinguishes faster than behavior on intermittent schedules.
- Ratio strain is not extinction. Reinforcement is still available; the requirement has become too large.
Exam tip: Ask two questions. Does reinforcement depend on a number of responses (ratio) or on the first response after time passes (interval)? Is the requirement the same every time (fixed) or does it vary around an average (variable)?
Quick recap
- CRF reinforces every response: best for acquisition, least resistant to extinction.
- FR: high rate with postreinforcement pauses. VR: high, steady rate.
- FI: pause, then accelerating rate (scallop). VI: moderate, steady rate.
- A limited hold restricts how long a reinforcer stays available after an interval ends.
- Ratio strain follows thinning a ratio too fast; thin gradually.
Further reading
- Cooper, J. O., Heron, T. E., & Heward, W. L. (2020). Applied behavior analysis (3rd ed.), chapter 13.
- Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. Appleton-Century-Crofts.
Key terms
- Schedule of reinforcement
- A rule that specifies which responses will be reinforced. A schedule may reinforce every response (continuous reinforcement) or only some (intermittent reinforcement), based on the number of responses, the passage of time before a response, or both.
- Continuous reinforcement (CRF, FR 1)
- A schedule in which every occurrence of the target response is reinforced. It is the best schedule for building a new behavior, but satiation comes quickly and the behavior extinguishes faster than behavior maintained on intermittent schedules.
- Intermittent reinforcement (Partial reinforcement)
- Any schedule in which some, but not all, occurrences of a response are reinforced. The basic intermittent schedules are fixed ratio, variable ratio, fixed interval and variable interval. Behavior maintained on intermittent schedules is more resistant to extinction than behavior maintained on continuous reinforcement.
- Fixed-ratio schedule (FR)
- A schedule in which reinforcement follows a set number of responses, such as every fifth response (FR 5). It typically produces a high rate of responding with a postreinforcement pause after each reinforcer, and the pause tends to grow as the ratio gets larger.
- Variable-ratio schedule (VR)
- A schedule in which reinforcement follows a number of responses that varies from one reinforcer to the next around an average, such as an average of every 10 responses (VR 10). It produces high, steady rates with little or no pausing.
- Fixed-interval schedule (FI)
- A schedule in which the first response after a fixed amount of time has passed is reinforced, such as the first response after 5 minutes (FI 5 min). Responses before the interval ends have no effect. It typically produces a pause after reinforcement followed by a gradually accelerating rate, a pattern called the FI scallop.
- Variable-interval schedule (VI)
- A schedule in which the first response after a varying amount of time has passed is reinforced, with the intervals averaging a set value, such as 2 minutes (VI 2 min). It produces a moderate, steady rate with few pauses.
- Ratio strain
- Disrupted responding that occurs when a ratio requirement is raised too quickly or becomes too large: long pauses, erratic responding and sometimes a near stop of the behavior. It is prevented by thinning ratios gradually.
Check yourself
4 questions on B.9. Choose an answer to see whether you're right and why.
Show the answer
Answer: C. Reinforcement after a set number of responses is a fixed-ratio schedule, which typically produces a postreinforcement pause followed by a high rate (break and run). A rate that accelerates toward the end of a time period describes a fixed-interval scallop, and moderate steady responding describes a variable interval.
Show the answer
Answer: C. Only the first check after a fixed amount of time is reinforced (the cookies are done), and checking accelerates as the interval ends. That is the fixed-interval scallop. A variable interval would produce steadier checking, because the end of the interval could come at any time.
Show the answer
Answer: D. A sudden, large increase in a ratio requirement commonly produces ratio strain: long pauses, erratic responding and near stopping. Tokens are still available, so this is not extinction, and tokens became less frequent, not more, so satiation does not fit.
Show the answer
Answer: C. A variable interval reinforces the first response after a varying amount of time, so both time and a response are required. Every fifth request is a fixed ratio, an unpredictable number of requests is a variable ratio, and delivering treats regardless of behavior is a time-based schedule (fixed time), not an interval schedule.
Adds a step to your study record. Saved in this browser only.