/ Single-Case Design Graphs

Overview › Visual analysis › Lesson 6

Lesson 6 of 7About 25 minutes

Variability and stability in depth

Lesson 1 described variability by the range. Here you measure it from every data point: each point's distance from the level line, the sum of squares, the variance, and the standard deviation. Then you compare variability within and across phases, judge whether a phase is stable, and see what a trend does to it.

You will be able to

  • Find each data point's distance from its phase's level line, and explain why the distances always add to zero.
  • Calculate a phase's sum of squares, variance, and standard deviation, by hand and in Excel.
  • Compare variability across phases, each measured around its own level line.
  • Judge whether a phase is stable with a stability envelope, and measure variability around a trend line when the data trend.
  • Work through new graphs step by step, reaching 8 of your last 10 in the practice.

Why the range isn't enough

The range uses only the two most extreme points. One unusual session can make a steady phase look variable, and two phases with the same range can bounce around their level very differently. Measuring every point's distance from the level line uses all the data, so each session counts.

Distance from the level line

Draw the phase's level line at its mean. Each point's distance from that line is its value minus the mean: positive for a point above the line, negative for a point below it, and 0 for a point on it.

Baseline graph of percentage of intervals with problem behavior, sessions 1 to 5: 62, 32, 65, 41, and 50 percent. A dashed level line at the mean, 50 percent, with a vertical line from each point to it, labeled +12, −18, +15, and −9. The last point sits on the line.
Distances from the level line. The five values add to 250, so the level (mean) is 50. The points sit +12, −18, +15, −9, and 0 from the level line.

Add the distances and you get 0: 12 − 18 + 15 − 9 + 0 = 0. You always will. The mean is the balance point of the data, so the distances above it cancel the distances below it. To measure how far the points spread, the signs have to go. There are two ways:

Variance and standard deviation by hand

SessionValueDistance from the level (value − 50)Squared distance
162+12144
232−18324
365+15225
441−981
55000
Total2500774
  1. Level. 250 ÷ 5 = 50.
  2. Distances. Subtract the level from each value.
  3. Sum of squares. Square each distance and add the squares: 144 + 324 + 225 + 81 + 0 = 774.
  4. Variance. Divide the sum of squares by n − 1, one less than the number of points: 774 ÷ 4 = 193.5. Its units are squared, percentage points squared here, so it is hard to picture on its own.
  5. Standard deviation. Take the square root of the variance: √193.5 = 13.9. It is back in the units of the data: a typical session is about 14 percentage points from the level line.

Why n − 1? The level line comes from the same five points, so the points sit a little closer to it than they would to the behavior's true level. Dividing by n − 1 instead of n makes up for that. Excel's VAR.S and STDEV.S divide by n − 1, and VAR.P and STDEV.P divide by n. Use the .S versions, as the dual-criteria lessons do.

In Excel

With the sessions in A2:A6 and the values in B2:B6:

Build the distance and squared-distance columns at least once. They show where each number comes from, and which sessions add the most to the variance: here session 2, whose squared distance, 324, is over 40% of the total.

Within a phase and across phases

Variability within a phase is the bounce from session to session around that phase's own level. To compare phases, find each phase's variance around its own level line, then compare the standard deviations, which are in the units of the data.

AB graph of percentage of intervals on task. Baseline, sessions 1 to 6, is 40, 58, 35, 62, 45, and 54 percent, around a level line at 49. Intervention, sessions 7 to 13, is 78, 82, 80, 84, 79, 83, and 81 percent, around a level line at 81. Vertical lines from each point to its own phase's level line are long in baseline and short in intervention.
Variable, then stable. Baseline: level 49, variance 113.6, standard deviation 10.7. Intervention: level 81, variance 4.7, standard deviation 2.2. The intervention raised the level and made behavior about five times less spread out.

Stability before a phase change

Change phases when the data are steady enough to predict what would happen next. A stability envelope turns that into a rule: draw the phase's median, then lines 25% of the median above and below it. A common rule calls the phase stable when about 80% of its points fall inside the envelope (Lane & Gast, 2014).

Baseline graph of percentage of intervals on task, sessions 1 to 7: 44, 52, 47, 63, 40, 49, and 46 percent. A dashed median line at 47 and a shaded envelope from about 35 to 59 percent. Only the point at 63 percent falls outside the envelope.
Stable by the 80% rule. The median is 47, and 25% of 47 is 11.75, so the envelope runs from 35.25 to 58.75. Six of the 7 points fall inside. 80% of 7 is 5.6, so 6 are needed.
  1. Median. Sort the points and take the middle one: 40, 44, 46, 47, 49, 52, 63. Excel: =MEDIAN(B2:B8).
  2. Envelope. The lower edge is 0.75 × the median and the upper edge 1.25 × the median.
  3. Count. Count the points between the edges. Excel: =COUNTIFS(B2:B8,">="&E2,B2:B8,"<="&E3), with the lower edge in E2 and the upper edge in E3.
  4. Decide. Compare the count with 80% of the number of points, rounded up.

Read the envelope with the graph. The envelope is a percentage of the median, so it is narrow when the median is low: around a median of 8, it reaches only 2 either way. And it judges spread, not trend: data that rise steadily can stay inside a wide envelope. Check the trend separately before you change phases.

When the data trend

A level line is flat. When a phase trends, each point's distance from the level line includes the trend itself, so the variance overstates the bounce. Measure from the trend line instead, using its value at each session (intercept + slope × session, as in Lesson 5).

Baseline graph of percentage of intervals with problem behavior, sessions 1 to 5: 62, 65, 41, 50, and 32 percent, falling. A dashed level line at 50 and a dotted trend line falling from 65 to 35, with a vertical line from each point to the trend line, labeled −3.0, +7.5, −9.0, +7.5, and −3.0.
Same values, different order. These are the five values from the first example, now falling about 7.5 points per session. Around the level line, the squared distances still add to 774. Around the trend line, the distances are −3, +7.5, −9, +7.5, and −3, and their squares add to only 211.5. About three quarters of the spread around the level line was the trend.

The variance ignores order: the same five values have the same variance in any order. The graph doesn't. That is why visual analysis describes trend and variability separately: first the trend, then how far the points scatter around it. (To turn the scatter around a trend line into a variance, statisticians divide its sum of squares by n − 2, because the line uses two values from the data, its slope and its intercept.)

Practice

Each graph works in steps. Most ask you to calculate a phase's level, distances, sum of squares, variance, and standard deviation by hand. Others compare two phases, test stability with an envelope, or measure the bounce around a trend line. The data table is open, with the exact values. Round as each step asks; answers within a rounding step are accepted. After a wrong step, the right answer appears so you can carry on, and a graph counts toward mastery only when every step is right.