Regression Foundations

Taxonomy of Control Variables

A reading guide — which kind of control buys accuracy, which buys precision, and which combination is the dangerous one.

Section one

Key concepts

The classification and the four resulting models, each stated as a claim.

Key concepts

A good estimate of program impact is accurate and precise.

  • Accurate (“unbiased”) = no omitted variable bias
  • Precise (“efficient”) = small standard errors

These are separate properties with separate causes, and different control variables buy you different ones.

The full model has one policy variable and two kinds of control.

Y = B0 + B1X1 + B2X2 + B3X3 + e
  • X1 = the policy variable; B1 = program impact
  • X2 = a control correlated with X1 — a competing hypothesis
  • X3 = a control uncorrelated with X1 — a pure predictor of Y

Type A: the control is uncorrelated with the policy variable.

  • Explains extra Y
  • Smaller standard errors
  • More precise estimates

Type B: the control is correlated with the policy variable.

  • Removes bias from B1
  • More accurate estimates

Dropping each type produces a two-by-two.

X3 includedX3 omitted
X2 included Unbiased & PreciseUnbiased & Imprecise
X2 omitted Biased & PreciseBiased & Imprecise
  • Ay = b0 + b1x1 + b2x2 + b3x3 — unbiased and precise
  • By = b0 + b1x1 + b2x2 — unbiased, but large standard errors
  • Cy = b0 + b1x1 + b3x3biased, with false confidence
  • Dy = b0 + b1x1 — biased and imprecise

Section two

Key relationships

The mental map. How the pieces connect, and how to read the deck.

Two jobs, two kinds of variable

This deck is a short one and it does one thing: it sorts control variables by which quality problem they solve.

The classification depends on the control’s relationship to X1, not to Y. Both types predict Y — that is what makes them controls at all. What separates them is whether they also move with your treatment.

Case C is the one to be afraid of

Three of the four cells are honest failures. Case C is a dishonest one.

If you include the noise-reducing control and omit the competing hypothesis, you get tight confidence intervals around a biased estimate. The model looks excellent — small standard errors, strong significance, high R2 — and the number it is confident about is wrong.

The deck says this plainly: the uncorrelated control results in small standard error, which can give false confidence when the absence of X2 results in omitted variable bias.

Compare case D, the naïve model. It is also biased, but its standard errors are large, so it advertises its own uncertainty. Adding a type-A control to a mis-specified model does not fix anything — it just removes the warning label.

This is the practical reason R2 and significance are poor guides to model quality. Neither one can see bias.

Precision is cheap; accuracy is a claim about the world

There is an asymmetry between the two fixes that is worth naming.

Adding a type-A control is a technical improvement. You can hunt for such variables in your data, add them, and read the standard errors to see if it worked. Nothing about your causal argument changes.

Adding a type-B control is a substantive claim. You are asserting that this particular alternative explanation exists and needs to be ruled out. No diagnostic in the regression output will tell you which competing hypotheses you have forgotten — that comes from theory and knowledge of the setting.

Which is why the exam question at the end of the deck is about matching diagrams to descriptions rather than computing anything. The skill being tested is reading a specification, not running one.

How this deck sits between p-06 and p-07

If you understood those two lectures, this one should feel like a summary. If it does not, the grid is the place to start over.

How to read the slides

SlidesWhat they are doingWhat to take away
1The two quality criteriaAccurate and precise are different goals.
2The taxonomyType A buys precision; Type B buys accuracy.
3Four candidate modelsTry to rank them before turning the page.
4–8Each case explainedNote that case C is called out as “complicated.”
9, 11Exam-style matchingClass size, SES, teacher quality. Do these.
10The two-by-twoThe summary slide. Four cells, four verdicts.

Section three

What should be clear in my mind?

Four things to be able to answer without notes.

  1. What makes a regression estimate good. Two things, independently: unbiased (no omitted variable bias) and efficient (small standard errors).
  2. Which control buys which. Correlated with the treatment → removes bias. Uncorrelated with the treatment → reduces standard errors.
  3. How to classify a control. Look at its relationship to your policy variable. Its relationship to Y is what makes it a control; its relationship to X1 is what makes it one type or the other.
  4. Why “biased and precise” is the dangerous cell. Small standard errors around the wrong estimate look like a good model and are not.

Key takeaways