Regression Foundations
A reading guide — which kind of control buys accuracy, which buys precision, and which combination is the dangerous one.
Section one
The classification and the four resulting models, each stated as a claim.
Key concepts
A good estimate of program impact is accurate and precise.
These are separate properties with separate causes, and different control variables buy you different ones.
The full model has one policy variable and two kinds of control.
Type A: the control is uncorrelated with the policy variable.
Type B: the control is correlated with the policy variable.
Dropping each type produces a two-by-two.
| X3 included | X3 omitted | |
|---|---|---|
| X2 included | Unbiased & Precise | Unbiased & Imprecise |
| X2 omitted | Biased & Precise | Biased & Imprecise |
Section two
The mental map. How the pieces connect, and how to read the deck.
This deck is a short one and it does one thing: it sorts control variables by which quality problem they solve.
The classification depends on the control’s relationship to X1, not to Y. Both types predict Y — that is what makes them controls at all. What separates them is whether they also move with your treatment.
Three of the four cells are honest failures. Case C is a dishonest one.
If you include the noise-reducing control and omit the competing hypothesis, you get tight confidence intervals around a biased estimate. The model looks excellent — small standard errors, strong significance, high R2 — and the number it is confident about is wrong.
The deck says this plainly: the uncorrelated control results in small standard error, which can give false confidence when the absence of X2 results in omitted variable bias.
Compare case D, the naïve model. It is also biased, but its standard errors are large, so it advertises its own uncertainty. Adding a type-A control to a mis-specified model does not fix anything — it just removes the warning label.
This is the practical reason R2 and significance are poor guides to model quality. Neither one can see bias.
There is an asymmetry between the two fixes that is worth naming.
Adding a type-A control is a technical improvement. You can hunt for such variables in your data, add them, and read the standard errors to see if it worked. Nothing about your causal argument changes.
Adding a type-B control is a substantive claim. You are asserting that this particular alternative explanation exists and needs to be ruled out. No diagnostic in the regression output will tell you which competing hypotheses you have forgotten — that comes from theory and knowledge of the setting.
Which is why the exam question at the end of the deck is about matching diagrams to descriptions rather than computing anything. The skill being tested is reading a specification, not running one.
If you understood those two lectures, this one should feel like a summary. If it does not, the grid is the place to start over.
| Slides | What they are doing | What to take away |
|---|---|---|
| 1 | The two quality criteria | Accurate and precise are different goals. |
| 2 | The taxonomy | Type A buys precision; Type B buys accuracy. |
| 3 | Four candidate models | Try to rank them before turning the page. |
| 4–8 | Each case explained | Note that case C is called out as “complicated.” |
| 9, 11 | Exam-style matching | Class size, SES, teacher quality. Do these. |
| 10 | The two-by-two | The summary slide. Four cells, four verdicts. |
Section three
Four things to be able to answer without notes.