EconStatsCraft › Heckman selection

Heckman selection

For an outcome you only observe for a self-selected group - a wage only for people who work. Reports the two-step estimator so you can see the mechanism, then full maximum likelihood for inference, and tests whether selection was distorting anything at all.

What it needs

The intuition

You observe wages only for people who work, and people work partly because their wage would be high. So the wages you see are not a random sample of the wages that exist, and a regression on them answers a question about workers rather than about people. Heckman's insight is that if you can model who ends up in the sample, the expected error among those selected becomes a computable quantity - and once it is computable it can be put in the regression as a variable.

When to use it

The outcome is missing for a systematic, behavioural reason rather than at random, and you can name a variable that shifts whether it is observed without belonging in the outcome equation.

Where the estimator comes from

Two equations: selection d_i=\mathbf{1}[z_i'\gamma+u_i>0] and outcome y_i=x_i'\beta+\varepsilon_i, observed only when d_i=1, with (u,\varepsilon) jointly normal and \mathrm{Corr}(u,\varepsilon)=\rho. Then E[y_i\mid d_i=1]=x_i'\beta+\rho\sigma_\varepsilon\lambda(z_i'\gamma),\qquad \lambda(\cdot)=\frac{\phi(\cdot)}{\Phi(\cdot)}, the inverse Mills ratio. OLS on the selected sample omits that term, and because \lambda depends on z it is an omitted variable correlated with the regressors whenever x and z overlap. The two-step estimator fits a probit for selection, constructs \hat{\lambda}_i, and adds it to the outcome regression; its coefficient estimates \rho\sigma_\varepsilon, so testing it is a test of whether selection bias exists at all.

The model

E[y\mid \mathbf{x},\text{observed}]=\mathbf{x}^{\prime}\boldsymbol{\beta}+\rho\sigma\,\lambda(\mathbf{z}^{\prime}\boldsymbol{\gamma}),\qquad \lambda(a)=\frac{\phi(a)}{\Phi(a)}

What it assumes

Statistical properties

How to read the output

A worked reading

A wage equation on working women. OLS on the observed wages gives a return to schooling that is biased in a direction that depends on the correlation between the participation error and the wage error - if the women who work are those with unusually high unobserved earning capacity, rho is positive and OLS overstates the constant while the slope bias depends on how participation covaries with schooling. Adding lambda with number of young children excluded from the wage equation gives a corrected estimate, and the t-statistic on lambda is the test of whether the correction was needed. Without that exclusion, the same regression is identified only by the curvature of the Mills ratio, and its standard errors will say so.

Symptom → diagnosis → what to do

If you see thisIt meansDo this
No exclusion restrictionIdentification from functional form aloneExtremely fragile. Report OLS alongside and be honest
lambda coefficient insignificantNo detectable selection biasOLS on the selected sample is defensible
Enormous standard errorslambda nearly collinear with xThe classic symptom of a missing exclusion restriction
rho estimated at plus or minus 1A boundary solutionThe model is not identified in this sample
Two-step and MLE disagreeing sharplyNormality is doing heavy liftingDistrust both
Selection driven by observables onlyThe wrong modelControl for them, or use matching

Common mistakes

Where to read this properly

See also

Truncated regression, when the selection is on the outcome itself rather than a separate equation. Propensity score matching, for selection on observables.

Related Causal

Spatial autocorrelation · Spatial regression · Instrumental variables (2SLS) · Difference-in-differences · Staggered difference-in-differences · Regression discontinuity · Matching & weighting · Oaxaca–Blinder decomposition

All analyses

Charts

Line chart · Area chart · Bar chart · Stacked bar · Scatter plot · Bubble chart · Histogram · Box plot · Pie chart · Heat map · Rebased to 100 · Lorenz curve and Gini

Maps

World map · Bivariate map · Flow map · India - state map · India - district map

Explore

Descriptive statistics · Summary by group · Two-way table · Classical statistical tests

Regression

Multiple regression (OLS) · Logit / Probit · Tobit (censored) · Truncated regression · Multinomial logit · Ordered logit / probit · Quantile regression · Poisson / Negative binomial

Time series - one series

Time-varying coefficients (Kalman) · Unit root tests · Correlogram (ACF / PACF) · ARIMA / SARIMA · Rolling-origin cross-validation · Theta method · Unobserved components · STL forecasting · Forecast combination · Markov regime switching · Change frequency (resample) · ARCH / GARCH volatility · Decompose & filter · Spectral analysis · Exponential smoothing · Forecast accuracy

Time series - several series

Yield curve (Nelson–Siegel / Svensson) · Dynamic factor model · Dynamic regression (ARIMAX) · Structural VAR · VAR · Granger causality · Cointegration · VECM · ARDL & bounds test

Panel data

Panel regression · Panel cointegration tests · Heterogeneous panel: Mean Group & PMG · Gravity model of trade · Dynamic panel GMM · Panel diagnostics · Panel unit-root tests

Multivariate statistics

Principal components (PCA) · Factor analysis · Cluster analysis

Marketing research

Conjoint analysis · MaxDiff (best–worst scaling) · TURF - reach of a product line · Price sensitivity (Van Westendorp) · Market basket analysis · Perceptual map · Scale reliability (Cronbach’s alpha) · Key driver analysis

Causal

Spatial autocorrelation · Spatial regression · Heckman selection · Instrumental variables (2SLS) · Difference-in-differences · Staggered difference-in-differences · Regression discontinuity · Matching & weighting · Oaxaca–Blinder decomposition

Finance & risk

Black–Scholes option pricing · Bond price, duration & convexity · Merton distance to default · EMI / home loan planner · CAPM / beta estimation · Multi-factor model · Portfolio optimization · Value at Risk & Expected Shortfall · Performance & drawdown · Time value of money & NPV/IRR · Equity valuation (DDM, FCF, residual income) · Cost of capital (WACC) · Binomial option pricing · Option strategies (payoff & profit) · Forwards, futures & swaps · Credit risk & Basel capital · Extreme value theory (tail risk)

Actuarial

Life table · Life annuity · Life insurance pricing · Chain ladder reserving · Buhlmann credibility · Survival analysis · Mortality graduation · Aggregate loss model · Ruin probability · Multi-state Markov model · Loss severity fitting

Tests & breaks

Monte Carlo experiment · F-test, Wald & Chow · Structural breaks & stability

Machine learning

Regression vs machine learning · Ridge / Lasso / Elastic Net · Random forest · Gradient boosting

Open the workspace →

Starting engine…

EconStatsCraft rigorous, plain-spoken econometrics

Econometrics that explains itself.

Regression, panel data, time series and the whole battery of tests. Every result is followed by a verdict you can defend.

Load a dataset to see it here.