EconStatsCraft › Ordered logit / probit

Ordered logit / probit

For an outcome with categories that are ranked but not evenly spaced - a 1-to-5 satisfaction score, a credit rating, low/medium/high. One coefficient per variable describes the shift towards higher categories, with estimated cut points between them.

What it needs

The intuition

A rating from "strongly disagree" to "strongly agree" has an order but no arithmetic: the gap between agree and strongly agree is not the same size as the gap between neutral and agree, and averaging the numbers 1 to 5 pretends otherwise. Ordered logit posits one underlying continuous attitude cut into bands by thresholds. A regressor shifts the whole attitude left or right, and the thresholds stay where they are.

When to use it

The outcome has three or more categories with a genuine order, and treating the labels as numbers would be a lie about the spacing between them.

Where the estimator comes from

Let y_i^=x_i'\beta+u_i with u_i logistic, observed as category j when \kappa_{j-1}<y_i^\le\kappa_j. Then P(y_i\le j\mid x)=\Lambda(\kappa_j-x_i'\beta), so each CUMULATIVE probability is an ordinary logit with its own intercept and a SHARED slope. That shared slope is the proportional-odds assumption. Note the sign convention: a positive \beta raises y^* and therefore lowers the probability of being at or below any given category. There is no separate constant - the thresholds absorb it, which is why software reports J-1 cut points and no intercept.

The model

P(y\le j\mid \mathbf{x})=F(\kappa_{j}-\mathbf{x}^{\prime}\boldsymbol{\beta}),\qquad \kappa_{1}<\kappa_{2}<\dots<\kappa_{J-1}

What it assumes

Statistical properties

How to read the output

A worked reading

A five-point job-satisfaction scale for 900 respondents, with 117 in the lowest category and 126 in the highest. Each additional child lowers the odds of being in a higher category by a factor of 0.5803 - almost halving them - with schooling (odds ratio 1.0925 per year) and husband's income (1.0265 per unit) pulling the other way. The four cut points come out at -0.4875, 0.8885, 2.1368 and 3.4945, and the average predicted probabilities match the observed shares to within a tenth of a percentage point in every category, which is the least a five-category model should manage. Proportional odds is the claim that the single figure 0.5803 applies identically to the odds of clearing the first threshold, the second, the third and the fourth. One number replacing four is what the model buys, and it is an assumption rather than a finding: if the effect of children really differs between the bottom of the scale and the top, the summary is a fiction and only a test of parallel lines will say so.

Symptom → diagnosis → what to do

If you see thisIt meansDo this
Brant test rejectingProportional odds failsUse a generalised ordered model, or report multinomial
A threshold not increasingAn estimation failureCut points must be ordered by construction
Very few observations in one categoryThat threshold is poorly identifiedConsider merging, deciding before you see results
Coefficient signs the reverse of expectationThe software's sign conventionCheck whether it models P(y <= j) or P(y > j)
Odds ratio enormousNear-perfect separation in a small categoryCheck the crosstab
Marginal effects not summing to zeroAn arithmetic errorThey must, across all categories

Common mistakes

Where to read this properly

See also

Multinomial logit, which drops the ordering entirely. Logit and probit, the two-category case this generalises.

Related Regression

Multiple regression (OLS) · Logit / Probit · Tobit (censored) · Truncated regression · Multinomial logit · Quantile regression · Poisson / Negative binomial

All analyses

Charts

Line chart · Area chart · Bar chart · Stacked bar · Scatter plot · Bubble chart · Histogram · Box plot · Pie chart · Heat map · Rebased to 100 · Lorenz curve and Gini

Maps

World map · Bivariate map · Flow map · India - state map · India - district map

Explore

Descriptive statistics · Summary by group · Two-way table · Classical statistical tests

Regression

Multiple regression (OLS) · Logit / Probit · Tobit (censored) · Truncated regression · Multinomial logit · Ordered logit / probit · Quantile regression · Poisson / Negative binomial

Time series - one series

Time-varying coefficients (Kalman) · Unit root tests · Correlogram (ACF / PACF) · ARIMA / SARIMA · Rolling-origin cross-validation · Theta method · Unobserved components · STL forecasting · Forecast combination · Markov regime switching · Change frequency (resample) · ARCH / GARCH volatility · Decompose & filter · Spectral analysis · Exponential smoothing · Forecast accuracy

Time series - several series

Yield curve (Nelson–Siegel / Svensson) · Dynamic factor model · Dynamic regression (ARIMAX) · Structural VAR · VAR · Granger causality · Cointegration · VECM · ARDL & bounds test

Panel data

Panel regression · Panel cointegration tests · Heterogeneous panel: Mean Group & PMG · Gravity model of trade · Dynamic panel GMM · Panel diagnostics · Panel unit-root tests

Multivariate statistics

Principal components (PCA) · Factor analysis · Cluster analysis

Marketing research

Conjoint analysis · MaxDiff (best–worst scaling) · TURF - reach of a product line · Price sensitivity (Van Westendorp) · Market basket analysis · Perceptual map · Scale reliability (Cronbach’s alpha) · Key driver analysis

Causal

Spatial autocorrelation · Spatial regression · Heckman selection · Instrumental variables (2SLS) · Difference-in-differences · Staggered difference-in-differences · Regression discontinuity · Matching & weighting · Oaxaca–Blinder decomposition

Finance & risk

Black–Scholes option pricing · Bond price, duration & convexity · Merton distance to default · EMI / home loan planner · CAPM / beta estimation · Multi-factor model · Portfolio optimization · Value at Risk & Expected Shortfall · Performance & drawdown · Time value of money & NPV/IRR · Equity valuation (DDM, FCF, residual income) · Cost of capital (WACC) · Binomial option pricing · Option strategies (payoff & profit) · Forwards, futures & swaps · Credit risk & Basel capital · Extreme value theory (tail risk)

Actuarial

Life table · Life annuity · Life insurance pricing · Chain ladder reserving · Buhlmann credibility · Survival analysis · Mortality graduation · Aggregate loss model · Ruin probability · Multi-state Markov model · Loss severity fitting

Tests & breaks

Monte Carlo experiment · F-test, Wald & Chow · Structural breaks & stability

Machine learning

Regression vs machine learning · Ridge / Lasso / Elastic Net · Random forest · Gradient boosting

Open the workspace →

Starting engine…

EconStatsCraft rigorous, plain-spoken econometrics

Econometrics that explains itself.

Regression, panel data, time series and the whole battery of tests. Every result is followed by a verdict you can defend.

Load a dataset to see it here.