Clustered standard errors (or Liang-Zeger standard errors)[1] are measurements that estimate the standard error of a regression parameter in settings where observations may be subdivided into smaller-sized groups ("clusters") and where the sampling and/or treatment assignment is correlated within each group.
[2][3] Clustered standard errors are widely used in a variety of applied econometric settings, including difference-in-differences[4] or experiments.
[5] Analogous to how Huber-White standard errors are consistent in the presence of heteroscedasticity and Newey–West standard errors are consistent in the presence of accurately-modeled autocorrelation, clustered standard errors are consistent in the presence of cluster-based sampling or treatment assignment.
For example, suppose that an educational researcher wants to discover whether a new teaching technique improves student test scores.
When analyzing her results, she may want to keep the data at the student level (for example, to control for student-level observable characteristics).
However, when estimating the standard error or confidence interval of her statistical model, she realizes that classical or even heteroscedasticity-robust standard errors are inappropriate because student test scores within each class are not independently distributed.
Instead, students in classes with better teachers have especially high test scores (regardless of whether they receive the experimental treatment) while students in classes with worse teachers have especially low test scores.
The researcher can cluster her standard errors at the level of a classroom to account for this aspect of her experiment.
[7] While this example is very specific, similar issues arise in a wide variety of settings.
For example, in many panel data settings (such as difference-in-differences) clustering often offers a simple and effective way to account for non-independence between periods within each unit (sometimes referred to as "autocorrelation in residuals").
[4] Another common and logically distinct justification for clustering arises when a full population cannot be randomly sampled, and so instead clusters are sampled and then units are randomized within cluster.
In this case, clustered standard errors account for the uncertainty driven by the fact that the researcher does not observe large parts of the population of interest.
[8] A useful mathematical illustration comes from the case of one-way clustering in an ordinary least squares (OLS) model.
Consider a simple model with N observations that are subdivided in C clusters.
vector of unexplained residuals: As is standard with OLS models, we minimize the sum of squared residuals
: From there, we can derive the classic "sandwich" estimator: Denoting
yields a potentially more familiar form While one can develop a plug-in estimator by defining
Given the assumptions that a practitioner deems as reasonable, different types of standard errors solve this problem in different ways.
For example, classic homoskedastic standard errors assume that
is diagonal but that the diagonal value varies, while other types of standard errors (e.g. Newey–West, Moulton SEs, Conley spatial SEs) make other restrictions on the form of this matrix to reduce the number of parameters that the practitioner needs to estimate.
is block-diagonal according to the clusters in the sample, with unrestricted values in each block but zeros elsewhere.
and derive the following mathematical fact: By constructing plug-in matrices
While no specific number of clusters is statistically proven to be sufficient, practitioners often cite a number in the range of 30-50 and are comfortable using clustered standard errors when the number of clusters exceeds that threshold.
Alternatively, finite-sample modifications are also typically used, to reduce downwards bias
due to finite C.[9] Thus, the resulting bias corrected estimator follows the form: