Categories

Report: Technical Methods Report: Estimation and Identification of the Complier Average Causal Effect Parameter in Education RCTs

pdf

Categories

RESEARCH

Areas

PRACTITIONER:group practice and professional learning

Authors

Peter Z. Schochet

Published

2009

Publisher

National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education

Abstract

In randomized control trials (RCTs) in the education field, the complier average causal effect (CACE) parameter is often of policy interest, because it pertains to intervention effects for students who receive a meaningful dose of treatment services. This report uses a causal inference and instrumental variables framework to examine the identification and estimation of the CACE parameter for two-level clustered RCTs. The report also provides simple asymptotic variance formulas for CACE impact estimators measured in nominal and standard deviation units. In the empirical work, data from ten large RCTs are used to compare significance findings using correct CACE variance estimators and commonly-used approximations that ignore the estimation error in service receipt rates and outcome standard deviations. Our key finding is that the variance corrections have very little effect on the standard errors of standardized CACE impact estimators. Across the examined outcomes, the correction terms typically raise the standard errors by less than 1 percent, and change p-values at the fourth or higher decimal place.

Files