Teacher Merit Pay and Student Test Scores: A Meta-Analysis (with L. Pham and T. Nguyen) [pdf]
In recent years, teacher merit pay programs have garnered considerable political and financial support, spurring rapid growth in the number of research studies investigating the effects of teacher pay incentives. The burgeoning research literature on this topic presents a novel opportunity to synthesize our understanding of how teacher merit pay influences on student test scores, and this study fills that role as a meta-analysis of reported findings from 44 primary studies. Our meta-analysis finds that the presence of a merit pay program is associated with a modest, statistically significant, positive effect on student test scores – 0.052 standard deviations. We also find that effects sizes are highly sensitive to program design and study context, which suggests that while some merit pay programs have the potential to improve student test scores in some contexts, researchers and policy-makers should pay close attention to how the program is structured and implemented.
Do Unobserved Student Environmental Characteristics Prevent the Unbiased Estimation of Teacher Effects? Evidence from a Twin Study Design (with S. Doan)
In this paper, we address claims that unobserved student environmental characteristics confound and ultimately prevent the unbiased estimation of teacher effects by implementing a novel twin-by-year fixed effect approach that accounts for the influence of any factors that are held common within a pair of twins, within a given year. Because twins are born to the same parents, are very likely to live in the same household, and by construction in this sample, attend the same school and grade, a host of school and household related factors that are often cited as potential confounders (e.g., parental education, parental marital status, computers in the home) in the teacher effects literature are held fixed and differenced out from the estimating model.
Does Incentive Pay Impact Teacher Turnover? Evidence from Tennessee (with L.L. Taylor)
The Obama Administration’s Teacher Incentive Fund and Race to the Top Initiative encouraged many states to experiment with teacher incentive pay. In Tennessee, some school districts developed incentive pay plans that provided teachers with bonus awards while other districts incorporated incentive pay into their salary schedules. This paper uses panel data on individual teachers and instrumental variables regression to examine the impact of those incentive programs on teacher retention. We find that Tennessee’s strategic compensation programs had a significant impact on teacher turnover in participating schools. Teachers who received large awards were significantly more likely to be retained while teachers who received no award were significantly more likely to turn over. On net, turnover rates rose in bonus program schools because there was an increase in the percentage of teachers moving to other districts, not because there was a significant increase in the percentage of teachers leaving the public school system in Tennessee. Furthermore, the teachers who are moving between districts in the wake of the strategic compensation program appear more likely to be teachers with low Tennessee Value Added Assessment System (TVAAS) scores than teachers with high TVAAS scores. This is somewhat disconcerting, as it implies that other districts are absorbing teachers who are somewhat less effective than average. The strategic compensation programs may have had unintended consequences for non-program schools and districts.
Do Evaluation Ratings Affect Teachers’ Professional Development Activities? (with C. Koedel, J. Li, and L. Tan) Evaluation and PD paper
We document substantial differences across teachers who receive different performance ratings from the educator evaluation system in Tennessee in terms of both the intensity of their self-reported professional development activities, and the extent to which these activities are guided by feedback from their performance evaluations. Using a regression discontinuity design, we test whether ratings per se causally influence these gaps and find that they do not. We then perform an exploratory analysis of an alternative mechanism to explain the gaps. Namely, we examine the link between the feedback that teachers receive during classroom observations and their professional development activities, and find a strong association. We conclude that future research in this area should aim to more rigorously test hypotheses that relate teachers’ experiences during classroom observations to their professional development activities.
The Effect of Children’s Health Insurance Expansion on Student Achievement (with W. Swain)
Numerous scholars, policymakers and advocates who favor a “broader, bolder” approach to education policy have argued for the devotion of increase resources to promote student health. The logic is simple. Poor students’ treatable health problems, like asthma or hearing and vision impairment pose serious obstacles to their regular attendance and full participation in the learning environment. However, empirical evidence of the academic benefits of large-scale health interventions remains sparse. In the proposed study, I plan to exploit the overlap between the administration of a nationally representative longitudinal education survey (ECLS-K) and the radical expansion of youth health coverage from the implementation of the State Children’s Health Insurance Program to examine the effects of a health policy intervention on student’s academic success. The findings of the proposed dissertation would be of interest to policymakers interested both in issues of educational equity and access to healthcare. If this study could draw a clear link between interventions to improve student health and improved academic achievement, particularly among disadvantaged subgroups of students, it would highlight a potentially important tool for elevating overall academic performance and combating persistent achievement gaps. Related, if broad reaching, expensive health care expansions are causally linked to even small increases in student achievement, the economic returns of the improved achievement could significantly shift cost benefit analyses of interventions targeting student health.
Student-Teacher Race Congruence: New Evidence and Insights from Tennessee (with E. Joshi and S. Doan)