Evidence Reports

Wested (September 2024) posted an RCT of ASSISTments, a low-cost online tool that assists 7th graders with math independent practice (e.g., homework) and gives teachers real-time reports on student performance. This high-quality RCT found a sizable gain (~31% of a grade-level) in math scores on the state test at 2 year follow-up.

SSRN (October 2024) posted long-term RCT findings for Sourdun, a French “Boarding School of Excellence” for middle and high school students from disadvantaged communities. This high-quality RCT found a remarkable 14 percentage point decrease in the high school dropout rate and 16 percentage point increase in graduation from higher education, 9-12 years after study entry.

Annenberg Institute (January 2025) posted a comparison-group study of a California program to train teachers in the “science of reading.” Despite the study abstract’s claims of positive effects, the study found no discernible impact on 3rd grade English Language Arts (ELA) achievement in its primary analysis.

AERA Open published long-term RCT findings for Early Colleges in North Carolina (providing grade 9-13 students an opportunity to earn an associate degree or college credit during high school). Despite claims of large effects in the study’s abstract, its primary finding was a modest effect (2.4 percentage points, near statistically significant) on the rate of bachelor’s degree completion at the 10-year mark.

NBER (April 2024) posted an RCT of Khoaching with Khan Academy – a program integrating computer-assisted learning into classroom math teaching. Despite the positive portrayal of results in the study’s abstract, it found no discernible impact on the prespecified primary outcome – grade 3-8 math scores on the state test after one year.

Journal of Research on Educational Effectiveness (Sept 2024) published an RCT of City Year's WSWC Tier 2 services (e.g., tutoring, mentoring) for at-risk middle school students. This high-quality RCT, evaluating the added benefit of Tier 2 services over City Year’s schoolwide assistance, found no discernible impacts on student outcomes over 1-1.5 years.

NBER (May 2024) posted an RCT of Saga Technology, a program that provides 9th graders with high-dosage math tutoring and engagement with educational technology. This large, high-quality RCT found sizable gains (~86% of a grade-level) in math achievement on end-of-year district tests.