Evidence Reports

The Annenberg Institute (October 2024) posted an RCT of Choose to Change, a group therapy and mentoring program for at-risk teens. Despite the study abstract’s claimed effects on youth crime, the study found no discernible impact on its preregistered primary measure of crime – number of youth arrests – over 3 years.

An RCT of a cash transfer program for individuals experiencing homelessness, published in the August 2023 Proceedings of the National Academies of Sciences (PNAS), portrays its results as positive despite finding no discernible impact on any of the study’s pre-registered primary or secondary outcomes.

NBER (April 2024) posted an RCT of Khoaching with Khan Academy – a program integrating computer-assisted learning into classroom math teaching. Despite the positive portrayal of results in the study’s abstract, it found no discernible impact on the prespecified primary outcome – grades 3-8 math scores on the state test after one year.

An RCT of the Chicago Heights (CHECC) preschool program, published in Journal of Political Economy (December 2024), portrays results of its grade-school follow-up as positive despite finding no impact on the preregistered primary outcome – state test scores in English and math.

Development & Psychopathology (December 2022) published an RCT of a program that provides home visiting and doula visits to low-income women starting in pregnancy. Despite the positive portrayal of results in the study’s abstract, the study found no discernible impact on child outcomes and little impact on parent practices, at age 30 months.