Assessing an intervention’s effects on multiple outcomes increases the risk of false positives. Procedures that make adjustments to address this risk can reduce power, or the probability of detecting effects that do exist. MDRC’s Reflections on Methodology discusses how to estimate power when making adjustments as well as alternative definitions of power.
To improve outcomes among high-interest borrowers, policymakers need to understand what is driving usage. This second post in MDRC’s Reflections on Methodology series discusses how a data discovery process revealed clusters of borrowers who differed greatly in the kinds of loans and lenders they used and in their loan outcomes.
A Literature Review
Examining the scholarly literature published since a seminal review in 2000, this working paper discusses the principles that underlie project-based learning, how it has been used in K-12 settings, the challenges teachers have confronted in implementing it, and what is known about its effectiveness in improving students’ learning outcomes.
Machine learning algorithms, when combined with the contextual knowledge of researchers and practitioners, offer service providers nuanced estimates of risk and opportunities to refine their efforts. The first post of a new series, Reflections on Methodology, discusses how MDRC helps organizations make the most of predictive modeling tools.
Empirical Guidance for Studies That Randomize Schools to Measure the Impacts of Educational Interventions
This paper examines how controlling statistically for baseline covariates (especially pretests) improves the precision of studies that randomize schools to measure the impacts of educational interventions on student achievement.
Evidence from a Sample of Recent CET Applicants
This working paper examines employment and earnings over a four-year period for a group of disadvantaged out-of-school youth who entered the Evaluation of the Center for Employment Training (CET) Replication Sites between 1995 and 1999. It assesses the importance of three key factors as barriers to employment: lack of a high school diploma, having children, and having an arrest record.
Evidence from Three States
In a study of over 3,500 women in welfare-to-work programs in three states, child care instability did not appear to be a major cause of employment instability.