New York City Small Schools of Choice Evaluation

Overview

The New York City public school system is the largest in the United States, with over 1,200 schools and more than 1.1 million students enrolled each year. For more than a decade, it has also been the site of an unprecedented investment in high school reform. Beginning in 2002 and with the support of the Bill & Melinda Gates Foundation and other philanthropies, the New York City Department of Education (NYCDOE) closed many large, comprehensive high schools with a history of low performance and created hundreds of new small secondary schools. At the same time, the NYCDOE instituted a centralized high school admissions process for matching incoming ninth-grade students to the over 400 high school options available to them.

The small school movement has been a national one. And while nearly every major American urban district has undertaken efforts to create new small schools or to transform large schools into campuses of small learning communities, there has been little rigorous evidence about the effectiveness of small schools.

New York City uses a lottery-like system to assign students when the high schools they choose are oversubscribed. MDRC has been able to take advantage of that system to develop an unusually large and rigorous study of the impact of these small high schools on students’ academic achievement, high school graduation, and progression into college. The project’s reports and policy briefs provide rigorous evidence that new small public high schools are narrowing the educational attainment gap and markedly improve graduation prospects, particularly for disadvantaged students.

Agenda, Scope, and Goals

New York City’s new small high schools — called Small Schools of Choice (SSCs) in this project — are more than just small. They were authorized through a demanding, competitive proposal process designed to attract innovative ideas for new schools from a range of stakeholders and institutions, from educators to school reform intermediary organizations. The resulting schools emphasize strong, sustained relationships between students and faculty. Each SSC also received start-up funding as well as assistance and policy support from the district and other key players to facilitate leadership development, hiring, and implementation.

While the new small schools in New York City have a wide variety of themes and educational philosophies, they are intended to share three common design characteristics:

  • Academic rigor: Schools are expected to be college preparatory in that they move all students toward acquisition of a New York Regents Diploma.

  • Personalization: Schools were to be small not only in size but also in function to ensure strong student-teacher relationships and to hold adults accountable for individual student outcomes.
  • Community partnerships: Through partnerships with business and community partners, schools were intended to offer learning opportunities outside of the classroom and to infuse relevant real-world examples into classroom instruction. Partners were expected to bolster school capacity in areas ranging from curriculum and instruction to youth development and community outreach.

The ongoing evaluation of New York City high school reform addresses the following questions:

  • What effects do the new small schools have on students’ engagement, academic performance, and postsecondary enrollment and degree completion beyond what they would have achieved if they did not have the opportunity to enroll in these schools?

  • How are the small high schools similar to and different from other high schools in the system?

  • What role have intermediary organizations played in effecting change in New York City high schools?

  • What issues and challenges do the schools confront as they undertake new reform initiatives, and how do they respond? What are the instructional practices at a sample of the schools?

Design, Sites, and Data Sources

The impact analysis focuses on the Small Schools of Choice (SSCs) — new, small, unscreened high schools. The path-breaking analytic approach used in the impact study capitalizes on random elements of the NYCDOE’s centralized high school admissions process. Each lottery for a small school of choice is a naturally occurring experiment, which, after some adjustments, makes it possible to produce valid estimates of the effects of enrollment in SSCs on student academic outcomes. The impact study will be the most rigorous evaluation to date on the effectiveness of small schools.

The impact study follows four cohorts of students — those entering high school in the fall of 2005, 2006, 2007, and 2008. The primary sources of data for the analyses are High School Application Processing System (HSAPS) data and school records, which were obtained from the NYCDOE.

The MDRC school characteristics study uses extant data from the U.S. Department of Education, New York State Report Card, and NYCDOE, along with aggregate HSAPS and student records data in a school-level database, to analyze changes in high school options and student enrollment over time. The analyses identify patterns and trends among schools for a number of instruction-related, demographic, and performance-based characteristics by school type as defined by size and selectivity.

A companion qualitative study by Policy Studies Associates examined the roles that intermediaries played in designing and implementing new small schools. The Academy for Education Development has also published case studies of six new small schools that assess the degree to which they implemented best school and classroom practices.