The Case for Urban Charter Schooling

David Griffith & Michael J. Petrilli

Fall 2020

A decade ago, the charter-school movement was moving from strength to strength. As student enrollment surged and new schools opened in cities across the country, America's first black president provided much-needed political cover from teachers' union attacks. Yet today, with public support fading and enrollment stalling nationwide — and with Democratic politicians from Elizabeth Warren to Joe Biden disregarding, downplaying, or publicly disavowing the charter movement — the situation for America's charter schools has become virtually unrecognizable.

This is a strange state of affairs, given the ever-growing and almost universally positive research base on urban charter schools. On average, students in these schools — and black and Latino students in particular — learn more than their peers in traditional public schools and go on to have greater success in college and beyond. Moreover, these gains have not come at the expense of traditional public schools or their students. In fact, as charter schools have replicated and expanded, surrounding school systems have usually improved as well.

To be sure, the research is not as positive for charter schools operating outside of the nation's urban centers. Furthermore, multiple studies suggest that internet-based schools, along with programs serving mostly middle-class students, perform worse than their district counterparts, at least on traditional test-score-based measures. But like the technologies behind renewable energy (which work poorly in places where the wind doesn't blow and the sun doesn't shine), charter schools needn't work everywhere to be of service to society. And, contrary to much of the public rhetoric, the evidence makes a compelling case for expanding charter schools in urban areas — especially in major cities like New York, Los Angeles, Chicago, Miami, Houston, Atlanta, and San Francisco, where their market share is still relatively modest. Indeed, encouraging such an expansion may be the single most important step we can take to improve the lives of low-income and minority children in America's most underserved urban communities.

It is a particularly cruel irony that many within the Democratic Party — with its historic legacy of standing up for needy urban families — have turned against a policy that could so dramatically improve the lives of their constituents. But despite some Democrats' about-face on charter schools, it is imperative that America's dispirited education reformers — who have experienced more than their fair share of disappointment — not throw in the towel just yet. Although the political climate may now entail a serious fight over charter schools in the coming years, the benefits of such schools make them well worth the effort.

THE EVIDENCE ON URBAN CHARTER SCHOOLS

In general, the most rigorous studies of charter schools rely on data from the randomized admissions lotteries that are conducted when individual schools are oversubscribed, which ensure that research resembles a natural experiment.

With few exceptions, these lottery-based studies have found that attending oversubscribed charter schools is associated with higher achievement in reading and math — especially in large, human-capital-rich cities such as Boston, Chicago, and New York City. For example, a 2011 study of the Promise Academy charter schools in the Harlem Children's Zone found the effects of attendance in middle school were "enough to close the black-white achievement gap in mathematics," while the effects in elementary school were "large enough to close the racial achievement gap in both mathematics and [English language arts]."

If all charter schools were so effective, there would be little to debate. But unfortunately, charter schools that are popular enough to make use of admissions lotteries are likely atypical. Consequently, although studies may tell us something important about the schools in question — and, perhaps, about the potential gains associated with the policies and practices that allow them to do their work — this research can tell us little about the overall performance of urban charter schools.

In an effort to overcome this limitation, many recent studies have used a statistical technique known as "matching" to compare the academic trajectories of students in charter schools to students in traditional public schools with similar characteristics and levels of academic achievement. A 2012 study that used matching found that students in Milwaukee charter schools made more progress in English language arts (ELA) and math than otherwise similar students in traditional public schools, as did a more recent study of students in Los Angeles charter schools.

Although there are many approaches to matching, perhaps the best known in education circles is the virtual control record (VCR) method developed by the Center for Research on Education Outcomes (CREDO) at Stanford University. CREDO has used the VCR method in recent years to generate an extensive collection of national, state-, and city-specific estimates of the "charter effect." In a 2015 analysis of charter performance in 41 urban locations, for instance, CREDO estimated that students who attended a charter school in these cities gained an average of 28 days of learning in ELA and 40 days of learning in math per year. (For the purposes of this discussion, 180 days of learning can be thought of as the progress the average American student makes in the average school year.) Students who enrolled in an urban charter school for at least four years gained a total of 72 days of learning in ELA and 108 days — over half a year's worth of learning — in math.

Notably, these gains were concentrated among low-income black and Latino students. Black students in poverty gained 44 days of learning in ELA and 59 days of learning in math per year. Similarly, Latino students in poverty gained 25 days of learning in ELA and 48 days of additional learning in math. Students with English-language-learner status gained 79 days of learning in ELA and 72 days of learning in math.

Nationally, ELA and math achievement gaps between white students and black and Latino students are roughly two grade levels. So while most charter schools aren't erasing racial achievement gaps, the average urban charter is putting a sizable dent in them.

Since the goal of public education is to serve all students effectively, one key question is whether the success of students in charter schools comes at the expense of their peers in traditional public schools. Yet contrary to the assumptions of many charter-school opponents, there is little evidence that this is the case.

In fact, most of the "spillover" effects that charter schools have on the traditional public schools in their vicinity appear positive — or at worst, neutral. To wit, a recent review of the literature on this question identified nine studies that found positive effects, three that found negative effects, two that found mixed effects, and 10 that found no effects whatsoever. As that summary suggests, evidence that charter competition has salutary effects on district-run schools has now been detected in a wide variety of contexts, from the dense urban cores of Milwaukee and New York City to the sprawling suburbs of Florida, North Carolina, and Texas.

Logically, if urban charter schools have a positive effect on their own students' achievement and a neutral or positive effect on other students' achievement, it follows that their overall effect on student achievement must be positive. To test that hypothesis, researchers at the Thomas B. Fordham Institute recently examined the relationship between the "market share" of local charters — that is, the percentage of publicly enrolled students in a geographic school district who attend a charter school — and the average reading and math achievement of all students (including those in traditional public schools). Overall, the data revealed that an increase in the former was associated with an increase in the latter, especially in black and Latino communities and in the largest urban areas. In other words, at least when it comes to charter schools in America's biggest cities, a rising tide really does lift all boats.

BEYOND ACADEMIC ACHIEVEMENT

While most parents expect their children to leave school with a mastery of critical academic skills and knowledge, the ultimate success of an education lies in the degree to which it empowers students to thrive in adulthood. Consequently, to gauge the true efficacy of charter schools, one cannot simply rely on charter students' performance record based on standard academic tests.

Fortunately, a growing number of studies allow us to examine the relationship between enrollment in charter schools and long-term, real-world outcomes. One evaluation of a high-performing "no excuses" charter school in Chicago found that, compared to their peers, "lottery winners are 10.0 percentage points more likely to attend college and 9.5 percentage points more likely to enroll for at least four semesters." Similarly, in a follow-up study of the Harlem Children's Zone's Promise Academy, researchers found that the same students who had previously experienced large test-score gains relative to their district peers were also "14.1 percentage points more likely to enroll in college." Furthermore, admitted female students were "12.1 percentage points less likely to be pregnant in their teens," while male students were "4.3 percentage points less likely to be incarcerated."

Other lottery-based studies encompass multiple schools. For example, one study found that attending an oversubscribed Knowledge Is Power Program (KIPP) middle school between 2008 and 2011 had a positive effect on post-secondary enrollment. Similarly, a 2016 study found that charter schools "increase pass rates on Massachusetts' high-stakes [high-school] exit exam, with large effects on the likelihood of qualifying for a state-sponsored [college] scholarship," and that they "induce a substantial shift from 2- to 4-year institutions." Finally, a recent study of the Democracy Prep charter network found that it boosted students' odds of voting in the 2016 election by six percentage points.

Like the lottery-based studies of charter schools' impact on achievement, this research doesn't necessarily generalize to all charter schools. However, at least two studies have used matching techniques to estimate the long-term effects of charter attendance for entire cities or states.

The first, a 2011 study of charter schools in Florida and Chicago, found that "among students who attended a charter middle school, those who went on to attend a charter high school were 7–15 percentage points more likely to earn a standard diploma than students who transitioned to a traditional public high school," as well as "8–10 percentage points more likely to attend college." The second, a more recent study of charter schools in North Carolina, found that students who attended a charter high school were "less likely to be chronically absent, suspended, be convicted of a crime as an adult, and more likely to register and participate in elections."

In short, although the literature on charter schools' long-term effects is still developing, the early evidence — like the two studies mentioned above — is extremely encouraging as well as highly consistent with the evidence on charter schools' short-term effects on academic achievement.

RACIAL INTEGRATION

In the absence of any compelling evidence that charter schools' well-established benefits for low-income and minority students come at the expense of students in traditional public schools, the claim that charter schools exacerbate segregation is perhaps opponents' most potent line of attack. And though, as of yet, the evidence is neither dramatic nor conclusive, there is some limited evidence to support this argument.

In a recent literature review, for instance, researchers identified 10 studies of charter schools and racial integration, including two that found they increased integration, five that found no significant effect, and three that found that they decreased integration (i.e., increased or at least preserved segregation). Meanwhile, in the most comprehensive analysis to date, researchers at the Urban Institute found that higher charter market share was associated with a small increase in racial segregation within the average school district. Specifically, the authors estimated that if every charter school in the country was eliminated, racial segregation in the average district would decrease by approximately 5%. However, that same study also found that charter schools reduced segregation between school districts. Consequently, when the analysts looked at segregation across entire metro areas, they found no significant effects.

For some charter skeptics, even the faintest hint of "re-segregation" on any level is intolerable. While this objection to charter schools is understandable, an overemphasis on this dimension of their impact risks missing the forest for the trees.

First, it's important to recognize that American schools are already highly segregated and have been so for the many decades of traditional public-school hegemony. Thus, it's not as if charter schools are derailing an otherwise successful program of racial integration.

Second, much of the most concerning segregation takes place within outwardly diverse schools. For example, if math or other subjects are tracked, pre-existing achievement gaps can and do lead to highly segregated classrooms, even within schools that look integrated on paper.

Third, some research suggests that, because it "decouples" housing and education markets, expanding school choice makes it more likely that white parents will move into "racially segregated urban communities." In other words, even if charter schools do lead to slightly less diverse schools in some places, their arrival may mean that neighborhoods become more diverse.

Finally, it is simply a fact that many "racially isolated" charter schools achieve exceptional results for the minority students they serve. At the end of the day, the argument that charter programs will re-segregate America's schools misses the profound difference between policies of enforced segregation and those that empower black and Latino families to opt out of a system designed by and for the white majority. Parents who choose all-black or all-Latino charter schools that defy society's expectations of failure are hardly modern-day Bull Connors.

CRITICS OF THE RESEARCH

As should be obvious, much of the pro-charter argument depends on the validity of the methodologies upon which researchers have relied (and of CREDO's methodology in particular). So, given how much is at stake, it's worth taking a moment to understand the various criticisms of CREDO's approach, most of which can be summarized in two points.

First, critics claim that CREDO's estimates could be biased by unobserved differences between students in charter schools and students in traditional public schools. In other words, it's possible that the students in charter schools make more progress than "otherwise similar" students (i.e., students with similar demographic characteristics and prior achievement) in traditional public schools because of factors that are hard to measure, like unusually involved parents.

Second, the critics argue that even if CREDO's estimates are unbiased, they might not generalize to other locations or higher levels of charter market share. For example, if the 25% of Boston's black students who are enrolled in a charter school are above average, easier to teach, or otherwise different from the rest of the city's black student population, the same schools that are seemingly serving these students so well might struggle to replicate their results with the other three-quarters of that population. And of course, insofar as the extraordinary success of Boston's charter schools depends on conditions that are not replicable — such as the city's unusually deep reservoir of human capital — it may be difficult to reproduce this success in other locations.

For each of these criticisms, there is a compelling counterargument. For example, when the federal Institute of Education Sciences (IES) evaluated non-experimental methods for studying charter schools, it found that matching studies generated "impact estimates that are not significantly different from the experimental estimates." Other attempts to assess the validity of matching approaches have reached similar conclusions. And in general, it's difficult to overlook the similarities between CREDO's estimates and those generated by other experimental and quasi-experimental studies. Like the CREDO studies, for example, those other studies found increased positive effects for disadvantaged students and students of color, as well as a stark gap between the performance of urban and non-urban charter schools, all of which suggests that CREDO's estimates should be taken seriously.

As for the second criticism, although our knowledge of the opportunities and challenges associated with an exclusively charter-based system is thus far limited to the experience of New Orleans (which made the switch almost overnight following Hurricane Katrina), we now have quite a bit of experience with "charter-heavy" systems, where charter market share is somewhere between 15% and 45%. In general, the evidence collected in such environments suggests that the returns associated with higher charter market share do not necessarily diminish as charter market share increases. For example, one rigorous analysis found that the "average effectiveness of Boston's charter middle school sector increased...despite a doubling of charter market share." And CREDO's 2015 estimates for cities like Detroit and Washington, D.C., were highly positive, despite the fact that charter schools enroll more than a third of the students in these cities. Finally, the evidence suggests that New Orleans's leap of faith led to substantial gains for students — although it's not clear how much smaller those gains would have been if the city had stopped at 50% or 75% charter market share instead of going all the way.

Obviously, even if one takes CREDO's estimates at face value and accepts that there is room for growth in most places, it's still the case that charter performance varies by location. But what this criticism often overlooks is that charter policy also varies by location. So at best, this line of reasoning is a double-edged sword. After all, nothing but politics prevents states and localities from adopting smarter education policies.

IMPROVEMENTS OVER TIME

Collectively, the research discussed makes a compelling case for expanding charter schools in urban areas. Yet that case would be incomplete without a final, critical, and frequently overlooked point: Charter schools (and urban charter schools in particular) have improved since the movement's inception — even as their numbers have increased — and will probably keep improving in the coming years.

The first half of this claim is difficult to contest. For instance, after breaking down previously collected achievement data according to school year, CREDO estimated that students in urban charter schools gained 24 days of learning in reading and 29 days of learning in math in 2008-09. Yet by 2011-12, it estimated that these figures had increased to 41 days for reading and 58 days for math. Similarly, meta-analyses of the lottery-based and quasi-experimental charter-school literature suggest a gradual improvement in overall performance. For example, a 2008 review of 17 lottery-based and value-added studies found "compelling evidence that charter schools underperform traditional public schools in some locations, grades, and subjects, and outperform them in other locations, grades, and subjects." Yet in 2019, the same authors concluded that charter schools had positive effects in the elementary and middle grades, with no statistically significant effects in high school.

Although the causes behind this improvement are complex, it stands to reason that it is at least partly attributable to the inevitable learning process that occurs whenever a new idea is introduced. As skeptics are quick to note, "charter schools" often feels like an unhelpfully broad category. Fortunately, thanks to nearly two decades of research, we know quite a bit about what sorts of charter schools work best, for whom, and under what circumstances. Another landmark CREDO study (and other research) tells us that non-profit "charter management organizations" (CMOs) are, on average, higher performing than for-profit networks or independent "mom-and-pop" charter schools. And numerous studies suggest that "no excuses" schools have had a particularly positive effect on black students' achievement. Finally, as noted previously, we know that charter schools in urban areas outperform those in rural and suburban districts, especially when it comes to serving black and Latino students.

Though it's unlikely to persuade the critics, one obvious implication of all this research is that we should allow high-performing CMOs like KIPP, Success Academy, and IDEA to expand their footprints in major urban areas. And in fact, that's more or less what has been happening in places where charter schools in general have been allowed to grow: Since 2015, the share of newly created charter schools run by for-profit entities has fallen from 20% to around 10%, while the share of new schools run by CMOs has increased to 40%.

Once one starts looking for them, the signs that states and localities are learning from one another's experiences are everywhere. To wit, at least half a dozen cities have now adopted common applications that make it easier for parents to choose from and apply to multiple schools. Or take Texas, which historically has had a relatively low-performing charter sector. In 2013, the Lone Star State boosted funding for its charter schools while also moving to close its lowest performers. Following the law's passage, CREDO's estimate of Texas charter schools' effect on math learning went from negative 17 days per year in 2013 to positive 17 days per year in 2015, with even larger gains for poor students and the state's ever-expanding Latino population.

This improvement is too recent to be reflected in CREDO's national estimates, as are the widely recognized improvements in several other states' charter sectors. But the more important point is that, even after 25 years of "learning" on the part of both states and localities, charter-school policy in most places is far from optimal. Additionally, a 2018 study found that, once the cost of facilities and other unavoidable expenses was taken into account, charter schools received 27% — or about $6,000 — less per pupil than traditional public schools. And in more than a dozen major urban districts — including Atlanta, Baltimore, Cleveland, Detroit, Indianapolis, Los Angeles, Oakland, and Washington, D.C. — it has been estimated that charter schools receive anywhere from 25% to 50% less revenue per pupil than traditional public schools. In other words, urban charter schools are achieving their remarkable results despite spending far less money per pupil than their district counterparts. If and when legislators begin funding charter schools more equitably, one can only imagine the levels of success they — and their students — will achieve.

RENEWING THE PROMISE OF CHARTER SCHOOLS

In recent decades, education reformers have experimented with numerous approaches to boosting the achievement of disadvantaged children of color — from reducing class sizes to insisting that teachers receive "National Board Certification" to investing heavily in failing schools. Yet ultimately, most of these ideas were abandoned because they were politically untenable or, in hindsight, unscalable or ill-conceived. In contrast, the case for charter schools has only strengthened over time — and the experiences of places like New Orleans, Newark, and D.C. suggest we have only begun to realize their potential.

Precisely why urban charter schools work so well for students of color is difficult to say. In theory, freedom from district bureaucracies and teacher-union contracts should allow them to make better hiring decisions, appropriately reward strong performance, and let go of ineffective teachers when necessary. But it's also possible that more intense competition between schools encourages them to make better use of their resources. Or perhaps the periodic closure of low-performing charter schools leads to a gradual improvement in quality. Or maybe allowing more school choice improves the "match" between students and schools in ways that disproportionately benefit at-risk students. Since research supports each of these theories, the best possible answer to the question of causal mechanisms may simply be "all of the above."

Despite what many may have heard, the growth of charter schools is not out of control. To the contrary, where growth has been permitted, it is completely under the control of disadvantaged populations that can now exercise their right to pursue a better education. And despite the overheated rhetoric that dominates public conversation, the truth is that charter schools enroll a modest percentage of students in most major cities. In New York City, for instance, they enroll just one in five black students and one in 10 Latino students. Yet at the start of the 2019-20 school year, nearly 50,000 families in the Big Apple were denied a place in a charter school.

Nationally, roughly one-quarter of black students and perhaps one in six Latino students in urban districts attend a charter school. So how much progress could we make by expanding charter market share for these groups? Although any concrete estimate is subject to criticism, our back-of-the-envelope arithmetic suggests that moving from 25% to 50% charter market share in urban areas could cut the achievement gap in half for at least 2.5 million black and Latino students in the coming decade. And of course, with more equitable funding, improved oversight, and an expanded role for truly high-performing networks, the dividends might be even larger. With so much to be gained for America's most poorly served children, there is simply no reason not to prioritize the expansion of charter-school policies and programs in the years ahead.

David Griffith is a senior research and policy associate at the Thomas B. Fordham Institute.

Michael J. Petrilli is president of the Thomas B. Fordham Institute and a visiting fellow at the Hoover Institution.


Insight

from the

Archives

A weekly newsletter with free essays from past issues of National Affairs and The Public Interest that shed light on the week's pressing issues.

advertisement

Sign-in to your National Affairs subscriber account.


Already a subscriber? Activate your account.


subscribe

Unlimited access to intelligent essays on the nation’s affairs.

SUBSCRIBE
Subscribe to National Affairs.