Skip to main content

The No Child Left Behind Act is up for reauthorization. While it is an obvious point that all policies have costs and benefits, it is too often ignored in the NCLB reauthorization debate. This week, in a 3-part series, I'll discuss these costs and benefits. Today I ask whether educational accountability systems improve student achievement, and for whom.

Part 1 of 3 of a series on NCLB. In Part 2, I'll consider the collateral damage of NCLB. In Part 3, I'll discuss the issues around testing special education and English language learners. For more detail and discussion, and links to many of the studies cited below, please see www.eduwonkette.com

Here are my thoughts on three central questions related to today's issue, i.e., "Do accountability systems improve test scores, and for whom?":

  1. Do accountability systems improve test scores (i.e. percentage of students passing state tests)?

Despite both supporters' and opponents' eagerness to tell us how well NCLB is or isn't working based on limited data, the cleanest evidence of accountability systems' effects pre-dates NCLB. This earlier generation of studies examined data from Texas, North Carolina, and Chicago, and found, unsurprisingly, that accountability systems do substantially increase achievement on the state tests themselves. Other studies have looked at the effects of accountability systems on non-state tests. Two studies in particular, comparing NAEP progress in accountability and non-accountability states (again, all pre-NCLB), found that states with public monitoring (in Hanushek and Raymond's 2004 study) or those with stronger accountability policies (in Carnoy and Loeb's 2002 study (available here, #9 under articles) exhibited greater gains. But the gains on state tests consistently outpace those on NAEP, which some have called evidence of test-score inflation. See a recent paper by Brian Jacob here that addresses this issue in Texas.

So it's fair to say that accountability systems do increase test scores, which is different than saying they improve academic achievement. Remember, the test is not an end in itself, but a proxy for the real thing we care about - students' academic skills. The real question, then, is whether these increases translate to other venues in ways that improve students' life chances over the long haul.

  1. Do increases in state tests scores translate into improvements in children's academic skills that generate meaningful improvements in children's life chances?

This question is the crux of the accountability issue, and we unfortunately don't know much about this question - though again, lots of people on both sides claim to. (If I am wrong, please email me references!) Put differently, are kids graduating from high school in Texas and North Carolina, who have gone through the better part of their K-12 educations under NCLB-like accountability systems, more likely to graduate from high school, go to college, and graduate from college than they would been otherwise? Are they more productive workers as a result? Better citizens?

  1. For whom do accountability systems improve test scores, and what are implications of maintaining a "proficiency for all" target?

Proficiency-based accountability systems can lead educators to focus on kids close to the cut score for proficiency. These kids have been assigned a variety of titles, including marginal kids, cusp kids, or bubble kids (see my post here about Derek Neal's Chicago study). Since sanctions are doled out based on passing rates, slightly increasing the scores of a small number of students can help a school make AYP. Such a focus could affect the achievement of both high and low-scoring students. The irony is that in states where the bar for passing is higher, it is more likely that very low-performing kids will lose out under accountability systems, as they are likely to be well below passing.

What about the argument that with 100% proficiency, schools can't pursue this strategy forever? When people face impossible tasks, they focus too heavily on the short-term incentives and not at all on the long-term incentives. The short-term incentive here is to push one more kid over the passing mark. Yes, I am arguing, unapologetically, that 100% proficiency is impossible, that most educators would second that assertion, and that almost all researchers who study school effects would argue this is impossible as well, absent a dramatic change in how American schools, or American society for that matter, do business. The rate of improvement required for 100% proficiency would require schools to improve performance at a rate unlike anything even the top 5% of American schools have ever done. This is the jogger's equivalent of asking an eight minute miler to rev it up to a five and a half minute mile; that someone else can do it is not evidence that everyone can.

Teachers and principals are doing what they can to push forward, but if we stay at a 100% proficiency target, even with growth models, I fear that teachers are going to continue to attend to those close to passing first. This is all a way of answering the "for whom" question: kids at the tails of the distribution - low and high achievers - aren't served well by NCLB's current focus on proficiency. Another response to this is, "Well, it's not NCLB's fault that those bad news bears teachers are doing that." If you believe this is true, you may be surprised to learn that you also agree with the argument that guns don't kill people, people kill people. It's no different.

To sum up - and there's something here for both sides, I think - accountability systems do increase test scores, but they do so most for the kids closer to passing. Stay tuned for installment 2 - on what gets left behind by No Child Left Behind - on Wednesday.

Originally posted to eduwonkette on Mon Oct 01, 2007 at 12:27 PM PDT.

EMAIL TO A FRIEND X
Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags

?

More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

  •  NCLB has its problems (0+ / 0-)

    but acountiblity is quite a benefit. Having taught in a few high schools, I'm convinced that if it weren't for testing, administrators and most teachers wouldn't care if the students learned a damn thing.

    I'm voting for Vinnie!

    by foxfire burns on Mon Oct 01, 2007 at 12:58:54 PM PDT

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site