Skip to main content

How did the largest and most aggressive federal education initiative, No Child Left Behind (NCLB), garner bipartisan support under George W. Bush, and how have the central tenets of that legislation—accountability, standards, and testing—maintained and increased their value as approaches to education reform despite the tremendous evidence that they do not work?

One answer may lie in the power of claims that NCLB and the accountability paradigm are "evidence-based," scientific, and thus objective (as objectivity has endured as a central aspect of authority in the American mind for at least a century).

Two parts of this possible answer deserve some consideration: (1) Are evidence-based scientific approaches objective, effective, or both? and (2) If so, why does science fail education reform?

Scientific Education Reform: A Historical Perspective

Before examining how science as a term and concept functions in the American mind, we must acknowledge the tendency to respond to any information without historical context. While it may be alluring to view NCLB's call for "evidence-based" approaches to education reform as both something already proven (it was based on Bush's education policy in Texas when he was governor and future Secretary of Education Rod Paige was his superintendent) and something "new," or at least a departure from the oft-used criticism of public education, the "status quo," both assumptions are misleading.

Kliebard, in his examination of education in the U.S. throughout the first half of the twentieth century, details that at least four different ideological perspectives battled for control of the American public education system, but what is most important for my discussion here is that all four competing ideologies pursued and argued for a scientific (and thus evidence-based and objective) approach to creating and maintaining an education system.

Notably John Dewey, as a leading voice of progressivism, and the efficiency educators, who pioneered and entrenched our obsession with measurement, both proclaimed science and the scientific method as essential for public schools that would serve the American people well. And herein lies a key for understanding NCLB, its power and its failure: Claims of "objective" and "scientific" always occur within contextual and cultural assumptions even as both depend on a faith in their not being contextualized to garner their power.

Again, if we return to Dewey and the efficiency educators, we note that they shared a pursuit of scientific but represent competing ideologies; what appeared scientific to Dewey didn't appear scientific to the efficiency advocates because Dewey tended (at the risk of oversimplifying) to look at the child while the efficiency educators focused on the data.

As well, once we place NCLB in historical context, we also discover that calls for higher standards for student learning, greater and better measurement, and stronger accountability from our teachers and our schools have occurred repeatedly and persistently over the past century; in short, NCLB's essential elements of reform are in fact nothing new—and have proven, ironically in the evidence, never to achieve the goals that the accountability paradigm promises.

Science in a Belief Culture: Reform in the Eyes of the Beholder

Howard Gardner has shown that the adolescent mind is nearly obsessed with fairness, and his work also suggests that each of us embodies the different minds we pass through in our development. In other words, I believe humans are often nearly blinded with the adolescent pursuit of fairness, to the exclusion of fairness itself. That faith in and seeking out fairness may be central to our equally blind faith in the possibility of and value in "objectivity"—even when the evidence itself reveals that objectivity is neither possible nor desirable.

Why is evidence so ineffective then?

Similar to research examined by Keohane and the central arguments offered by Malcolm Gladwell in Blink, Mooney examines the evidence from psychology that reveals the power of belief to drive people to the evidence they want to see in order to confirm what they already embrace as truth and Truth:

"It would seem that expecting people to be convinced by the facts flies in the face of, you know, the facts....In other words, when we think we're reasoning, we may instead be rationalizing. Or to use an analogy offered by University of Virginia psychologist Jonathan Haidt: We may think we're being scientists, but we're actually being lawyers. Our 'reasoning' is a means to a predetermined end—winning our 'case'—and is shot through with biases. They include 'confirmation bias,' in which we give greater heed to evidence and arguments that bolster our beliefs, and 'disconfirmation bias,' in which we expend disproportionate energy trying to debunk or refute views and arguments that we find uncongenial."

Even when we claim "scientific" and "objective," we are in fact functioning within belief paradigms and advocacy positions, thus contradicting the very paradigms we are seeking.

"Sure enough, a large number of psychological studies have shown that people respond to scientific or technical evidence in ways that justify their preexisting beliefs," explains Mooney, offering the evidence we need to begin to understand why the accountability paradigm at the center of NCLB—and now Race to the Top (RttT) and even opting out of NCLB under Obama—remains both powerfully alluring to education reformers and persistently ineffective: "In other words, people rejected the validity of a scientific source because its conclusion contradicted their deeply held views—and thus the relative risks inherent in each scenario"; acceptance or rejection of evidence results from imposing beliefs on the evidence, not drawing conclusions from the evidence.

Also problematic is that attempts to reason with or make a case using evidence proves to have the opposite impact we would assume given our professed faith in evidence-based science, as Mooney explains:

"And that undercuts the standard notion that the way to persuade people is via evidence and argument. In fact, head-on attempts to persuade can sometimes trigger a backfire effect, where people not only fail to change their minds when confronted with the facts—they may hold their wrong views more tenaciously than ever."

If we focus on the education reform debate, then, for example, when advocates for Teach for America (TfA) and KIPP charter schools (such as they are portrayed in Waiting for "Superman") present reports from either TfA or KIPP, they are likely to find the advocacy from both as compelling—regardless of the nuance or conclusions any skeptics of TfA or KIPP may offer.

As another example, many of the most widely cited and discussed studies on charter schools are simultaneously used as evidence for those opposing and those rejecting charter schools.

In other words, when it comes to scientific evidence, the evidence shows that reform is in the eyes of the beholder.

Why Evidence-Based Education Fails

Let's return to the questions I posed in the opening: (1) Are evidence-based scientific approaches objective, effective, or both? and (2) If so, why does science fail education reform?

To answer the first question, we have to perform some mental gymnastics that fly in the face of what I have discussed above: Many people will never consider the answer if it pushes against what they already believe. And since I have made the case that the American mind has already fully embraced the power and possibility of objectivity, to make a case against objectivity is likely futile.

But that is the answer to question one.

Evidence and the scientific method are both powerful, but to suggest that they are "objective" or that we can somehow make them objective is deceiving and ultimately corrosive to the possibility of both. The central failure of framing human behaviors as "objective" is assuming that the human element is something to be avoided and something that can be avoided. I find the first premise distasteful and filled with self-loathing (our humanity is something to be treasured, not rejected), and I find the second premise a strategy of those in power to maintain their power.

In short, the aura of "objectivity" is always how the evidence matches the cultural norms of any people, and cultural norms are the paradigms reflected in and perpetuated by those in power. The powerful achieved their power within the norms they believe are "right" and thus feel compelled to perpetuate them both to maintain their status as winners and to confirm their deserving (or having earned) their status (and although rarely stated, to confirm that the losers deserve to be losers).

And now question two: Scientific education reform couched as evidence-based initiatives has always and will always fail education unless we re-imagine both "scientific" and how we respond to evidence.

First, we have historically and currently failed to start with both clearly examined and defined problems and goals in education. Again, as I noted above about Dewey as his progressivism contrasted the efficiency educators, if we shift the problems and goals, the evidence suggests different outcomes. Evidence never is and never can be decontextualized, and that pursuit is what is failing the value of science and education in school reform.

It isn't that data do not matter; it is how careful and transparent we are being with that data in the context of problems and goals for the solutions.

Next, then, after we establish the problem to be solved (How well are students learning in our schools and what do we mean by "learning"?) and the goals we hope to attain (Is public education intended to fuel our workforce or support our democratic ideals?), we must examine ways to seek the goal of "objectivity" (truth and Truth we can depend on for the good of all without the oppressive nature inherent in subjectivity in the hands of a powerful elite) while rejecting the traditional view of "objectivity" that is not supported by the evidence of human history.

Education Reform in the Twitter Era: Clustering Belief as Fact

NCLB is the logical extension of the accountability era begun in the early 1980s by a deceptive report, A Nation at Risk, that simply packaged Reagan-era ideology as science to tell the America people what they already believed: U.S. public schools were failing and as a result so was the U.S. internationally. Politicians seized on this moment and turned popular belief into political capital.

We now sit a decade into NCLB and three decades removed from A Nation at Risk—and no wiser than at any point in the past century in terms of what our schools should be accomplishing, what our schools are accomplishing, and how all that fits into the wider social and political debates. As the evidence shows, we are amazingly like Reagan as a Teflon people to whom facts don't stick. Instead, we impose our will on the world.

One final point offered by Mooney should give us pause as we seek ways to evaluate our students, teachers, and schools as the evidence we need to reform our education system:

"Okay, so people gravitate toward information that confirms what they believe, and they select sources that deliver it. Same as it ever was, right? Maybe, but the problem is arguably growing more acute, given the way we now consume information—through the Facebook links of friends, or tweets that lack nuance or context, or 'narrowcast' and often highly ideological media that have relatively small, like-minded audiences. Those basic human survival skills of ours, says Michigan's Arthur Lupia, are 'not well-adapted to our information age.'"

Social media and instant information may be the logical extension of how humans evolve as processors of data—both maximizing our impressive human ability to think and our fatal flaws to use that evidence to reinforce our beliefs, regardless of what that evidence reveals.

Universal public education—like the allure of "objectivity," "science," and "evidence"—holds either certain failure or unimaginable promise, depending on our human ability to recognize context and nuance.

Ironically, despite the warning of Mooney above, I have seen a message begin to rise within the twitter and blog world, such as the work of Bruce Baker and Matthew Di Carlo, both of whom use their blogs and twitter to caution against snap judgments about data and to emphasize the complexity of data in the face of education reform.

Evidence and the careful attention to detail inherent in the scientific process do matter, but as Mooney cautions: "In other words, paradoxically, you don't lead with the facts in order to convince. You lead with the values—so as to give the facts a fighting chance."

Instead of masking poses of objectivity, culturally, politically, and educationally, we need to be transparent with our contexts, as Kincheloe explains, by offering a critical pose that is simultaneously transparent and self-conscious:

"[P]roponents of critical pedagogy understand that every dimension of schooling and every form of educational practice are politically contested spaces. Shaped by history and challenged by a wide range of interest groups, educational practice is a fuzzy concept as it takes place in numerous settings, is shaped by a plethora of often-invisible forces, and can operate even in the name of democracy and justice to be totalitarian and oppressive....Recognition of these educational politics suggests that teachers take a position and make it understandable to their students. They do not, however, have the right to impose these positions on their students [emphasis in original]....In this context it is not the advocates of critical pedagogy who are most often guilty of impositional teaching but many of the mainstream critics themselves....Critical pedagogy wants to know who’s indoctrinating whom."

In the comments above, Kincehloe's explanation about critical teachers offers the same possibility for critical researchers and a critical public.

NCLB, RttT, and opting out of NCLB are then ample evidence that we are failing the possibility of scientific and evidence-based education and education reform. If we find a way as political leaders and as a public to fully recognize our humanity instead of seeking to decontextualize the evidence from the exact circumstances we hope to improve, we will likely discover the inevitable intersection of science, humanity, and democracy that has been facing us all along.

Evidence-based education reform fails because we refuse to start with the problems and we fail to acknowledge the goals we are seeking. Public education is not suffering a lack of standards, testing, and accountability; thus, we are wasting valuable time and energy and proving Mooney correct: "All we can currently bank on is the fact that we all have blinders in some situations."

Education reform is one such situation.

References

Keohane, J. (2010, July 11). How facts backfire. The Boston Globe.

Kincheloe, J. L. (2005). Critical pedagogy primer. New York: Peter Lang.

Kliebard, H. M. (1995). The struggle for the American curriculum: 1893-1958. New York: Routledge.

Mooney, C. (2011, May/June). The science of why we don't believe science. Mother Jones.

Originally posted to plthomasEdD on Mon Dec 19, 2011 at 08:30 AM PST.

Also republished by Education Alternatives.

EMAIL TO A FRIEND X
Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags

?

More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

  •  Shouldn't you provide evidence? (3+ / 0-)

    Surely you don't expect us to take "Evidence-based Education fails" as a given?

    This whole diary sounds vaguely like a rant against the scientific method and empiricism in general.

    •  Cited throughout (0+ / 0-)

      What evidence do you not see? Or do you not see evidence because you see only what you want to see?

      (See the evidence on seeing only what we want to see in the article.)

      •  The only "evidence" I see cited... (1+ / 0-)
        Recommended by:
        saCardinal

        ...is a NYT editorial regarding problems with testing reliability in NYC.  That's not only anecdotal, it's also a single data point.  Even if it is correct, that's only an as-applied criticism to evidence based teaching.

        Other than that, it's mostly links to Mooney ranting about how we shouldn't pay attention to pesky "facts" and "data."  Mooney being, as far as I can tell, just some dude who writes books about essentially the same subject.

  •  plthomasEdD, what alternative do you purpose? (0+ / 0-)

    The issue is not which approach is perfect, but which approaches clearly work better than the rest.

    If not evidence based education, what do you propose instead, and what is your basis for asserting your proposed alternative is better?

    The most important way to protect the environment is not to have more than one child.

    by nextstep on Mon Dec 19, 2011 at 09:09:39 AM PST

    •  Your Q misses my point (2+ / 0-)
      Recommended by:
      Arsenic, kait

      I am asking that we start with a clearly addressed problem, identify a clear goal (we do neither), and then gather evidence, but recognize the inherent flaws associated with human perception of evidence.

      I am asking us to take a step back from "objectivity" (since there is none) and admit the human element.

      I am in fact suggesting perpetual experimentation; use evidence to proceed, but do so cautiously and carefully (not knee-jerk and with our blinders on as we do now).

      As I state in the piece, I believe we have failed evidence-based reform; as we have failed public education—not the other way around.

  •  NCLB was never about improving education. (2+ / 0-)
    Recommended by:
    plthomasEdD, kait

    Education has become a political battleground.  Conservatives want to end public education and NCLB was devised as the means to do so.  It is mathematically structured to result in the overwhelming number of schools to be labeled failing in order to lay the groundwork for a transition to vouchers, public funding of religious schools and privatized education.

    For the points you make with respect to values and beliefs being determinant over evidence the NCLB act is exhibit A.  Like balancing the budget, almost everything we need to understand about educating children is known, but proper solutions are "off the table" before the process of deciding how to "fix" the problem can be discussed.

    We, this country, as political leaders and the public will continue to bend in whatever direction provides the most convenient scapegoat and the easiest sounding remedy.  That is who we have become.

  •  question from a layman/college drop-out (1+ / 0-)
    Recommended by:
    Still Waters

    I'm not very well educated (my own fault), but I was well trained. That really sucks for me. I've tried to correct it.

    Is this suggesting that the emphasis has been on "training" our young students rather than "educating" them?

    Or do I still not get it?

  •  Case in point (1+ / 0-)
    Recommended by:
    plthomasEdD

    The evidence gathered thus far indicates that the increased use of technology in the classroom has no measurable impact on test scores (I refuse to use the term "student achievement" when we are only using test scores to measure achievement).

    The Obama administration then declares that the impact of technology can not be measured by a test. Of course these folks insist that these same tests can accurately measure teacher effectiveness.

    Data is only valid when it supports their preconceived POV.

    A proud member of the Professional Left since 1967.

    by slatsg on Mon Dec 19, 2011 at 02:40:30 PM PST

    •  I worked on a technology plan (1+ / 0-)
      Recommended by:
      slatsg

      for my daughter's school. This is a document where you are supposed to declare what you would use technology money for (replacing 5 year old computer systems), and "how it will raise student achievement" how much it would raise "achievement" (!!!) and how you will measure that it does.

      It's the last that had us all scratching our heads. This group - serious educators who really wanted to write something that was a responsive and true and scientifically defensible answer - was stumped.

      We were all getting a little punchy, and so I said, with a twinkle in my eye, "Let's write that we'll only share the technology with half the kids so we can compare the scores between the two groups."

      We all cracked up. And then we wrote something obviously mealymouthed and foolish, because what else could you do? (Seriously, that's not a rhetorical question. We would have loved to answer it better.)

      One of the initiatives on the California ballot, if my fears are correct, would expect this kind of analysis for every line item in the budget. "How does having bus service raise student acheivement?" "How does $10,000 from the general fund to the cafeteria raise student acheivement?" "How does paying someone to clean the bathrooms and repair the plumbing raise student acheivement?"

      Ah, I can hardly wait.

      Fry, don't be a hero! It's not covered by our health plan!

      by elfling on Mon Dec 19, 2011 at 03:37:51 PM PST

      [ Parent ]

      •  Well ... The answer to the last one is easy. (0+ / 0-)

        You don't need any adult to clean the bathrooms. Just hire some poor kids to do it.

        We've had to fill out the same types of grant applications.
        This is the value-added idiocy that is the rage in "reformist" circles.  The craziness has no end. Here in Michigan some are actually proposing that we evaluate art and music teachers based on the English and math scores of their students. Beyond stupid.

        A proud member of the Professional Left since 1967.

        by slatsg on Mon Dec 19, 2011 at 04:42:58 PM PST

        [ Parent ]

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site