Skip to main content

Yesterday I looked at the presidential predictions. Today I'm looking at the Senate ones, with focus on those of us, individuals or aggregators, who made predictions on the victory margins.

Below are the predictions and average error for me, Nate Silver, Sam Wang, and the Huffington Post, Real Clear Politics, and Talking Points Memo aggregators.

The orange cells are the best calls for each race. The garish red and blues are races were the predictor got the wrong victor. So I erroneously thought Democrats would win Nevada and Republicans would win North Dakota.

Nate, RCP and I each got two of the 16 races wrong. Sam Wang, HuffPo, and TPM didn't get any wrong. Wang didn't make predictions on all of these races, just the ones that looked closest, so his perfect record is worth as much as anyone else's.

I may have had the lowest average error, but missing two races disqualified me from the crown. So of the people who called all the winners correctly, the winner is ... Huffington Post by a sliver.

A few quick notes:

I really don't understand why anyone respects RCP. They cherrypick polls and have a crap methodology. It wasn't so much that they missed two races, since both they missed were hard-to-call ones, but their average error (just like in the presidential results) is far beyond anyone else's.

The error margins are far bigger here than in the presidential race, and the reason is simple: There was far fewer polling for these races. The more polling, the more accurate the aggregation becomes.

Three of us got the North Dakota Senate race wrong. Silver only gave Democrat Heidi Heitkamp an 8 percent chance of winning! Or put another way, Republicans had an 92 percent chance of picking up the seat. So yeah, that was a crazy one. I went back and looked at the polling to see what I missed. Not much—much of the polling was either partisan (Dems had themselves +4, Rasmussen had GOP up +5, and they were both wrong), or unproven. This fresh new Pharos Research outfit had Heitkamp up +2, but they also had the Democrats trailing by just 2.7 in the Nebraska Senate race they lost by 16.2. They weren't looking very credible. But ultimately, even TPM composite had Heitkamp at 46, while HuffPo had her at 47.9. In a Red state, Heitkamp should not have gotten the undecideds, but she's a spectacular politician and somehow pulled it off.

Look how far off everyone was in Missouri. Most polling had the race close, but there were two standouts: SuveyUSA gave McCaskill a 15-point lead, DSCC internals had it at 12, while McCaskill campaign internals had it at 14. They seemed optimistic at the time, but they nailed it. For comic relief, the Republican pollsters at Wenzel Strategies, polling for Citizens United (yeah, that Citizens United), had Akin up four points at the same time as that McCaskill internal. It must've taken some serious unskewing to get those numbers.

I'm still struck by the wide disparity in many of these races among the pure poll aggregators (HuffPo, RCP, TPM). Just because someone says they're averaging out all the polls doesn't mean that they're doing it the same way. Or put another way, RCP really, really sucks.

Originally posted to kos on Thu Dec 13, 2012 at 10:21 PM PST.

Also republished by Daily Kos.


Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags


More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site