Skip to main content

Cross-posted at as a more in depth, history/technology-focused expansion of two previous DK diaries, one by peggy and one by chicago DEM

Reported as early as Feb, 2012 in a Slate article titled “Obama’s White Whale”, project Narwhal, Obama’s top-secret campaign project until then, featuring high tech data integration and data mining techniques, promised to change the ways in which campaigns are fought and won.  

It started off as part of the 2008 campaign, when early on, during the first initial steps of the campaign in 2007, each Obama campaign department started creating their own data repositories for the election and voter data they collected. They realized, albeit too late for the 2008 elections, that they were collecting unprecedented volumes of political information, but had no way to study the data together to yield the maximum benefit, which in this case meant, targeting voters in the most effective way and getting them to cast their vote. In 2008:

   Even as the outside world marveled at their technical prowess, Obama campaign staffers were exasperated at what seemed like a basic system failure: They had records on 170 million potential voters, 13 million online supporters, 3 million campaign donors and at least as many volunteers—but no way of knowing who among them were the same people.
So what changed between 2008 and 2012? The implementation of two new projects: Narwahl and Dreamcatcher. Project Narwahl relied on a real time full data integration technology that allowed the campaign to target voters in ways previously only imagined. As the Slate article reported in Feb, 2012:
   Permanently linking the campaign’s various databases in real time has become one of the major projects for Obama’s team this year. Full data integration would allow the campaign to target its online communication as sharply as it does its offline voter contact. When it comes to sensitive subjects like contraception, the campaign could rely on its extensive predictive models of individual attitudes and preferences to find friendly recipients… that might mean pulling email addresses only for those who had identified themselves as women on their registration forms and whose voter records included a flag marking them as likely pro-abortion rights.

The project also helped target undecided voters, as reported in the Applied Data Labs blog:

   The project also helps logistically; last time around when volunteers canvassed neighborhoods they simply went door to door. Now armed with detailed maps about neighborhood residents, canvassers can skip the hardcore supporters on each side and get right to those illusive undecided voters.
As for project Dreamcatcher, the Obama campaign was particularly secretive about this one. From the tids and bits we hear about it, the project seemed to be grounded in Association Rule learning, an algorithm that is also used by popular online stores such as to make recommendations to their customers :
   Hopes and dreams, and fears and frustrations, these are the marketers goldmine. They are the difference between telling you why you should buy something and making you feel that you need to buy it. You see it in the change from a laundry list of features to making a product sexy. This change in marketing is the goal of “Project Dreamcatcher”.
The article by the Applied Data Labs blog finishes with these words:
   Although this article focuses on Obama’s Campaign, you need to realize the Romney camp is trying to do the same thing. The data mining of politics and personalization of political messages is just part of the larger trend in todays society.
Unfortunately for Romney, as we learned just a few days ago, his attempt at anything similar to Narwhal and  Dreamcatcher, project ORCA, was a COMPLETE FAILURE.

Aren’t we happy we did not get THAT president?

If you want to read and commiserate with Romney for such a failed attempt at reproducing or beating Obama’s system, please read the blog entry by John Ekdahl, a web developer and blogger who signed up to be a Project ORCA volunteer, basically a Republican Romney supporter, and the story by another Romney ORCA volunteer, Fat Dave, who called his experience:

    “A failure and an embarrassment. And I sensed it the night before the election, when I called the 800 number for our final conference call and got a busy signal.”
In the blog entry by Ekdahl, comment #567 by a GOP official is an especially devastating account of the failures of Romney's project ORCA:
   The Congressional campaign tried using this list to get voluteers and GOTV, but got many hangups and "why are you calling me, I'm a democrat!" I begged RPV for the usual list of registered voters sorted by precinct, but was told all of that was coming from Romney. It never did.
ORCA is a telling election-day failure for Romney that points to his managerial incompetence.There is no point in discussing the technologies of a failed system, we will therefore not indulge in trying to understand the technology behind Romney’s system, but you are free to read more about it in this ABC article if only to feel pity for the guy or feel relieved that he did not get elected.
Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags


More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site