Skip to main content

All of the metadata sucked up by the NSA came from corporate servers, not our home computers.  If we claim to fear Big Brother, it would be good to clarify his identity or, more important, for whom he is working.

Big Brother in the Data Mines

By Steve Russell

One of the television talking heads really hurt my feelings in a report the other night on Edward Snowden, the traitorous hero or heroic traitor who leaked the existence of PRISM, wholesale collection of data from the servers of various major players on the Internet.  Not once but twice, he demanded to know how a 29-year-old high school dropout could become a computer jock for the National Security Agency with a top-secret clearance?

I was once an 18-year-old high school dropout who was a computer jock for the NSA (USAF branch) with a top-secret clearance.  In the three years I worked up to my elbows in top secret intelligence, I can remember two items the leaking of which would have landed the news on the front pages along with the leaker in the pokey.

We were all told regularly and often what the consequences of revealing classified information would be.  Would I have done that?  I like to think I would if the public interest in the information clearly outweighed my own safety, but that circumstance never came up, so I can’t know.

Spying on the retail level has been part of war on this continent at least since the pueblos pulled off a sneak attack that sent the Spanish colonists all the way back to El Paso del Norte, licking their wounds.

Spying on the wholesale level awaited technology, not intent.  Governments had always tried to gin up networks of informers, some of which became famous in history and did the job for a period of time.  Scholars estimate that one in seven East Germans informed for the Stasi on some level.  People, over time, seem to revert to their own values over those imposed by government, and so become less reliable as informers.  People lack the discipline of computers.

During WWII, Bletchley Park began to move warfare into the digital age.  Communication had for some time been by wire and by broadcast, and so intelligence became a contest between code makers and code breakers in, as the computer geeks say, real time.

One obvious method of code breaking is to archive and collate vast numbers of messages and look for patterns.  This became possible by entrusting analysis to Alan Turing’s mathematics, which became the Allies’ ACE (“Automatic Computing Engine”) in the hole.

Once the algorithms were written, the issue became how to capture and store mountains of communication data.  We’ve been living for some time in the world set out in Moore’s Law, which predicts that computing power will double every two years, a proposition that obviously has mathematical limits we have yet to reach.

By the time the calendar turned over the date that gives the title to George Orwell’s dystopian novel, 1984, the technology was possible for Big Brother to be watching us.  When the date whizzed by with no more notice than Y2K, some of us wondered whether the American people, like Winston Smith, had learned to love Big Brother?

Apparently, not all people share amorous attachment to the government, since the sales of Orwell’s novel have spiked with the revelations about PRISM.

This Okie teenager who got his top-secret clearance in 1965 learned his trade on computers that stored data in kilobytes.  When we moved to intelligence, we were dealing with megabytes.  There were rumors about gigabytes, like the computer in my home on which I compose this column.  Today’s NSA is storing data in yottabytes.  That is, a septillion bytes.

We are told PRISM collects “metadata,” not identifiable to individuals or even organizations.  Numbers called to and from, length of call.  Not content.  Not even who made the call.

Excuse me, but how would it help catch terrorists if it could not be focused on individuals or organizations?  Back when I did this, just about everything we had in the computer was from communications intercepts and aircraft sorties.  Collating that told us all kinds of useful things about our adversaries.

The question how many data points it takes to focus on an individual is not one of opinion but one of mathematics, and the number of data points is directly related to the level of certainty we demand.  In the case of cell phone metadata, there’s some evidence that a mere four hits on the same number can identify 95% of individuals. Because published studies in scientific journals are limited, that could be wrong, but the fact remains that the question is not one of opinion, but of mathematics.

By cross referencing telephone and internet metadata with bank records, which are already in electronic form and do not require a search warrant to access, the NSA can discover things about you that your parents may not know.

We are told that the metadata can be accessed from the desktop computer of any analyst who has the proper clearance.  You know, like the one I had at age 18?  Let’s not give Big Brother too much credit for having his attention focused on us, but let’s not pretend that it’s impossible or that the right hand always knows what the left hand is doing when thousands of people have access to yottabytes of data.

Big Brother does not care about you, but he cared enough about Martin Luther King, Jr., to bug his motel room, a laughably primitive method.  He cared enough about the Black Panther Party and the American Indian Movement to insert double agents, which is also kind of labor intensive and old fashioned.

If the United States is data mining on this level, what do you think China and Russia are doing?  China in particular has pulled off some hacks into corporate databases that left me scratching my head.

This is not an argument to shut down PRISM, assuming that would be possible given the resources already invested in storage.  Consider this a weather report, since, after all, the databases being mined were already in corporate hands before the government touched them.  I’m unclear that maximizing shareholder value is a less dangerous imperative than maintaining a government in power.

“You don’t need a weatherman to know which way the wind blows.”

Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags


More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

  •  A thoughtful analysis. (2+ / 0-)
    Recommended by:
    Superskepticalman, CroneWit

    I don't really think that it is a question of private corporations or the government. One thing that these revelations point is how much they are joined at the hip.

    I really don't know what guarantees of privacy we can expect in a world where our lives are becoming ever more wired. We can at least ask questions, and remember that anybody who says trust me bears close watching.  

    •  Likewise, thoughtfully done. (n/t) (1+ / 0-)
      Recommended by:

      "There's a conceptual zone within which the romanticized historical past and the immanentizing historical future converge in a swamp of misapprehension and misstep. It's called 'the present'." - David Beige

      by Superskepticalman on Sat Jun 29, 2013 at 03:12:13 PM PDT

      [ Parent ]

    •  As to guarantees... (0+ / 0-)

      I'll guarantee that your data is safe with me, or your money back.  Since I don't have any of your data (except your DailyKOS moniker), and since you haven't paid me any money, it's a safe bet either way.

      Beyond that, if somebody wants to guarantee you that no FBI or CIA operatives can break into your house and steal your bankbook and credit card statements, or that no one will get your online data from you bank, phone company, ISP, smart money would bet against him/her.  If the technology exists, it'll get used.  Best get used to it.

  •  How to stop digging or exporting coal? (0+ / 0-)

    Lobby Peabody's major shareholders?  How?  California has law forbidding the purchase of any electrons from coal-fired power plants....

    This is us governing. Live so that 100 years from now, someone may be proud of us.

    by marthature on Sat Jun 29, 2013 at 03:56:45 PM PDT

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site