Skip to main content

The long-awaited update is finally uploaded to Dave's Redistricting App. In summary, these are the states with revisions.

2008 presidential data has been added for Kentucky, Massachusetts, and West Virginia.

Revised 2008 presidential data has replaced the previous data for Georgia, Idaho, Maryland, Nebraska, Ohio, Oklahoma, and Tennessee.

I'll go over the revisions after the fold.

I have not yet had a chance to review the uploaded data so if anyone catches anything that looks like an error, please let me know. It may be a few days before I have a chance to review all of the uploaded data myself.

Meanwhile, this is what I'll be working on next.

Arkansas: I have a full 2008 precinct data set but it needs a good bit of prep work to translate it into the DRA voting districts. I simply have not had a chance to get to it. Unfortunately for Arkansans, it's not a swing state in this election nor does it have any competitive congressional races, so it's low on my priority list.

Florida: I want to add the minor party figures. This is now the only state I've done in full where they're missing. It's not high on the priority list, so I don't know if this will be in the next round of updates or in the one after that.

Iowa: I finally got a full statewide set of precinct shapefiles on Tuesday. This should now be a fairly quick state to complete. The main issue with Iowa is that rural election precincts are divided into multiple voting districts for census purposes, so there was no viable way for me to do it without 2008 precinct maps.

New Jersey: I had hoped to have the long-overdue NJ fix ready for this update. I've done a lot of work on New Jersey as it is. Tragically, my underlying data set got corrupted (short version: the formulas I use to cross check municipality totals with official results somehow got scrambled into the data itself). Anyway, I hope to rebuild my data set and wrap up the revision late next week.

Virginia: To my knowledge, the discrepancies are not major, and mostly involve missing early votes. I've collected the data I need for a revision. I just haven't had a chance to revisit the state. It's high on my to-do list though since it's a swing state. I'll probably do it before I go back to New Jersey, even though the NJ errors are far more extensive.

Now, here's a recap of the revisions.

Georgia: The previous file on DRA was a 'hack' where absentees were distributed based on voting age population. The new data distributes absentees by the same formula that I've used for a handful of other states where early vote data is not provided by precinct. My formula distributes absentees based on the proportion of each candidate's countywide election day votes received from each precinct. This revision also corrects errors in some of the underlying election day data for a number of precincts.

Update: Georgia is fixed!

Idaho: I added minor party votes and fixed the precinct numbering for Burley.

Maryland: There were two major types of error in the replaced data. (1) Wherever precincts were split into multiple census VTDs, the original precinct figures were duplicated for all the consituent VTDs. That's why, for instance, there were voting districts in Prince George's County with zero people and thousands of votes. (2) Where precincts were merged between 2008 and 2010, the previous data simply dropped the highest numbered precincts in the given municipality and reordered the rest. So, all the precincts after the lowest-number merged precinct were wrong.

Nebraska: The data previously on DRA was a big, huge mess. I've replaced it with the statewide official canvass. The previous data incorrectly assigned precincts for a number of counties. It excluded about 140,000 early votes and added the minor candidate votes to the McCain figure. A number of precincts were also missing any election figures, particularly in Douglas County (Omaha), which is why the old data incorrectly had McCain winning NE-02.

Ohio: The replaced data did not account for precinct splits, mergers, or boundary changes. The new data set corrects about 800 precincts according to my notes. It also adds in roughly 60,000 votes that were missing from the old data set. For the record, the only votes that are not included in the revised data are the federal ballots for Columbus (606 Obama, 139 McCain, 8 Other) and Toledo (124 Obama, 17 McCain, 3 Other).

Oklahoma: The previous DRA data was missing about 190,000 votes. There were also mixed up precinct figures in all the main cities. Note that Oklahoma didn't have any third-party candidates or qualified write-ins on the 2008 ballot, so there are no Other votes.

Tennessee: I've added minor candidate vote figures. I've also added about 150,000 missing Obama/McCain votes. The data previously on DRA missed precinct figures that were reported on multiple lines (especially around Memphis and, to lesser extent, Nashville). Also, the precinct figures in several counties had been scrambled, especially for Hamilton County (Chattanooga) and for Knox County (Knoxville).

EMAIL TO A FRIEND X
Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags

?

More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

  •  Thanks for the update (2+ / 0-)
    Recommended by:
    KingofSpades, roguemapper

    Do you have any plans, or is it even possible to upload a partisan average data set for states such as Kentucky or West Virginia?

    NC-06/NC-04; -9.00, -8.41; progress through pragmatism

    by sawolf on Thu Sep 06, 2012 at 08:37:36 AM PDT

    •  Yes (2+ / 0-)
      Recommended by:
      KingofSpades, sawolf

      The short answer is that it's certainly possible, but I rather doubt it's imminent.

      I have very limited time to work on DRA data and actually far less than I put into it. I made a decision quite some while ago that I would not work on anything besides 2008 presidential data unless I have no more 2008 presidential data to work with.

      I do want to upload some partisan averages or individual races for states where the 2008 presidential race doesn't well represent the overall leanings of the state, but I simply don't have the time right now.

      When I get to that point, and it's probably several months away, I plan to ask for suggestions on what states would most benefit from additional data.

      All that said, I may see about getting a 2010 senate/governor average up for West Virginia sooner rather than later. The SoS has a precinct data set (they lost the 2008 data in a server crash, so that had to come from each individual county).

      •  Understandable that you'd want pres data first (1+ / 0-)
        Recommended by:
        James Allen

        As for which states should get a partisan average first I think it's no question that Arkansas, Kentucky, and West Virginia would be the most worthwhile since Obama's numbers aren't very predictive at all of how local Dems do.

        NC-06/NC-04; -9.00, -8.41; progress through pragmatism

        by sawolf on Thu Sep 06, 2012 at 02:24:35 PM PDT

        [ Parent ]

  •  Been a while (4+ / 0-)

    Since we've seen you around here. I hope all is well.

    Political Director, Daily Kos

    by David Nir on Thu Sep 06, 2012 at 10:40:13 AM PDT

    •  I'm here in spirit! (3+ / 0-)

      Aside from being super-busy, all is well. My hiatus from DKE is mainly a time-management thing. I would much rather be drawing and analyzing maps then working on DRA data, but I realize that if I don't do it, no one else will.

      I don't post on DKE anymore because what little 'free' time I have I put into DRA. I sure didn't imagine it would become such an epic task back when all I wanted to do was get an Illinois data set last March!

      Anyway, I post semi-regularly on RRH, generally when taking a break from DRA work, because I find it a bit easier to jump in with a comment than I do on DKE. When I check in on DKE the main threads are usually so long there's just not much point in my commenting, and I don't read diaries anymore either here or at RRH (well, I never read them to begin with over there).

      In short, that's the tradeoff for the hours upon hours I put into DRA work while at the same time working on a rather complex thesis (which has required a good bit of research travel) as well as the textbook I'm co-authoring.

  •  Awesome. Thanks for the additions. (1+ / 0-)
    Recommended by:
    roguemapper

    We miss you around here though.

    Hail to the king, baby.

    by KingofSpades on Thu Sep 06, 2012 at 10:57:59 AM PDT

    •  Thanks! (1+ / 0-)
      Recommended by:
      KingofSpades

      Someday I'll finally be done with DRA and the skies will open for me and I'll have so much free time I won't know what to do with myself! But, sadly, that day isn't imminent.

      I'm on a mission to get a full, nationwide 2008 data set onto DRA (and haven't even mentioned the dreaded census block states that still await - AL, MT, OR, RI). Until then, I pretty much put all the time I can spare into DRA.

  •  GA errors (1+ / 0-)
    Recommended by:
    roguemapper

    There are a few errors with the Georgia data. It shows Echols County, in the far south, as voting 98% for Obama when it actually voted >80% for McCain. There are also a few heavily black precincts in the Atlanta area that are shown as McCain precincts.

    That being said, I do appreciate the improvements.

    (-8.38, -4.72), CT-02 (home), new ME-01 (college) "The needs of the many outweigh the needs of the few, or the one." -Spock

    by ProudNewEnglander on Thu Sep 06, 2012 at 12:00:24 PM PDT

    •  Georgia Errors (1+ / 0-)
      Recommended by:
      ProudNewEnglander

      Echols & Fulton County- Not sure what went wrong there. I just checked Fulton County 11E1 and 11E2 (they stick out like a sore thumb) and they're correct on my spreadsheet (and heavily Obama of course). Echols County is also correct on my sheet (981 McCain to 201 Obama) Something obviously went very wrong in the transfer to DRA.

      My suspicion is that Dave did not remove the 'hack' that was designed to compensate for the previous data's lack of absentee votes, though I don't see how that would result in something like the figures given for Echols (if anything it should inflate the McCain figure, not flip the results). The other possibility off the top of my head, as happened before with some other states, is the GeoIDs got misaligned, but that should result in far more errors across the state.

      All I can say for now is that I'll have to download the new Georgia csv file tonight and figure out what's going on to get it fixed.

      More generally speaking, it's not super unusual for errors to slip in (though of course I make every effort to avoid it). I can't do my final checks until the data goes up on DRA. This is the first time it's been this many states uploaded at once, so it'll take me at least a couple days to go back over all of them.

      But, please, don't anyone hesitate to point out additional errors in states besides Georgia. It'll make my task a whole lot easier.

      Thanks for alerting me to this!

    •  Georgia (0+ / 0-)

      I'm done reviewing the Georgia data and it looks as if the precinct figures got scrambled during upload in four counties (Echols, Elbert, Emanuel, Floyd) andn four Fulton County precincts (11E1, 11E2, 12E1, 12E2).

      I've sent Dave a file with a Georgia fix. Hopefully that'll take care of any Georgia data issues.

      •  I'll get to this today or tomorrow (1+ / 0-)
        Recommended by:
        roguemapper

        Daves Redistricting: 50 states + DC & PR w/ 2010 data. 42 states + DC w/ election data.

        by dgb on Sat Sep 08, 2012 at 01:49:03 PM PDT

        [ Parent ]

      •  Georgia is now fixed. (1+ / 0-)
        Recommended by:
        roguemapper

        Thanks for sending the updated file. Except for Fulton, I'm not sure what happened. For Fulton it's the "E" that messes things up.

        Daves Redistricting: 50 states + DC & PR w/ 2010 data. 42 states + DC w/ election data.

        by dgb on Sat Sep 08, 2012 at 09:23:47 PM PDT

        [ Parent ]

        •  Hi Dave (1+ / 0-)
          Recommended by:
          dgb

          It seems as if Georgia is just destined to be a perpetual pain in the butt..

          The election figures now match the correct precinct name throughout the state. However, I can tell that the precincts themselves are now scrambled on the map. I can't tell how extensive the problem is, but the precincts are definitely in the wrong place for Fulton and Muskogee (Columbus). I'm 99% certain they're in the wrong place for Dekalb and Chatham (Savannah) as well. That suggests to me a statewide problem.

          I'm guessing this is a simple enough fix.

          I've been checking over the other states that were updated and everything else looks fine so far.

          •  It is a statewide problem (3+ / 0-)
            Recommended by:
            dgb, roguemapper, abgin

            I just looked at the Georgia map, and all the large counties are messed up. Most of the small ones are also.

            Though wouldn't it be very interesting to try to redistrict Georgia as if the precincts were accurate. ;)

            (-8.38, -4.72), CT-02 (home), new ME-01 (college) "The needs of the many outweigh the needs of the few, or the one." -Spock

            by ProudNewEnglander on Sun Sep 09, 2012 at 06:40:39 AM PDT

            [ Parent ]

          •  I shouldn't work on this late Saturday (2+ / 0-)
            Recommended by:
            roguemapper, abgin

            I know exactly the problem and will fix immediately.

            Daves Redistricting: 50 states + DC & PR w/ 2010 data. 42 states + DC w/ election data.

            by dgb on Sun Sep 09, 2012 at 09:12:26 AM PDT

            [ Parent ]

          •  Ok. Fixed now... (2+ / 0-)
            Recommended by:
            roguemapper, abgin

            I hope. Last night I forgot to reorder the precincts.... doh!

            (Note: what I do to put the new data in is to order the the precincts by GeoID in both my spreadsheet and roguemapper's new data sheet. Spot check to make sure precincts line up. Then move the numbers over. Then I have to reorder back to the original order (the order the precinct shapes show up in the files from Census, which is way different). This last step is what I forgot last night.)

            Daves Redistricting: 50 states + DC & PR w/ 2010 data. 42 states + DC w/ election data.

            by dgb on Sun Sep 09, 2012 at 09:24:25 AM PDT

            [ Parent ]

            •  Georgia's not fixed (1+ / 0-)
              Recommended by:
              abgin

              I don't see any change in Georgia's status from this morning. Each county's precincts are still spread randomly around the county. Are you sure you did that last reorder?

              (-8.38, -4.72), CT-02 (home), new ME-01 (college) "The needs of the many outweigh the needs of the few, or the one." -Spock

              by ProudNewEnglander on Sun Sep 09, 2012 at 10:52:02 AM PDT

              [ Parent ]

              •  Cache (1+ / 0-)
                Recommended by:
                abgin

                You probably need to clear your browser or Silverlight cache.

              •  Timestamps (1+ / 0-)
                Recommended by:
                abgin

                DRA will reload from the server if the timestamp is newer than what you have locally. The file in question is vt13_plus.csv. When I look at the file on the server (with FileZilla) the time says 9:15am today. Since I'm on Pacific time and you, presumably, are on eastern time, that could be the source of the problem. You would need to remove that file from your cache. Easiest way is the clear the entire Silverlight cache (Application Storage). If you want to do that selectively you have to find the cache. Let me know if you want to do that and I can help.

                Daves Redistricting: 50 states + DC & PR w/ 2010 data. 42 states + DC w/ election data.

                by dgb on Sun Sep 09, 2012 at 12:27:38 PM PDT

                [ Parent ]

                •  This is a reply to both you and roguemapper (2+ / 0-)
                  Recommended by:
                  dgb, abgin

                  I cleared my browser cache (I use Chrome), and the data is still messed up.

                  I don't know how to clear the Silverlight cache. Would it have any adverse effects on my computer? If not, then could you explain to me how to do that?

                  Thanks!

                  (-8.38, -4.72), CT-02 (home), new ME-01 (college) "The needs of the many outweigh the needs of the few, or the one." -Spock

                  by ProudNewEnglander on Sun Sep 09, 2012 at 12:55:08 PM PDT

                  [ Parent ]

                  •  To clear Silverlight Storage (Cache) (2+ / 0-)
                    Recommended by:
                    ProudNewEnglander, abgin

                    Bring up DRA (or any Silverlight app).
                    Right click on map and click on the word "Silverlight"
                        You should get a dialog box with multiple tabs
                    Click the Application Storage tab
                    Select the line that says http://gardow.com
                    Click Delete
                    Click Yes

                    This will clear downloaded files for all the states you have worked on, which will mean they may be somewhat slower to load next you you try them. This does not affect any files you might have saved.

                    Good luck.

                    Daves Redistricting: 50 states + DC & PR w/ 2010 data. 42 states + DC w/ election data.

                    by dgb on Sun Sep 09, 2012 at 05:09:55 PM PDT

                    [ Parent ]

  •  Possible error in OK (1+ / 0-)
    Recommended by:
    roguemapper

    I've found something strange in Oklahoma that could be an error. In the precinct that covers Langston, OK, there are 1,348 votes but only 1,112 people age 18+, and only 1,142 people in total. However, the precinct that surrounds Langston seems to have abnormally low turnout, and substantially less Democratic strength than would be expected considering that the precinct is 52% black.

    (-8.38, -4.72), CT-02 (home), new ME-01 (college) "The needs of the many outweigh the needs of the few, or the one." -Spock

    by ProudNewEnglander on Thu Sep 06, 2012 at 12:33:21 PM PDT

    •  Hmm.. (1+ / 0-)
      Recommended by:
      ProudNewEnglander

      That's almost surely a VTD error. In other words, the actual 2008 precinct boundaries were almost surely different from the 2010 census voting districts. Unfortunately, these can be tricky to flag down. I'll have to check into this, and may very well have to see about getting 2008 Logan County maps.

      Thanks again!

  •  Virginia (2+ / 0-)
    Recommended by:
    sapelcovits, roguemapper

    Would it be possible to get the census data corrected? It still has the errors in Norfolk where way too many people in the city were allocated to the Taylor precinct.

    •  In short (0+ / 0-)

      I don't see why not. I'll check with Dave on this. You probably already know, but the Census Bureau issued a correction to the census blocks: explained here.

      So far as I can tell, the roughly 20,000 people incorrectly assigned to the Taylor precinct should be in the Zion Grace precinct.

      In any case, if the fix hasn't been issued for the VTD file as well, then I should definitely be able to do it manually in the csv file. So, one way or another we should be able to get it fixed.

  •  Hey (1+ / 0-)
    Recommended by:
    roguemapper

    I'm still in the process of trying to get more Oregon county data.  Don't know if you still think it's worthwhile since it'd have to be converted to census blocks, but anyway.

    •  Yes! (0+ / 0-)

      Any Oregon data will be helpful once I finally have the chance to work with the state. Any data you collect now will surely expedite the process when I eventually start working on the state.

      I should add, what I need above all else are 2008 precinct maps. Shapefiles are ideal, because they're the easiest to work with, but any kind of maps will suffice.

      There's little chance I can complete the state before I can get precinct maps for every county. I know from plenty of experience what a pain that can be.

      For what it's worth, I'm acutely aware of how much the Oregon data is desired. I probably get more requests for Oregon than any other state at this point. I just can't justify the intensive time and effort I know it will entail while I have so much else still waiting to be done.

      But, I'll eventually get to it for sure. It might very well end up being the last state that gets done, but it'll definitely happen. I won't rest until every state has full 2008 presidential data on DRA.

      •  if there's any way I can help (0+ / 0-)

        I'm just starting law school, but I'll help if I can, just let me know how I could make the process easier for you.

        Luckily, it appears that a couple more counties have put precinct maps up (small counties which have had no or minimal changes) and some past results, I'm thinking principally of Curry but I think also Clatsop or Columbia.  I think I still have some maps that I didn't send you before.  Unfortunately Linn & Clackamas counties I'll need to scan in.

        Romney. Ryan. Wrong.

        by James Allen on Fri Sep 07, 2012 at 10:56:53 AM PDT

        [ Parent ]

        •  Good luck! (2+ / 0-)
          Recommended by:
          dgb, James Allen

          With law school. For the time-being there's really not much to be done with Oregon. Until I get a chance to fully assess the state, I won't know what I need to get it done, so there's a good chance you'd be putting in unnecessary effort.

          In short, I'd say just keep doing what you're doing anyhow and when I'm ready to tackle Oregon I'll be in touch.

          Thanks for the offer!

          •  well (1+ / 0-)
            Recommended by:
            abgin

            would trying to match up precinct data with census blocks be helpful?  I've already sort of done it with counties that have legislative district splits, which is most of the well-populated ones.

            ...better the occasional faults of a government that lives in a spirit of charity, than the consistent omissions of a government frozen in the ice of its own indifference. -FDR, 1936

            by James Allen on Sun Sep 09, 2012 at 12:53:13 PM PDT

            [ Parent ]

  •  Whew, glad I found this (3+ / 0-)
    Recommended by:
    dgb, roguemapper, abgin

    I opened up a Georgia map and ?????!

    Thanks for your work!

    Ok, so I read the polls.

    by andgarden on Sun Sep 09, 2012 at 07:29:24 AM PDT

  •  You are awesome n/t (1+ / 0-)
    Recommended by:
    abgin

    NY-14, DC-AL (College), Former SSPer and incredibly distraught Mets fan.

    by nycyoungin on Mon Sep 10, 2012 at 12:41:20 AM PDT

  •  Thank you very much (1+ / 0-)
    Recommended by:
    dgb

    DRA is allways interesting.

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site