Skip to main content

In the last two elections, the patterns was similar -- Election Day traffic was three times that of the preceding days. This was our chart in 2006:

Given our daily traffic was in the 3 million pageviews per day in the weeks leading up to this election night, we wondered if that trend would hold. Our tech guru Jeremy (aka "ct") literally spent the entire year preparing our infrastructure for the Big Show. We had the primaries and debates to fine tune the backend, but would we actually serve 9 million pageviews? And if so, could our servers survive such a crush?

Well, here's what we served: First of all, the main site:

And our kick-ass Electoral Scoreboard (which we agree, was the best of the web):

Add them up, and we get ... 9 million pageviews Election Day. Funny how these trends have held three elections in a row.

Early in the night we had some scoreboard bugs to deal with -- it is, after all, new technology being debuted for its first election. But Jeremy and the widget's developer had squashed those bugs by 7 p.m. ET (before the big crush of results started coming in), and after that, it was pretty much smooth sailing. A year's of hard work by Jeremy, as well as efforts by our data center Voxel, and our widget's developer Free Range Studios, all conspired to deliver a fantastically smooth night for you guys.

And for me, it was a chance to focus on the results, rather than on keeping the site alive. My champagne tasted sweeter knowing my tech team had it all under control.

And you don't want to know what Jeremy did all year.

Hardware is part of the solution, Bingham says. “To handle the traffic better, we moved to a cluster of six quad core Xeons with 8GB RAM for webheads that all boot off a central NFS (Network File System) root, with the capability of adding more webheads as needed,” he said. Daily Kos also added two 16GB eight-core Xeons and a 6×73GB RAID-10 array for database files running a MySQL master/slave setup [...]

Many database-driven sites facing scalability challenges have looked to the distributed caching system memcached, which helps speed dynamic web applications. Bingham says memcached has played an important role in scaling the Daily Kos site. “I greatly expanded memcached usage with 1GB instances memcached running on each webhead, which they all share,” said Bingham. “The backend also places fully rendered pages into memcached, which a hacked up lighttpd running as the front end proxy then serves these pages from memcached directly to anonymous users. This has helped the sites performance immensely, since not only does it spread the work of rendering these pages around to the all of the webheads, but it greatly reduces the amount of work the backend has to do.”

I told you that you didn't want to know...

Originally posted to Daily Kos on Sat Nov 08, 2008 at 10:05 AM PST.

Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags


More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site