Skip to main content

In my last diary I announced that the Diary flow rate meter is public and explained what the tool measured and why. I said that I'd let it run for awhile to gather data before making any conclusions. Over fifty megs of data later, I've got some pretty graphs illustrating the rate at which diaries are published on DailyKos, the changes since DK4 was introduced, and answers to some of your most pressing meta questions.

The Diary Flow Gauge
(DL/RR): the ratio of diaries published to those on the Recently Recommended List. Basically, all of them. :P

First, raw data of RR50, RR100 and DL100, by hour, is available in a CSV here. A GoogleDocs spreadsheet containing the data is here. You can import it into your own spreadsheet by putting the following text in cell A1:=importrange("tyskSd_JLNc1smoit4_8wNw", "DATA!A1:D1000")That's basically what I've done here, which is where all the pretty pictures are generated. Pretty pictures which answer questions like How long has the last diary been on the ___ the last day?
Photobucket the last week?
Photobucket...since opendna started collecting data?
This and this let you look a little closer at the data.

Those who's been following along at home will realize that this last graph answers the question that Seneca Doane first posed set out to explore with the Diary Flow Gauge, 2/16-17/11: no, there is not an appreciable increase in the rate of turn-over of either the Recently Recommended (RR) or recent Diaries List (DL). In fact, both lists are so large relative to the rate of diaries published, that even after both the east and west coasts have gone published their evening diaries and gone to bed, the the older items on the Recently Recommended list have been there for around three hours (and if timed just right, might languish for over ten hours!).  

Those observations early on caused me to question the value of our measurements. Perhaps we needed more precision and should select the DL 10 or RR10, which would tell you how long it took for the last 10 diaries to be published or hit the Recently Recommended list. I left the sampling alone because it is meaningful (is it on the first page?), might have changed (if the Firehose Hypothesis were correct) and, frankly, I couldn't come up with a good research question to justify messing it. Anyway, the data's there for you to use. Maybe you'll find something interesting in there that I didn't, or even a new question that should be asked. If so, drop me a line @gmail and we'll start filtering the datasets.

Getting on with it...

Updated by opendna at Fri Apr 08, 2011 at 04:24 PM EDT

aoeu pointed out that the images generated by GoogleDocs were breaking so I replaced them with ones hosted at Photobucket. (Damn you, Google!)

Originally posted to Toolbox on Fri Apr 08, 2011 at 12:43 PM PDT.

Also republished by Math and Statistics Geeks and Meta Groupies.

Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags


More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site