Participation at Dailykos: 2004-2014

jotter for Daily Kos Research

Community (This content is not subject to review by Daily Kos staff prior to publication.)

Thursday April 24, 2014 · 11:31 AM PDT

2014/04/24 · 11:31

Participation at Dailykos over time is a subject of some interest and speculation for both registered users and politically minded folk everywhere.

With a decade of data in hand it is long past time to take a look.

With this in mind, statistical summaries of participation over 536 consecutive weeks at daily kos were prepared to provide a starting point for discussion.

Jump through the curly queue of orange hue with me to further explore.

jotter for Daily Kos Research

Community (This content is not subject to review by Daily Kos staff prior to publication.)

Saturday April 13, 2013 · 12:31 PM PDT

2013/04/13 · 12:31

I'm interested in natural language processing.

Where could I find a very large collection of natural language text ("corpus" in NLP speak)?

Hmm. Oh, right. Right here.

What kind of things can you do with such a corpus?

Lots! But for just a first exercise, I do really love the "text generators" based on word and phrase frequencies.

So, I counted all the bigrams in Daily Kos diaries published in 2012 that were used 10 or more times.

A bigram is just a two word phrase, like, for instance, "Daily Kos".

Once you know often a word is likely to occur in a Daily Kos diary, and how often that word is followed by other words, you can generate "Daily Kos Text".

My two personal favorites.
- Media attention deficit.
- House oversight hearing aid kit.

Fun! Jump on over for more.

RSS

Participation at Dailykos: 2004-2014

DKOS text generation: 2012 model