Skip to main content

Nate Silver long suspected that Research 2000 polls done for Kos were bogus.

from Nate Silver [xxx@xxx]
to Mark Blumenthal [xxx@xxx]
Mark Blumenthal [xxx@xxx]
date Thu, Feb 4, 2010 at 4:17 AM
subject Research 2000 weirdness


Not to sound too conspiratorial, but to be honest I'm getting
a little bit suspicious about Research 2000, or at least the
polling they've conducted for Markos over the past two years.
Do you know those guys at all?

Research 2000 president Del Ali has refused to go on the record but his attorney attacked Kos and threatened to countersue  instead of providing the data that would show that the polling for DailyKos was done randomly according to accepted polling standards.

Ali's attorney, Richard Beckler of Howrey LLP in Washington, told TPMmuckraker in an interview, "This guy is completely all wet. This allegation of fraud is absurd." He added, "These guys are basically ruining Mr. Ali's business."

Beckler promised to take "some kind of action soon against all of them" -- referring to Kos and the three authors of the analysis calling R2K's data into question. He declined to elaborate. Beckler also questioned the credentials of the three authors -- who Kos called "statistic wizards" -- Mark Grebner, Michael Weissman, and Jonathan Weissman. They are respectively described in the Kos post as political consultant, a retired physicist, and a wildlife research technician.

The problem for Del Ali is that Kos released the crosstabs for all to see. Attacking the messenger won't work when Nate Silver can show non-randomness from the data already released. Nate Silver says that the Grebner, Weissman and Weissman report was excellent.

And, of course, Kos got independent reviews from experts of the GWW report before he went public with the fraud allegations.

Kos' Lawyer Adam Bonin (AdamB) is not taking hostages.

"He handed Daily Kos fiction and claimed it was fact and got us to put our name on it," said Attorney Adam Bonin of R2K president Del Ali.

Del Ali needs to explain why his polling numbers done for Daily Kos are not random.

Random numbers have random correlations. Nate Silver analyzes R2K and PPP data. PPP 's data set is random. R2K's is highly correlated.

Nate explains the correlation problem succinctly.

and the daily results were remarkably consistent from day to day.  At no point, for instance, in the two months that they published daily did Obama's vote share fluctuate by more than a net of 2 points from day to day (to reiterate, this is for the daily results (n=~360) and not the rolling average).  That just seems extremely unlikely -- there should be more noise than that.

R2K's lawyer sent a cease and desist letter to Nate Silver to attempt to stop him from publishing the evidence that supports the position that R2K's polling data is bogus.


Nate Silver will not back down.

The cease and desist letter, which is published below, attributes to FiveThrityEight statements that were made by others. It alleges that "you have engaged in a campaign to discredit and damage R2K by posting negative comments regarding Mr. Ali, the Company, and its work products on the "Daily Kos" blog. It further threatens a lawsuit, unless I "immediately cease and desist all such activities, and retract all previous publicly transmitted statements."

I emphatically stand behind any statements I have made about Research 2000, and will be constrained by nothing other than my common sense and my professional integrity in any comments I should elect to make about Research 2000 in the future.

The first page of the cease and desist letter

Update 2

This morning Nate shows how the DailyKos daily tracking poll showed much less day to day variability than would be expected from a random polling sample.

The simulation found that Obama's daily numbers should have moved by at least 3 points from one day to the next about half  of the time, given the sample sizes that Research 2000 was using. In fact, they never moved by as many as 3 points, not even once. This behavior is exceptionally nonrandom. Indeed, we should also have seen a fluctuation of 5 or more points about once every four or five days, and a change of 7 or more points about once every two weeks -- this obviously never happened, either.

Originally posted to FishOutofWater on Tue Jun 29, 2010 at 01:34 PM PDT.

Your Email has been sent.
You must add at least one tag to this diary before publishing it.

Add keywords that describe this diary. Separate multiple keywords with commas.
Tagging tips - Search For Tags - Browse For Tags


More Tagging tips:

A tag is a way to search for this diary. If someone is searching for "Barack Obama," is this a diary they'd be trying to find?

Use a person's full name, without any title. Senator Obama may become President Obama, and Michelle Obama might run for office.

If your diary covers an election or elected official, use election tags, which are generally the state abbreviation followed by the office. CA-01 is the first district House seat. CA-Sen covers both senate races. NY-GOV covers the New York governor's race.

Tags do not compound: that is, "education reform" is a completely different tag from "education". A tag like "reform" alone is probably not meaningful.

Consider if one or more of these tags fits your diary: Civil Rights, Community, Congress, Culture, Economy, Education, Elections, Energy, Environment, Health Care, International, Labor, Law, Media, Meta, National Security, Science, Transportation, or White House. If your diary is specific to a state, consider adding the state (California, Texas, etc). Keep in mind, though, that there are many wonderful and important diaries that don't fit in any of these tags. Don't worry if yours doesn't.

You can add a private note to this diary when hotlisting it:
Are you sure you want to remove this diary from your hotlist?
Are you sure you want to remove your recommendation? You can only recommend a diary once, so you will not be able to re-recommend it afterwards.
Rescue this diary, and add a note:
Are you sure you want to remove this diary from Rescue?
Choose where to republish this diary. The diary will be added to the queue for that group. Publish it from the queue to make it appear.

You must be a member of a group to use this feature.

Add a quick update to your diary without changing the diary itself:
Are you sure you want to remove this diary?
(The diary will be removed from the site and returned to your drafts for further editing.)
(The diary will be removed.)
Are you sure you want to save these changes to the published diary?

Comment Preferences

pontificator, bink, Thumb, JekyllnHyde, Aexia, Alumbrados, Superskepticalman, Ed in Montana, Angie in WA State, zzyzx, Sylv, Terri, RF, Ray Radlein, Phoenix Woman, ogre, decembersue, Rita in DC, Timaeus, leftcoast, Trendar, tikkun, abarefootboy, MarkC, BigOkie, RunawayRose, newjeffct, bosdcla14, karlpk, tommurphy, alicia, DR RD, Shockwave, Heimyankel, meg, shayera, mslat27, eeff, TX Unmuzzled, dkistner, xynz, freelunch, ZAPatty, FyodorFish, Walt starr, zeitshabba, Creosote, Heart of the Rockies, dpc, bigforkgirl, Mr Teem, Hose B, bronte17, indybend, Shadan7, elveta, rhp, bluesteel, Glic, vmibran, farmerhunt, denig, nargel, redux, Torta, itskevin, PeteZerria, bustacap, lirtydies, Chrisfs, wader, SneakySnu, psnyder, Alizaryn, danthrax, Dr Colossus, leevank, brainwave, grannyhelen, JimWilson, HeyMikey, niteskolar, Steven Payne, defluxion10, nika7k, AbsurdEyes, papercut, RebeccaG, RenaRF, 313to212, Sophie Amrain, General Disarray, bwintx, Matt Esler, djtyg, Curt Matlock, smartgo, lonespark, tomjones, CanYouBeAngryAndStillDream, poemworld, Albanius, bablhous, rickeagle, AaronBa, BDA in VA, environmentalist, My Philosophy, sawgrass727, Julie Gulden, soros, maybeeso in michigan, bloomer 101, radarlady, 3goldens, Treg, mjd in florida, arnott, OpherGopher, Dickie, PBen, KnotIookin, Flint, willibro, bagman, grimjc, panicbean, ZappoDave, ajsuited, citizenx, basquebob, dewtx, Dobber, ratzo, eru, GUGA, Chaoslillith, cfk, Pam from Calif, Frank Palmer, Sun Tzu, jimreyn, where4art, aaraujo, GreyHawk, sheddhead, Phil S 33, Isara, Ginny in CO, wiscmass, Rogneid, Spathiphyllum, peacestpete, Ekaterin, Snud, Land of Enchantment, schoolpsyc, bently, begone, SoulCatcher, martini, Showman, K S LaVida, L Boom, karmacop, tommymet, Patriot Daily News Clearinghouse, myboo, Sam the Wolfdog, Kingsmeg, vigilant meerkat, cybersaur, Mr Bojangles, Clytemnestra, ferallike, BlueInARedState, Kimball Cross, raptavio, liberalconservative, victoria2dc, Hear Our Voices, kestrel9000, carolita, kto9, Lashe, gpoutney, Libby Shaw, SadieSue, imabluemerkin, JVolvo, bleeding heart, Preston S, el cid, OMwordTHRUdaFOG, soccergrandmom, doinaheckuvanutjob, Timothy J, Clive all hat no horse Rodeo, The Lighthouse Keeper, frankzappatista, blueoregon, kurt, blueness, Hedwig, ipsos, markthshark, Aaa T Tudeattack, AntKat, Joelarama, Thinking Fella, tegrat, sephius1, pgm 01, lightfoot, bluicebank, Buckeye Hamburger, donnamarie, uncomfortably numb, Haningchadus14, Cat Whisperer, dmh44, ninkasi23, moodyinsavannah, grelinda, mamabigdog, gloriana, terryhallinan, psychodrew, edsbrooklyn, HeartlandLiberal, Jimdotz, ezdidit, DWG, joyful, londubh, newpioneer, Strabo, bnasley, ProbStat, malharden, Kyle the Mainer, kingyouth, Kentucky Kid, jayden, Templar, vbdietz, crose, Uberbah, millwood, Moderation, jhop7, Progressive Chick, Sarea, JML9999, Jahiz, sable, oxon, Terra Mystica, Empower Ink, chicago minx, MKinTN, Michael91, mayrose, seriously70, revm3up, mconvente, JeffW, hulagirl, kingneil, ScottyUrb, poligirl, Involuntary Exile, dadadata, NewDealer, brooklynbadboy, skohayes, filby, CDH in Brooklyn, thetadelta, Kevin Holsinger, Mother of Zeus, Greasy Grant, Yohannon, Lujane, pamelabrown, TexasLiz, Cassandra Waites, hwmnbn, geomoo, icebergslim, Jake Williams, MsWings, Ladyhawk, Dean Barker, mofembot, Seamus D, Gemina13, Horsefeathers, SyntaxFeline, Rolling, petulans, phrogge prince, luckylizard, gas28man, BYw, allie123, psilocynic, HarpboyAK, Quilldriver, pilotmama, tristan57, sydneyluv, Simply Agrestic, dzog, Stroszek, lostboyjim, oldliberal, maggiejean, SciMathGuy, pileta, Leftcenterlibertarian, DontTaseMeBro, Coach Jay, greengemini, PapaNelly, Stranded Wind, DFutureIsNow, Partisan Progressive, h bridges, velvet blasphemy, bigmikek7, indres, Patch Adam, CamillesDad1, cjenk415, DefendOurConstitution, delillo2000, beijingbetty, sanglug, Denise Oliver Velez, kevinpdx, Keith Pickering, Joeytj, IreGyre, stevenwag, sfarkash, mdmslle, 57andFemale, spyguy999, nancat357, Bene Gesserit1, ohmyheck, mahakali overdrive, Dragon5616, Tricky, Leftcandid, Larsstephens, Words In Action, Railfan, bronxcharlie, Its the Supreme Court Stupid, hillgiant, rb137, KroneckerD, TFinSF, amk for obama, catwho, fidellio, Crabby Abbey, Eddie L, cordgrass, sullivanst, samanthab, pixxer, ItsSimpleSimon, Mariken, DerAmi, NYWheeler, sharonsz, Funkygal, rja, roystah, elengul, MsGrin, BlueFranco, Floande, wwjjd, Actbriniel, JanG, samantha in oregon, TheHalfrican, Onomastic, praying manatheist, gobears2000, Colorado is the Shiznit, cultjake, Quite Contrary, yankeedevil, Montreal Progressive, bgbrad, Korinthios, nicethugbert, wildlife advocate, kirbybruno, Kharafina, VoteBlue, La Gitane, BlueJessamine, BlackQueen40, QuestionAuthority, KelleyRN2, princesspat, Alice Olson, Lorikeet, grannysally, Cinnamon Rollover, theone718, slooterdam, muddy boots, merrily1000, UpstateAlan, jgnyc, Vtdblue, healthy, pensivelady, cap76, CowKingDeluxe, innereye, Amaryliss, Book of Hearts, thejoshuablog, Nightshade Q, jaebone, ChiTownDenny, PrometheusUnbound, Blue Shift, James Philip Pratt, Rejoinder, Monsieur Georges, Dom9000, left over flower child, James Robinson, Prairie D, KiB, Flying Goat, Aji, IndieGuy, delmardougster, DarkWater, AreDeutz, SocialRazor, CapeTown96

Subscribe or Donate to support Daily Kos.

Click here for the mobile view of the site