Call me a cynic, but for me, the prototype of all of the “fact-checking” columns in today’s mainstream media was in this piece here:

With the world breathing a collective sigh of relief following the violence-free passage into the year 2000, an international coalition of terrorists issued a reminder Monday that the new millennium does not actually begin until Jan. 1, 2001. “Technically speaking, we are now in the last year of the 20th century,” said Mahmoud al-Habib, a spokesperson for the terrorist organization Hamas. “Since there was no year zero, next New Year’s Eve is the real time to detonate bombs in Times Square and blow commercial airliners out of the sky.” Speaking from a secret bunker in the Kashmir hills, Osama bin Laden agreed. “We were all set to blow up the Eiffel Tower,” bin Laden said, “when one of my suicide bombers pointed out that it should actually be done next Jan. 1, not this one. I suppose we’ll just have to wait.”

Why, of course it’s the Onion.   But it spells out the model for so many “fact-checkers” in the industry; a relentless focus on the finding “gotchas”.

The piece spells out a key pitfall in the whole idea of “Fact-Checking” the news; it’s entirely possible to be right about “facts” and still miss, or even detract from, the truth.  In the example above?  It was, perhaps, a fact that the millennium didn’t begin until 2001, but that missed the point for the fictional terrorists (check the date-stamp on that piece), for whose purposes “crowds on the street” were more the issue than “having the right date”.

And that’s even when the “fact-checker” isn’t being cynical and exploiting the “fact-check” system to serve as a political editorial.

Takeaway:  It’s possible for facts to be true and still divert the audience from a larger, more important truth.

Takeaway Question: If a fact (“The Millennium begins in 2001!”) diverts the user from a larger truth (2000 is when all those crowds were out on the street, tempting the terrorists of the day), does it advance or divert from the story?

The answer, of course, is a question; “Is your story about Calendar Trivia, or Terrorism?”

Indictment

Last week, Jon Cassidy at Human Events wrote as clear an indictment of the “Fact-Checking” system, or at least of as I’ve seen.

And that indictment ran down not only the top-line biases built into “Politifact”, the national über-fact-check organization…

In 2007 [when Politifact was still affiliated with Congressional Quarterly], PolitiFact was checking numbers thrown around in debates, such as whether 300,000 babies annually are born deformed (False: it’s 40,000), or whether Social Security “is solid through about 2040 without any changes whatsoever” (True, in PolitiFact’s view: the system’s not going broke until 2041).

By 2010, PolitiFact was giving False ratings to statements that were true, such as U.S. Senator Rand Paul of Kentucky saying that federal workers make an average of $120,000, compared to a private sector average of $60,000. Paul used total compensation figures, which PolitiFact found misleading. The arbiters arbitrarily decided that salary alone is the valid figure, which would be news to the Internal Revenue Service.

By 2012, it was “fact-checking” extremely general statements of personal experience like this one by Paul’s father, Ron Paul, the Texas congressman and GOP presidential candidate: “I had the privilege of practicing medicine in the early ’60s before we had any government” involvement in health care. “It worked rather well, and there was nobody out in the street suffering with no medical care. But Medicare and Medicaid came in and it just expanded.”

Fact-checker Louis Jacobson tried to disprove Ron Paul’s statement, but eventually admitted his limits. It’s the only example we’ve seen of PolitiFact admitting that the truth was too complex or beyond the scope of the Truth-O-Meter treatment.

…as well as the absurdities of its performance once you get into the weeds with specific stories:

If a conservative advocacy group runs an ad saying Obamacare could cost “up to $2 trillion,” an honest fact-checker would look up the government’s own estimate and see that, indeed, the Congressional Budget Office puts the cost at $1.76 trillion for just the first few years…

…The Congressional Budget Office estimates that Obamacare “represents a gross cost to the federal government of $1,762 billion,” or $1.76 trillion, over the next decade, and that the costs will grow over time. Yet PolitiFact still managed to dismiss that bedrock number as something to be dismissed. In critiquing an advertisement that attacked the program’s costs, PolitiFact editor Angie Drobnic Holan wrote that “the $1.76 trillion number itself is extreme cherry-picking. It doesn’t account for the law’s tax increases, spending cuts or other cost-saving measures.” On paper, the Obama administration projects that new taxes and Medicare cuts will offset the new program’s costs for a while. But that doesn’t change the cost of “up to $2 trillion.” That would make the statement True, of course. Incidentally, the CBO’s 10-year cost figures will be closer to $3 trillion in a few years, if current forecasts prove accurate.

Read the whole article.  And remember it next time someone waves “Politifact” in your face.

Takeaway:  Journalists – really, journalism itself – depend on having some sort of trust from their consumers.  It starts with the little things – did they get the who, what, when, where, why and how correct – and in the bigger things, like “not slanting their coverage to suit some other agenda”.   See Dan Rather.

Meanwhile, Here At Home

I’ve always had a fair amount of regard for MPR News, which is perhaps counterintuitive for a Minnesota Conservative.  While a very close, and admittedly very partisan, listen reveals the odd bit of bias among the reporters and their editorial process, I think it’s fair to say that MPR News makes a game effort at playing the news straight (that is, of course, as distinct from MPR’s and “American Public Media’s” non-news programming, which is designed to afflict the comfortable and comfort the upper-middle-class liberal).

But I have had some questions about MPR News’ “Poligraph” feature this past week (and, let’s be honest, for years).  While I think Catherine Richert does a broadly acceptable job of balancing her “fact-checking”, I’ve taken a closer look at some of her pieces this week.  And I wrote her to ask some quesitons, which led to an interesting interchange between her and her boss, Mike Mulcahy and I.

Richert (as she herself noted in the comment section yesterday) responded, pointing out “Polograph’s” “about” section (which I also posted yesterday), and adding:

As you’ve probably noticed, we check one Democrat and one Republican every week, and occasionally a member of the IP. Once in a while, we switch the schedule up and check two members of the same party in one week. When that happens, we check two members of the other party the following week.

That was good to learn, actually.

 Both the Hernandez and Klobuchar claims from last week meet several of our criteria. Both were “checkable” statements, both were made in debates, which are significant news events, and both are central to major campaign issues.

And that was even better to learn.

And next, we get to the beef:

 Hernandez is adamantly opposed to the bank bailout, which highlights the GOP’s broader campaign theme that government has become too intrusive.

That’s correct.  We talked about this on Tuesday.  I called the fact-check “Obtuse” because while Tony wasn’t literally to-a-point accurate (the bailout didn’t cause unemployment all by itself), he spoke to a larger point that even Richert’s sources agreed with – that government intervention is fouling up the economy.

Question:  As in the “Millennium” example: does analyzing Hernandez’ ad-lib as an absolutely literal statement (“did the bailout literally cause our unemployment rate?”) rather than a general statement of economic principle (“did bailouts harm or help the economy”) or political princple (“are bailouts the right thing to do?”) bring us closer to, or farther from, the larger truth?  That the results of Obama’s (and Bush’s) interventions in the economy are, even if you’re completely non-partisan, mixed at best?

And Klobuchar has made bipartisanship a cornerstone of her political persona; her claim about how many bills she has sponsored with Republicans underscores that part of her campaign message.

And as I pointed out on Wednesday, that’s true in and of itself; it showed Klobuchar’s “bipartisanship” – according to one measure, at least.  It proved that the numbers gave to support her own assertion were in fact correct.  So if your question was “does Amy Klobuchar give out correct numbers to prove her assertions”, she passed with flying colors!

But if your question was “Is Klobuchar really bipartisan?”, there was much more to it; her voting record is 94% Democrat (as Richert noted), and in the leftmost third of the Democrat caucus; put another way, she’s the 17th most-liberal Senator out of 100.

Question:  Which is the more important question, if the goal of ones’ fact-checking is to inform people about the upcoming election: “Does Amy give out valid numbers?”, or “Is Amy’s contention that she’s bi-partisan accurate?”

I’d maintain that while the latter question’s answers are dependent to some extent on one’s political perspective, that that question is the real story.

As I noted yesterday, my most important question – after learning and noting their “ping-pong” format of hitting a statement by both major parties every week, more or less – is “how does a statement get picked for analysis?”  I noted a couple of Betty McCollum statements – one on her views of the Ryan budget, one on the funding for the Stillwater bridge project.  Let’s stick to the former for right now.  It’d seem this fits Richert’s description of Poligraph’s criteria;  it’s “checkable” (I checked it!), it took place at a significant news event (the same debate that Hernandez’ statements came from), and it’s a central part of her campaign (raise taxes, oppose the Ryan budget).

So I asked – why did MPR pick, as the “Democrat” question in the weeks’ ping-pong of statements from both parties, Klobuchar’s self-serving but accurate statement about her bipartisanship, as opposed to McCollum’s completely fact-free statement about the Ryan Budget?

Because that speaks to my second question, way up above – about how a “fact-checker” whose integrity isn’t trusted is just barking in the wind.

Now, it’s entirely possible that MPR News’ management doesn’t see the incongruity; I’ll cop to the fact that my perspective is one that it finely tuned to find bias, and that fine-tuning sometimes warps the perspective.  All that’s a given.

But I thought it was a legitimate question:  for the single, sole, weekly “fact-check” of a Democrat, by what rationale was a self-serving innocuity like Klobuchar’s statement selected (and a very tightly-focused validation given)) over an out-and-out untruth like McCollum’s?

Because given…:

• the growing, documented tendency of “journalistic” “fact-checking” organizations like Politifact, Factcheck and Snopes to operate from a standpoint of political bias, and…
• the fact that we are in an election where peoples’ votes are going to be swayed by the impressions they get from the news, and the “Journalism 101”-level fact that things like ledes and “MISLEADING” graphics tend to be remembered more than the deep-down details about a story, and that…
• looking at both of the stories from this week’s selection of “Facts” checked at that level would lead one to think “Tony Hernandez lied about the bailout, Amy Klobuchar told the truth about being bipartisan, and there’s apparently no news about Betty McCollum”…
• …while allowing that I’m looking at one week’s worth of Poligraph stories in a near vacuum, focusing on a couple of debates and statements of particular importance to me.   I’ll stipulate that that could very well skew my own perception.  I’m more than willing to be set straight on this.  I say that as a matter of intellectual honesty, not because I necessarily believe I’m wrong.

Question:  Did Poligraph’s stories about Hernandez or Klobuchar bring the news consumer closer to the real story – the candidates’ views on the economy and their “bipartisanship”?  Or did they answer the questions by asking the wrong questions, thus missing the forest for the trees? Or did they, like the “Terrorists” “fact-checking” at the top of the post, obscure rather than clarify the issue for someone seeking the truth?

Folllow-up question:  Does MPR’s choice of “facts’ to “check” make you trust their judgment and perspective on covering political news more, or less?

For years, now, I’ve had questions about how politicians’ statements get selected for MPR’s “Poligraph”.

If you Google the feature, one might be forgiven for thinking the feature should be named “MPR’s Michele Bachmann Bureau”.  That’d be unfair; Poligraph reporter Catherine Richert does spread some of the fact-checking love around among parties.

But I do seriously wonder what a pol has to do to get a statement picked up by Poligraph.

Huge Gaping Factual Hole, Ready For Occupancy

For example, I’ve wondered for years why Richert’s crew have never once checked up on Heather Martens, who has yet to speak her first significant truthful thing about the gun control issue.   This blog has spent years shredding everything Martens has ever said on the public stage.

It’s a big issue to me, naturally.  If I were a real cynic, I’d say it’s because MPR has invested some of its own credibility in Martens, airing an op-ed of hers in which every single one of her fifteen factual assertions – every one – was untrue.

But Martens isn’t an elected official?  Okie-Dokey – Dakota County Attorney Jim Backstrom is an elected official, and every single word he wrote about last years’ “Stand Your Ground” bill over the past four years was a lie.  Every single word.   And he’s elected, ya?   And both of them had Governor Dayton’s ear last session, when he vetoed the “Stand Your Ground” bill, which had passed with a bipartisan majority in the legislature.

Is it because MPR’s target demo doesn’t care about the issue?  I could almost understand it if that were the rationale.  But I don’t suspect a news organization would get behind that as an official alibi, do you?

Checking The Facts

So I wrote Richert over the weekend.  She emailed me back bright and early Tuesday morning.  Since I didn’t specify anything would be on the record (it was late), I’ll paraphrase; she referred me to the “About Poligraph” page, and noted the feature’s ground rules involve picking one statement from each party, each week (or, at times, two from one party one week, and two from the other the next).

The “About” page also notes:

PoliGraph puts the findings into short, clear explanations accompanied with a rating — accurate, misleading, false or inconclusive.

– Accurate: These claims are entirely or mostly true. They include important details and are supported by the facts.

-Misleading: These statements that leave out key information, are exaggerated, or have been taken out of context.

– False: These claims are not true or misleading to the point of being false.

– Inconclusive: This rating typically applies to projections or estimates. While such claims could be true under certain circumstances, more information is needed.

Well, that explains a few things, anyway.

One might hope that this next bit, however…:

If this reminds you of PolitiFact.com, the Pultizer Prize-winning from the St. Petersburg Times, you’d be right. We know good ideas when we see them.

…does not.  The political bias of Politifact (and those of the Pulitzer committee, as well) are a matter worth discussion; if those are “good ideas”, MPR News may see it; I do not.

More about the “Fact-checking” industry tomorrow.

Anyway – that brings us to my question from last Tuesday.

Selection Bias?

Yesterday, we looked briefly at “Poligraph”‘s take on an Amy Klobuchar claim to bipartisanship during her debate with Kurt Bills.    While Klobuchar’s statement was accurate as far as it went – the numbers literally supported the exact letter by letter intent of the Senator’s statement – Richert’s “fact check” focused to exclusion on the numbers, while ignoring the larger context Klobuchar’s statement seems to have been meant to hide.  This earned “Poligraph” a rating of “Cherry-PIcked”

That was their weekly “Democrat” fact-check.

But today’s installment will go back to this past Tuesday’s installment, in which Poligraph hit its self-imposed weekly “GOP” quota.  There, we looked at the “Poligraph” “fact-check” of a Tony Hernandez statement linking the bank bailouts to the unemployment rate.  While Tony oversimplified the issue, there is considerable debate about the question, and Richert herself focused excessively on refuting Hernandez’ words and ignored the broader context of the remark.   Calling Hernandez’ statement “Misleading” rather than “Oversimplified” earned “Poligraph” a rating of “Obtuse”.

But I wondered:  if “Poligraph’s” quota is one article per party per week, why pick the fairly innocuous Klobuchar quote about her record of co-sponsored bills?  The claim was almost as innocuous as the Senator herself (although it covered, I maintain, a much more important context).

But let’s go back to another moment from the State Fair debate.

Check out this segment from the Hernandez-McCollum debate:

(Video courtesy MN CD4 Conservatives blog)

Here’s the money quote from Rep. McCollum:

“The Ryan Budget does nothing to move this country forward.  It only protected tax cuts for the wealthy…[when presented with a putative Democrat budget proposal]…the Republicans said “No, if we can’t have tax cuts for the upper 1%”, which by the way is borrowed money from China, that we couldn’t have the middle-class tax cuts!”

This is an unvarnished lie.  The GOP and Ryan’s plan have been all about tax cuts across the board all along, combined with broadening the tax base so that a broader share of the people are actually paying something.  The Democrats want to use “tax cuts” as a class-warfare-baiting wedge, and seek to jack up taxes on the “wealthy”.

This McCollum statement was devoid of fact.  It contains an absolute absence of truth.  There is no validity to it in any way shape or form.

And yet it passed, while Richert spent a solid day or two vetting Hernandez’ off the cuff oversimplification about the bailout, and giving Amy Klobuchar’s blandishment about her “bipartisanship” a pass.

Why was that?

So I’ll give Poligraph a “Huh?”.

Here’s another one:  :

She says there’s lots of “Federal Highway Money” involved in the new St. Croix bridge project.  But there’s actually fairly little direct federal funding involved; it’s a lot more complex than that.

Now – the standard set with Tony’s oversimplification we looked at Tuesday was that, according to “Poligraph”, “too complex to put exactly that way” is “Misleading”.

So what is this?

We give Poligraph a rating of “Double Standard” for this one.

The question is, why does “Poligraph” pick the statements they pick?

More tomorrow.

Yesterday, I suggested that it might be a good idea for Minnesota Public Radio’s “Poligraph” feature (for whom Cathy Richert is listed as the “lead reporter”) might do well to add an “Oversimplified” rating to its rather cut-and-dried set of verdicts.

I suggested it because at first blush, it might be used to cover Richert’s own “fact-checking” – for example, the sole “fact-check” she did of Amy Klobuchar during the debate with Kurt Bills.

During the MPR debate at the Minnesota State Fair last week, A-Klo claimed that 2/3 of the bills she authored were ‘bipartisan”.  Richert dutifully confirmed that Klobuchar did, in fact, have Republican co-sponsors for 2/3 or so of the bills she wrote (while factually noting that Klobuchar votes with Harry Reid’s line in the caucus a very liberal 94% of the time).

On hearing this odd little juxtaposition – a “bipartisan” record of sponsoring bills versus a very partisan voting record – the curious reader and listener might have a question or two.

So What Did Klobuchar Sponsor?

Richert assures us that once fripperies like Senate Resolutions – which are usually non-controversial – are stripped from the data set, two-thirds of Klobuchar’s bills are, indeed, co-sponsored by Republicans.

And what assortment of bills are these?  I include them all below the jump.  And they are indeed some bipartisan profiles in courage; suspension of duties on plastic children’s wallets, bamboo kitchen utensils and inflatable swimming pools and the like.  Read the list at your leisure; you’ll need it.  There are 75 of ’em.  And right around 50 have a Republican co-sponsor.  And they are, pretty much to a T, innocuous.

The only two bills that Klobuchar has actually had signed by the President?  Neither the “Appeal Time Clarification Act“, co-sponsored by Jeff Sessions, and the St. Croix Bridge legislation, cosponsored by Franken and Wisconsin’s Senators Kohl (D) and Johnson (R), are especially controversial.

But there’s nothing wrong with having an innocuous record, really – is there?

Of course not.  Not everyone is a leader and a trail blazer, a la Paul Ryan.  It’s perfectly fine to claim innocuity as a virtue.

But what if there’s more to it?

Why Pick Such An Odd Figure To Wave Around In A Debate?

Klobuchar has, in fact, been running on the fact that she’s a pleasant enough person who is not averse to “bipartisanship”, but not in a way that risks anything.

But GovTrack shows her well to the left among Senators, with a voting record to the left of Harry Reid and San Francisco überliberal Dianne Feinstein, with only 16 Senators with more left-leaning rap sheets.  And it remained to Richert to point out to the reader and listener – days after the actual debate – that Klobuchar’s voting record is actually 94% in line with the Senate’s Democrat majority.  That is hardly a “bipartisan” record.

So it’d seem that:

• Klobuchar cherry-picked a statistic – a record of milquetoast bill sponsorships – to camouflage her extremely liberal voting record.
• Richert delved into the literal facts of the Senator’s claim and declared it “accurate”, while giving the shortest possible honest shrift one could give to the larger context – noting the top line of Klobuchar’s voting record without giving the faintest hint as to where that put Klobuchar within the Democrat caucus – that could still vaguely qualify as “journalistic balance”.

So there are a couple of questions here.

1. Richert called Tony Hernandez’ claim in the August 28 MPR debate (that the bailouts caused the unemployment problem) “Misleading”, when it could much more accurately be called an “Oversimplification” of a very complex question.  So – given that Richert has oversimplified Klobuchar’s statement, is she “oversimplifying” – my term – or, as she put it, “misleading?”
2. Given that , as I’ve shown, Klobuchar’s actual claim – that’s she’s oh-so-bipartisan – is supported by her co-sponsorship numbers but mocked by her voting record, doesn’t MPR, in the interest of accuracy, need to add a new, snappy “verdict” graphic?  Perhaps “Accurate on its face but intended to mislead the reader given a deeper context?”  It doesn’t fit on a snappy graphic like MPR seems to like, but it is in fact, more accurate, assuming “accuracy” is what “fact-checkers” shoot for.   I’ll run with “Cherry-Picked”.

And there’s another question.   Given all that was said in those two hour-long debates, why did MPR’s Richert pick this assertion of Klobuchar’s to “fact-check” (and oversimply), as well as Hernandez’ statement that we talked about yesterday?

What, indeed, are MPR’s criteria for submitting a politician’s statement to “Poligraph’s” eagle eye?

More on this tomorrow.
Continue reading →