A "Half True" update

Years ago, I pointed out to PolitiFact that it had offered readers two different definitions of "Half True." In November 2011, I posted to note PolitiFact's apparent acknowledgment of the problem, evidenced by its effort to resolve the discrepant definitions.

It's over five years later. But PolitiFact Florida (archived version, just in case PolitiFact Florida notices something amiss) either did not get the memo or failed to fully implement the change.

We then decide which of our six rulings should apply:

TRUE – The statement is accurate and there’s nothing significant missing.
MOSTLY TRUE – The statement is accurate but needs clarification or additional information.
HALF TRUE – The statement is accurate but leaves out important details or takes things out of context.
MOSTLY FALSE – The statement contains some element of truth but ignores critical facts that would give a different impression.
FALSE – The statement is not accurate.
PANTS ON FIRE – The statement is not accurate and makes a ridiculous claim.

PolitiFact Florida still publishes what was apparently the original standard PolitiFact definition of "Half True." PolitiFact National revised its definition in 2011, adding "partially" to the definition so it read "The statement is partially accurate but leaves out important details or takes things out of context."

PolitiFact uses the updated definition on its main page, and directs readers to PolitiFact's main "principles" page for more information.

It's not even clear if PolitiFact Florida's main page links to PolitiFact Florida's "About" page. It may be a vestigial limb of sorts, helping us trace PolitiFact's evolution.

In one sense, the inconsistency means relatively little. After all, PolitiFact's founder, Bill Adair, has himself said that the "Truth-O-Meter" ratings are "entirely subjective." That being the case, it matters little whether "partially" occurs in the definition of "Half True."

The main problem from the changing definition comes from PolitiFact's irresponsible publication of candidate "report cards" that supposedly help voters decide which candidate they ought to support.

Why should subjective report cards make any difference in preferring one candidate over another?

The changing definition creates one other concern--one that I've written about before: Academic researchers (who really ought to know better) keep trying to use PolitiFact's ratings as though they represent reliable truth measurements. That by itself is a preposterous idea, given the level of subjectivity inherent in PolitiFact's system. But the inconsistency of the definition of "Half True" makes it even sillier.

PolitiFact's repeated failure to fix the problems we point out helps keep us convinced that PolitiFact checks facts poorly. We think a left-leaning ideological bubble combined with the Dunning-Kruger effect best explains PolitiFact's behavior in these cases.

Reminder: PolitiFact made a big to-do about changing the label "Barely True" to "Mostly False," but shifted the definition of "Half True" without letting the public in on the long-running discrepancy.

Too much transparency?

"It is a change we don't make lightly"

Big news came down from PolitiFact today.  The fact checking organization will change its "Barely True" rating on its "Truth-O-Meter" to "Mostly False."

PolitiFact editor Bill Adair explains:

Today, Barely True becomes Mostly False.

It is a change we don't make lightly. The Truth-O-Meter has been the heart of PolitiFact since we launched the site four years ago, and we were reluctant to tinker with it.

If the powers that be at PolitiFact show such reluctance in making this minor cosmetic change then it sends a strong signal that PolitiFact will remain unwilling to make the substantial changes it would have to make to avoid its ongoing branding as the mainstream cousin to the partisans at Media Matters.

And I can't help but react with a wry smile when PolitiFact makes this change while leaving intact a long-running discrepancy in the descriptions of its ratings.  The "Principles of PolitiFact and the Truth-O-Meter" page describes "Half True" as  "The statement is partially accurate but leaves out important details or takes things out of context."  At "About PolitiFact" another version of "Half True" reads "The statement is accurate but leaves out important details or takes things out of context."

Between the new definition of "Half True" and the change from "Barely True" to "Mostly False" where both have the same definition, which is the more significant change?

But don't look for PolitiFact to reconcile its differing definitions with any fanfare.  There is still a reputation to protect.  Look for PolitiFact to (again) break the pledge it made about what it would do when it makes a mistake:

We strive to make our work completely accurate. When we make a mistake, we correct it and note it on the original item. If the mistake is so significant that it requires us to change the ruling, we will do so.