Tuesday, July 19, 2011

Grading PolitiFact (New Jersey): Burying Michael Doherty's underlying point

To assess the truth for a numbers claim, the biggest factor is the underlying message.
--PolitiFact editor Bill Adair

The issue:

(clipped from PolitiFact.com)


The fact checkers:

Bill Wichert:  writer, researcher
Caryn Shinske:  editor


Analysis:

PolitiFact appears to have the goods on Doherty.  It sure seems like he got the numbers wrong:
Doherty referred us to a fact sheet prepared by the Planned Parenthood Federation of America, Inc., showing that 7,021 prenatal clients were served nationwide in 2009. Based on that figure, Doherty determined there were, on average, about 140 prenatal patients per state.

Here’s the problem: the fact sheet said "clients," but Doherty referred to "visits" on the Senate floor.
Oops.  Big mistake.  One client might have more than one visit.

PolitiFact:
When we checked with Michele Jaker, executive director of Planned Parenthood Affiliates of New Jersey, she said Planned Parenthood centers provided a total of 40,489 prenatal visits across the country in 2009, which is the latest data available.
That's 5.77 visits per client, for those who like to see the numbers crunched.  And Doherty ends up underestimating the correct number by a walloping 83 percent.  What can save Doherty from receiving a "Truth-O-Meter" grade of "False" or worse?

The underlying point, maybe?  PolitiFact editor Bill Adair does call the underlying point the most important thing about a numbers claim, after all.  And there's some good news for Doherty in this fact check.  He's pretty much on target with the underlying point:
But for his overall argument that Planned Parenthood sees few prenatal patients, Doherty is right.

According to the same fact sheet, "other women’s health services," which includes prenatal care, only accounted for 10 percent of all services provided by Planned Parenthood nationwide in 2009.

According to figures provided by Jaker, prenatal clients represented about 0.6 percent of the 91,617 patients served by New Jersey centers in 2009.
In the context of overall services provided by Planned Parenthood, in fact, Doherty's error would shrink to a negligible level.  And since "the biggest factor" in grading a numbers claim is the underlying point, Doherty should fare okay.

Eh.  Not so much, as it turns out.

PolitiFact:
The senator said Planned Parenthood doesn’t provide many prenatal visits, saying the figure was "about 140 visits for each state in the entire country." That figure is way off, because Doherty was using the number of clients. The actual number would be more like 800 visits per state.

Figures provided by Planned Parenthood confirm that prenatal care represents a small part of the services offered, but since the senator’s figures were inaccurate to such a large degree, we rate the statement False.
Depending on the subject and/or the PolitiFact team doing the evaluation, the underlying point isn't always the most important thing.  Sometimes the underlying point doesn't appear to matter at all to the Truth-O-Meter's mighty objective needle.

Fancy that.


The grades:

Bill Wichert:  F
Caryn Shinske:  F

PolitiFact needs to decide as an organization what role the underlying point plays in a fact check.  And then stick to it.

No comments:

Post a Comment

Please remain on topic and keep coarse language to an absolute minimum. Comments in a language other than English will be assumed off topic.