Showing posts sorted by relevance for query palin defense gdp. Sort by date Show all posts
Showing posts sorted by relevance for query palin defense gdp. Sort by date Show all posts

Sunday, July 11, 2010

Grading PolitiFact: Sarah Palin & defense spending (Updated)

"There is ... a deep anti-military bias in the media. One that begins from the premise that the military must be lying, and that American projection of power around the world must be wrong."
--Terry Moran of ABC News, broadcast on the Hugh Hewitt Show May 18, 2005
Who knew?

Sarah Palin submitted a new post to her FaceBook page.  That's news, and time again for PolitiFact to fact check.


The issue:

PolitiFact did its work for two of Palin's claims.  I'm posting the main page blurbs together as they appeared there:


I'm including both images because the second one accounts for some of the context of Palin's statement about the 25th ranking for the U.S.


The fact checkers:

Louis Jacobson:  writer, researcher
Morris Kennedy:  editor


Analysis:

PolitiFact often deals with the literal statement as well as the underlying argument.

Louis Jacobson begins:
In a June 30, 2010, Facebook post, former Alaska Gov. Sarah Palin posted excerpts from a speech she gave in Norfolk, Va., primarily on national security. At one point, she said, "Did you know the U.S. actually only ranks 25th worldwide on defense spending as a percentage of GDP?"
PolitiFact claims that it grades claims while keeping them in context.  Perhaps revealing the her overall subject, national security, adequately fulfills that goal.  Just in case, here's more:
Our Defense Secretary recently stated the “gusher” of defense spending was over and that it was time for the Department of Defense to tighten its belt. There’s a gusher of spending alright, but it’s not on defense. Did you know the US actually only ranks 25th worldwide on defense spending as a percentage of GDP? We spend three times more on entitlements and debt services than we do on defense.
(yellow highlights added)
Note that the third sentence represents this fact check.  The following sentence is the one also receiving a fact check.  What is the underlying argument?  Most likely Palin sought to support her claim that there is no "gusher" of defense spending compared to other spending and chose two stats she expected to surprise her audience in order to underline that judgment.  That Palin presents one of the factoids as a question supports that interpretation.

Assuming I am correct, PolitiFact's decision to fact check the two claims at least partially validates her underlying argument.  PolitiFact found the claim surprising, as was made clear by Jacobson statement after he had quoted Palin:
At one point, she said, "Did you know the U.S. actually only ranks 25th worldwide on defense spending as a percentage of GDP?"

We didn't, so we decided to check up on her statistic.

We quickly tracked down the chart from which we suspect she pulled her factoid. (Her staff didn't return our e-mail query.) It's a credible source -- the CIA World Factbook -- and, as Palin said, the U.S. does rank 25th in the world, spending an estimated 4.06 percent of GDP on defense in 2005.
With the "False" and "Pants On Fire" ratings apparently ruled out, let's review the descriptions for the remaining "Truth-O-Meter" possibilities:
TRUE – The statement is accurate and there’s nothing significant missing.
MOSTLY TRUE – The statement is accurate but needs clarification or additional information.
HALF TRUE – The statement is accurate but leaves out important details or takes things out of context.
BARELY TRUE – The statement contains some element of truth but ignores critical facts that would give a different impression.
Review completed, back to Jacobson:
Case closed? Not really.

The list includes all countries, regardless of size, so some tiny countries outrank the United States on the CIA list. There's Eritrea at number 9 (with an economy about 1/1000th of the size of the U.S. economy); Burundi at number 11 (with an economy that's even less than 1/1000th the size of the U.S. economy); and Maldives at 13th (with an economy roughly the same size as Burundi's).
Though Palin specifically stated that the U.S. was 25th "worldwide," apparently she misled in Jacobson's eyes.

Jacobson:
All told, only four nations on the CIA list could be described as either industrialized democracies or major world players. They are Israel (6th), Turkey (16th), China (23rd) and Greece (24th).
Probably Jacobson meant that only four of the nations rated above the U.S. on the list were major world players.  If the list "includes all countries" as Jacobson claimed earlier, then we ought to find every industrialized democracy and major world player on the list.  It's OK for PolitiFact to misstate things like that, however.  The important thing is the other guy is not accurate.  Apparently Palin should have asked "Did you know that U.S. actually only ranks 5th among major world players on defense spending as a percentage of GDP?"  That would have made a huge difference or something.

Then Jacobson drops what probably accounts for the bigger complaint:
Is there a better yardstick? We think there is -- using rankings of members of the Organization for Economic Cooperation and Development. The OECD is a group of 31 nations that are generally large, industrialized democracies. This list makes the comparison closer to one of peers.
Hmm.  How many of those "large, industrialized democracies" are members of NATO and thus substantially subsidized in their defense by the U.S.?  It's easier to list the world players not part of NATO:
  • Australia
  • Chile
  • Korea
  • Mexico
  • New Zealand
  • Sweden
  • Austria
  • Finland
  • Ireland
  • Japan
  • Switzerland

We can add Japan and Korea immediately to the list of nations substantially subsidized in their national defense by the U.S.

Should any others qualify as resting under U.S. protection? I would suggest Australia (by treaty), Austria (nestled in the midst of NATO), Mexico (by proximity) and Switzerland (like Austria surrounded by NATO).

That leaves us only with Chile, New Zealand, Sweden and Finland as nations not unambiguously subsidized in their defense by the U.S. military. PolitiFact wants us to compare our military spending as a percentage of GDP with nations whose defense we subsidize plus two nations, Finland and Sweden, with an official policy of neutrality. New Zealand is geographically isolated and has a defense treaty with Australia. Chile has no history of using its military away from its home continent of South America. That's the best comparison? Ridiculous.

Additional sifting through the data revealed more problems. The OECD did not originate the data from which its list was derived. The data came from the Stockholm International Peace Research Institute.  And the following is from their description of their methodology:
SIPRI data reflects the official data reported by governments. As a general rule, SIPRI takes national data to be accurate until there is convincing information to the contrary. Estimates are made primarily when the coverage of official data does not correspond to the SIPRI definition or when there are no consistent time series available.
What makes SIPRI data better than CIA data?  Clearly superiority is not established by concentrating the comparison between the U.S. and other nations whose defense the U.S. subsidizes.  Just as clearly, giving non-transparent regimes (such as China) the benefit of the doubt minus strong evidence to the contrary tilts the board in favor of secretive nations.  To be sure, PolitiFact grants the caveat that secrecy is a problem--but then why prefer SIPRI as a data source in the first place?  Minus a recommendation from a consensus of neutral experts, PolitiFact's preference cannot count as an objective judgment.  It is opinion.

Speaking of expert opinions, Jacobson includes but one in his story:
Todd Harrison, a fellow with the Center for Strategic and Budgetary Assessments, said other factors set the U.S. apart.

"In absolute dollars, we spend almost as much as all other countries combined," Harrison said. "So saying we are 25th is a bit misleading and a selective use of facts."
OK, then, let's take the test.  It consists of one question:


Which of the following best matches "a bit misleading and a selective use of facts"?

A)  The statement is accurate and there’s nothing significant missing.
B)  The statement is accurate but needs clarification or additional information.
C)  The statement is accurate but leaves out important details or takes things out of context. 
D)  The statement contains some element of truth but ignores critical facts that would give a different    impression.

If you chose D then you have something in common with Louis Jacobson and PolitiFact:
Although she's technically correct, the numbers are wildly skewed by tiny, non-industrialized countries. We find her claim Barely True.
If, on the other hand, you thought Harrison's statement fit B or C just about as well if not better, I sympathize.

The fact is that Palin provided additional context that touched on the great expense involved in projecting power throughout the world:

It takes a lot of resources to maintain the best fighting force in the world – especially at a time when we face financial uncertainty and a mountain of debt that threatens all of our futures.
***
If we lose wars, if we lose the ability to deter adversaries, if we lose the ability to provide security for ourselves and for our allies, we risk losing all that makes America great! That is a price we cannot afford to pay.
***
Secretary Gates recently spoke about the future of the US Navy. He said we have to “ask whether the nation can really afford a Navy that relies on $3 to $6 billion destroyers, $7 billion submarines, and $11 billion carriers.” He went on to ask, “Do we really need... more strike groups for another 30 years when no other country has more than one?”

Well, my answer is pretty simple: Yes, we can and, yes, we do because we must. Our Navy has global responsibilities.
Palin was "technically correct."  So what was misleading in the underlying argument?  What numbers were supposedly "wildly skewed" by Palin's use of the CIA fact book?  Jacobson never identifies the target he claims Palin missed other than to claim that U.S. defense spending ought to be compared to nations either under our protective umbrella or with other reasons for low defense spending that do not allow for a fair comparison.  And he uses a dubious source to make the critical comparison with the nations who might tend to cause defense concerns for the U.S.


The grades:

Louis Jacobson:  F
Morris Kennedy:  F

PolitiFact left important data hidden and inserted opinion, if not error, by preferring a different measure based on incoherent grounds.

The fact check is not so much horrible for its rating of Palin but for the fact that PolitiFact does the same types of things for which Palin is faulted.  If it is wrong for Palin to leave out relevant data then it is wrong for PolitiFact to leave out relevant data.


Afters:

Wednesday, July 14, 2010

PolitiFact & the expert interview

Journalists keep secrets.

No, not secrets like a deal by the U.S. government to get banks to help find terrorists via their transaction records.  And not secrets like the existence of secret CIA prisons.  They keep other secrets.

They keep secrets such as their political leanings.  And secrets like the context of the quotations they use in their stories.  The latter secret accounts for this post, combined with my suspicion that PolitiFact reports don't always follow the best practices when obtaining comment from expert sources.

My first confrontation with PolitiFact's shortcomings in this area occurred while researching their story about John McCain's supposed earmarks.  I expressed the suspicion that Pete Sepp of the National Taxpayers Union may been taken a bit out of context.  Eventually I contacted Sepp and confirmed that suspicion to my satisfaction.

Often since I have wondered what questions PolitiFact reporters used to obtain statements from expert sources.  The reporter must take care not to ask leading questions.  Moreover, the reporter needs to tailor the question to ensure that the response reflects the expert's area of expertise.

Monday, February 21, 2011

Grading PolitiFact: Obama and shifting "domestic discretionary spending"

To assess the truth for a numbers claim, the biggest factor is the underlying message. 
--Bill Adair
While wearing out the above quotation from PolitiFact's Bill Adair, I've been looking for statements from Democrats constituting number claims.  Without strenuous effort I've found a number such claims concerning Republicans where the importance of the biggest factor seems to approach nil.  And with just a bit more searching a comparable example from a Democrat turned up.


The issue:



The fact checkers:

Robert Farley:  writer, researcher
Martha Hamilton:  editor


Analysis:

As a numbers claim this on is a bit more similar to Sarah Palin's statement about U.S. military spending as a percentage of GDP than to some others I've focused on recently.

On with the fact check:

Wednesday, October 05, 2011

Grading PolitiFact: Haley Barbour and Obama's unified government

To assess the truth for a numbers claim, the biggest factor is the underlying message.
--PolitiFact editor Bill Adair

 Here we go again.


The issue:

(clipped from PolitiFact.com)


The fact checkers:

Louis Jacobson:  writer, researcher
Martha Hamilton:  editor


Analysis:

Does PolitiFact focus on the underlying message this time with a Republican the subject of its fact check process?  By the end of the second paragraph it seems like it (bold emphasis added):
During the Oct. 2, 2011, edition of CBS’s Face the Nation, two governors -- Democrat Martin O’Malley of Maryland and Republican Haley Barbour of Mississippi -- faced off over a variety of political and policy issues.

At one point, Barbour parried O’Malley’s criticism of Republican economic policies by noting the size of President Barack Obama’s congressional majorities after he took office in early 2009. His argument was that Obama had significant legislative advantages that should have enabled him to do what he wanted policy-wise -- meaning that Obama can’t legitimately blame the Republicans for blocking what he wanted to do.
That's about as far as we get with the underlying point, however.  PolitiFact proceeds to satisfactorily demonstrate that Democrats on a number of occasions have held greater majorities than the majority enjoyed by Obama during his first years in office.

PolitiFact's conclusion?  "False":
It’s true that Democratic strength in Congress at the beginning of Obama’s term was the strongest it had been in 16 years. But that’s not what Barbour said -- he said the numbers were the strongest going back to President Johnson in the late 1960s. And that was not the case. We rate his statement False.
Have we changed our mind about the underlying point being the most important thing or what?

PolitiFact should check itself with the Flip-O-Meter.


The grades:

Louis Jacobson:  F
Martha Hamilton: F

The grades assume that Bill Adair isn't lying when he says the underlying point is the most important aspect of a numbers claim.


Afters:

I'd have no problem with the grade for Barbour if PolitiFact operated consistently.  But when Sarah Palin accurately states the rank of the U.S. for defense spending as a percentage of GDP she receives a "Barely True" based on her underlying point.  In contrast to Palin, Senator Barbara Boxer gets a benefit from having her underlying argument ignored in addition to kid-gloves treatment of her raw numbers to the tune of "Mostly True."

Gov. Haley Barbour of Mississippi is simply the latest conservative to suffer relative harm from PolitiFact's inconsistent application of standards.