You are hereBlogs / danielifearn's blog / Pundits predict no more accurately than a coin toss

Pundits predict no more accurately than a coin toss


By danielifearn - Posted on 04 May 2011

Krugman tops, Cal Thomas bottom of accurate predictors, according to study at Hamilton College

By Vige Barrie
May 2, 2011

Executive Summary

Full Report

Op-ed columnists and TV’s talking heads build followings by making bold, confident predictions about politics and the economy. But rarely are their predictions analyzed for accuracy.

Now, five Hamilton College seniors led by public policy professor P. Gary Wyckoff have analyzed the predictions of 26 prognosticators between September 2007 and December 2008. Their findings? Anyone can make as accurate a prediction as most of them if just by flipping a coin.

Their research paper, “Are Talking Heads Blowing Hot Air? An Analysis of the Accuracy of Forecasts in the Political Media” was presented via webcast on Monday, May 2, at www.hamilton.edu/pundit. The paper is also available at that address. Questions during the presentation were posed via Twitter using #hcpundit. The students responsible for this study include Holly Donaldson, Russell Doubleday, Scott Hefferman, Evan Klondar and Kate Tummarello.

The Hamilton students sampled the predictions of 26 individuals who wrote columns in major print media and who appeared on the three major Sunday news shows – Face the Nation, Meet the Press, and This Week – and evaluated the accuracy of 472 predictions made during the 16-month period. They used a scale of 1 to 5 (1 being “will not happen, 5 being “will absolutely happen”) to rate the accuracy of each, and then divided them into three categories: The Good, The Bad, and The Ugly.

The students found that only nine of the prognosticators they studied could predict more accurately than a coin flip. Two were significantly less accurate, and the remaining 14 were not statistically any better or worse than a coin flip.

The top prognosticators – led by New York Times columnist Paul Krugman – scored above five points and were labeled “Good,” while those scoring between zero and five were “Bad.” Anyone scoring less than zero (which was possible because prognosticators lost points for inaccurate predictions) were put into “The Ugly” category. Syndicated columnist Cal Thomas came up short and scored the lowest of the 26.

Even when the students eliminated political predictions and looked only at predictions for the economy and social issues, they found that liberals still do better than conservatives at prediction. After Krugman, the most accurate pundits were Maureen Dowd of The New York Times, former Pennsylvania Governor Ed Rendell, U.S. Senator Chuck Schumer (D-NY), and former House Speaker Nancy Pelosi – all Democrats and/or liberals. Also landing in the “Good” category, however, were conservative columnists Kathleen Parker and David Brooks, along with Bush Administration Treasury Secretary Hank Paulson. Left-leaning columnist Eugene Robinson of The Washington Post rounded out the “good” list.

Those scoring lowest – “The Ugly” – with negative tallies were conservative columnist Cal Thomas; U.S. Senator Lindsey Graham (R-SC); U.S. Senator Carl Levin (D-MI); U.S. Senator Joe Lieberman, a McCain supporter and Democrat-turned-Independent from Connecticut; and Sam Donaldson of ABC.

Landing between the two extremes – “The Bad” – were Howard Wolfson, communications director for Hillary Clinton’s 2008 campaign; former Arkansas Governor Mike Huckabee, a hopeful in the 2008 Republican primary; former House Speaker Newt Gingrich, a Republican; Sen. John Kerry of Massachusetts, the Democratic nominee for president in 2004; liberal columnist Bob Herbert of The New York Times; Andrea Mitchell of NBC; New York Times columnist Tom Friedman; the late David Broder, former columnist for The Washington Post; Chicago Tribune columnist Clarence Page; New York Times columnist Nicholas Kristof;
Hillary Clinton; and conservative George Will.

The group also found a link between conditional predictions and accuracy, that is, a prediction that was conditional (“If A, then B”) was less likely to be accurate. Finally, those prognosticators with a law degree were more likely to be wrong.

Contact: P. Gary Wyckoff, professor of government and director of the Public Policy Program at Hamilton College, at 315-859-4198 or pwyckoff@hamilton.edu.

Speaking Events

2016

 

March 24, Boone, NC.

 

March 25, Asheville, NC
Battery Park Apartments, 1 Battle Square, rooftop room, noon - 2 p.m.
Sign up on FB.

 

War Is A Lie: Second Edition
Published April 5, 2016
Tour begins here:

April 11, Washington, DC, 6:30-8:00 p.m. at Busboys and Poets at 5th and K Streets.
Sign up on FB.

 

April 12, Baltimore, MD, 7:30 p.m. at Red Emma's.
Sign up on FB.

 

April 14, Bellingham, WA, 7:00-9:00 p.m. at Bellingham Unitarian Fellowship.
Sign up on FB.

 

April 15, Seattle, WA
Town Hall Seattle
1119 Eighth Ave (8th and Seneca) 
Seattle, WA 98101
7:30pm
Sign up on FB.

 

April 16 Portland, OR

 

April 24, Oneonta, NY at Unitarian Universalist Society of Oneonta.
5:30 discussion with students.
7:00 talk and Q&A with everyone.
Sign up on FB.

 

May 28, San Francisco, CA
11 a.m. to 1 p.m., David Swanson interviewed by Daniel Ellsberg, at San Francisco Main Public Library, 100 Larkin Street.
Sign up on FB.



May 28, Marin County, CA
4 to 6 p.m., David Swanson in conversation with Norman Solomon, at Book Passage, 51 Tamal Vista Blvd., Corte Madera, CA
Sign up on FB.



May 29, Oakland, CA
3 to 4 p.m., David Swanson interviewed by Cindy Sheehan, at Diesel: A Bookstore, 5433 College Avenue at Kales (near Manila), Oakland, CA
Sign up on FB.



May 29, Berkeley, CA
7:30 to 9 p.m., David Swanson and Cindy Sheehan at Berkeley Fellowship of Unitarian Universalists, sponsored by the Social Justice Committee and Cynthia Papermaster, 1606 Bonita Ave. (at Cedar), Berkeley, CA
Sign up on FB.



May 30, Fresno, CA
2 to 4 p.m., David Swanson and Cindy Sheehan at a Peace Fresno event

 


June 11 St. Paul, MN, 6 p.m. at Macalester Plymouth Church Social Hall 1658 Lincoln, St. Paul, MN.
Sign up on FB.

 

June 12 Minneapolis, MN, 9 and 11 a.m. at St. Joan's 4533 3rd Ave So, Minneapolis, MN, plus peace pole dedication at 2 p.m.
Sign up on FB.

 

Other Events Here.

CHOOSE LANGUAGE

Support This Site

Donate.

Get free books and gear when you become a supporter.

 

Sponsors:

Speaking Truth to Empire

***

Families United

***

Ray McGovern

***

Financial supporters of this site can choose to be listed here.

Buy Books

Get Gear

The log-in box below is only for bloggers. Nobody else will be able to log in because we have not figured out how to stop voluminous spam ruining the site. If you would like us to have the resources to figure that out please donate. If you would like to receive occasional emails please sign up. If you would like to be a blogger here please send your resume.
CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.