A Statement by the National Council on Public Polls' Polling Review Board August 4, 2000
MSNBC's QUESTIONABLE REPUBLICAN CONVENTION POLLS
NBC News for many years was widely known for reliable news reporting. At this year's Republican National Convention it is giving the public unreliable reports of public opinion about events at the convention. In a two-pronged assault on its own credibility NBC is reporting results of focus groups conducted by Republican pollster and consultant, Frank Luntz. On opening night of the convention he called the focus group's utterances "representative" opinion.
Also, on its MSNBC.com web page, it has what it calls a National Internet Focus Group run by SpeakOut.com. This web focus group gives anyone who chooses to participate the opportunity to express a second-by-second reaction to key prime-time speeches. Erik Sorenson, the head of MSNBC said, "we'll be able to go directly to the people and find out what they're thinking." If he means a representative sample we disagree.
Focus groups usually consist of moderated discussions among small groups of people. They are generally chosen because of some background characteristic related to the topic being studied. The Luntz panel includes 36 voters who said when selected that they were uncommitted in their presidential preference this year. The SpeakOut panel includes as many web surfers as care to take the time to give their opinions.
While focus groups are useful for supplying context and nuance about a variety of issues or topics they are not a reliable gauge of public opinion on these subjects. Conclusions about what percentage of the general public holds a particular view, or any generalizations about the public, cannot be made from a focus group. Luntz talks about Republicans', Democrats' and independents' opinions as though they applied to all members of those groups in the general public. In fact, those are only the opinions of those in his focus group. There is nothing scientific about these focus groups. They are more akin to a parlor game than to a public opinion poll.
While many news organizations have their news polling conducted by non-partisan pollsters (or a bi- partisan pairing) Luntz is widely known for his work in behalf of Republicans. YROCK.com, a Web site and Internet service run by the National Young Republicans, sponsors the Luntz focus group. Luntz was instrumental in conducting research for the Contract With America. The American Association for Public Opinion Research found Luntz, in violation of its ethics code when he repeatedly refused to make public essential facts that supported the conclusions promoted by the Newt Gingrich led GOP caucus.
Live reports of Luntz focus group are part of the MSNBC convention coverage. The group, when urged by Luntz, has voiced it opinions on its current leanings for President, its opinions of Vice President designate, Dick Cheney, and its reactions to Colin Powell's speech on opening night. An MSNBC press release said the opinions of the Luntz effort would be compared to the reactions of the SpeakOut panel - a meaningless exercise, if ever there was one.
For more information about this and other polling issues see: http://www.ncpp.org/home.htm NCPP Polling Review Board Members: Chairman: Harry O'Neill, Roper Starch Worldwide 609 921-3333 x228 Warren Mitofsky, Mitofsky International 212 980-3031 Humphrey Taylor, Harris Interactive 212 539-9657
Mitofsky International 1 East 53rd Street - 5th Floor New York, NY 10022
212 980-3031 Phone 212 980-3107 FAX mitofsky at mindspring.com