A comparison of techniques used to collect informed public opinions about CCS: opinion quality after focus group discussions versus information-choice questionnaires

Both focus group discussions and information-choice questionnaires (ICQs) have previously been used to examine informed public opinions about carbon dioxide capture and storage (CCS). This paper presents an extensive experimental study to systematically examine and compare the quality of opinions created by these two research techniques. Depending on experimental condition, participants either participated in a focus group meeting or completed an ICQ. In both conditions participants received identical factual information about two specific CCS options. After having processed the information, they indicated their overall opinion about each CCS option. The quality of these opinions was determined by looking at three outcome-oriented indicators of opinion quality: consistency, stability, and confidence. Results for all three indicators showed that ICQs yielded higher-quality opinions than focus groups, but also that focus groups did not perform poor in this regard. Implications for the choice between focus group discussions and ICQs are discussed.

[1]  Dennis F. Thompson,et al.  Democracy and Disagreement , 1996 .

[2]  Gwen M. Wittenbaum,et al.  Management of information in small groups. , 1996 .

[3]  S. Chambers,et al.  Reasonable Democracy: Jürgen Habermas and the Politics of Discourse , 1996 .

[4]  Richard A. Krueger,et al.  Focus groups : a practical guide for applied research / by Richard A. Krueger , 1989 .

[5]  Emma ter Mors,et al.  It's not only about safety: Beliefs and attitudes of 811 local residents regarding a CCS project in Barendrecht , 2012 .

[6]  Kenshi Itaoka,et al.  A study on roles of public survey and focus groups to assess public opinions for CCS implementation , 2011 .

[7]  P. Converse.  The Nature of Belief Systems in Mass Publics , 2004 .

[8]  Jason Barabas,et al.  How Deliberation Affects Policy Opinions , 2004, American Political Science Review.

[9]  Robert S. Baron,et al.  So Right It's Wrong: Groupthink and the Ubiquitous Nature of Polarized Group Decision Making , 2005 .

[10]  John Gastil,et al.  Increasing Political Sophistication Through Public Deliberation , 1999 .

[11]  Linda C. Lederman,et al.  Assessing educational effectiveness: The focus group interview as a technique for data collection 1 , 1990 .

[12]  Dancker D.L. Daamen,et al.  A critical test of the choice questionnaire for collecting informed public opinions , 1997 .

[13]  J. Simmons,et al.  Distinguishing the cognitive and behavioral consequences of attitude importance and certainty: A new approach to testing the common-factor hypothesis , 2003 .

[14]  J. Kitzinger,et al.  Qualitative Research: Introducing focus groups , 1995 .

[15]  André Faaij,et al.  Informed and uninformed public opinions on CO2 capture and storage technologies in the Netherlands , 2009 .

[16]  Willem E. Saris,et al.  An instrument for collecting informed opinions , 1992 .

[17]  Shaila M. Miranda,et al.  Avoidance of Groupthink , 1994 .

[18]  John T. Cacioppo,et al.  The Elaboration Likelihood Model of Persuasion , 1986, Advances in Experimental Social Psychology.

[19]  P. Tetlock,et al.  Accounting for the effects of accountability. , 1999, Psychological bulletin.

[20]  Gene Rowe,et al.  Lay perceptions of carbon capture and storage technology , 2010 .

[21]  Robert W. Oldendick,et al.  Pseudo-Opinions on Public Affairs , 1980 .

[22]  N. Allum,et al.  A Different Take on the Deliberative Poll Information, Deliberation, and Attitude Constraint , 2005 .

[23]  Gabrielle Wong-Parodi,et al.  The Role of Social Factors in Shaping Public Perceptions of CCS: Results of Multi-State Focus Group Interviews in the U.S. , 2009 .

[24]  M. Roman,et al.  Carbon capture and storage in developing countries: A comparison of Brazil, South Africa and India , 2011 .

[25]  James N. Druckman,et al.  Political Preference Formation: Competition, Deliberation, and the (Ir)relevance of Framing Effects , 2004, American Political Science Review.

[26]  A. Tuchfarber,et al.  Effects of Filter Questions in Public Opinion Surveys , 1983 .

[27]  Mark Jaccard,et al.  Anticipating public attitudes toward underground CO2 storage , 2009, International Journal of Greenhouse Gas Control.

[28]  James S. Fishkin,et al.  The Voice of the People: Public Opinion and Democracy , 1995 .

[29]  L. Festinger.  A Theory of Social Comparison Processes , 1954 .

[30]  I. Janis,et al.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment , 1977 .

[31]  Andrea Ramírez,et al.  Informed public opinion in the Netherlands: Evaluation of CO2 capture and storage technologies in comparison with other CO2 mitigation options , 2012 .

[32]  William J. McGuire,et al.  The Effectiveness of Supportive and Refutational Defenses in Immunizing and Restoring Beliefs Against Persuasion , 1961 .

[33]  L. Festinger.  Informal social communication. , 1950, Psychological review.

[34]  Michaela Wänke,et al.  Semantic and Pragmatic Aspects of Context Effects in Social and Psychological Research , 1991 .

[35]  Peter Lunt,et al.  Rethinking the focus group in media and communications research , 1996 .

[36]  Scott L. Althaus.  Information Effects in Collective Preferences , 1998, American Political Science Review.

[37]  R. Petty,et al.  Attitude strength: An overview. , 1995 .

[38]  Elizabeth L. Malone,et al.  Moving from misinformation derived from public attitude surveys on carbon dioxide capture and storage towards realistic stakeholder involvement , 2010 .

[39]  D. Knippenberg,et al.  PROVIDING INFORMATION IN PUBLIC OPINION SURVEYS: MOTIVATION AND ABILITY EFFECTS IN THE INFORMATION-AND-CHOICE QUESTIONNAIRE , 1996 .

[40]  J. Kitzinger.  The methodology of focus groups: the importance of interaction between research participants , 1994 .

[41]  Philip E. Tetlock,et al.  Accountability and complexity of thought. , 1983 .

[42]  John P. Robinson,et al.  Questions and answers in attitude surveys , 1982 .

[43]  Robert W. Oldendick,et al.  Opinions on Fictitious Issues: The Pressure to Answer Survey Questions , 1986 .

[44]  Peter Neijens,et al.  Opinion quality in public opinion research , 1997 .

[45]  Rachel M. Krause,et al.  Early public impressions of terrestrial carbon capture and storage in a coal-intensive state. , 2012, Environmental science & technology.

[46]  P. Neijens,et al.  Helping citizens decide in referendums: The moderating effect of political sophistication on the use of the Information and Choice Questionnaire as a decision aid , 2009 .

[47]  S. Chaiken,et al.  The psychology of attitudes. , 1993 .

[48]  Edward F. McQuarrie,et al.  Focus Groups: Theory and Practice , 1991 .

[49]  Amanda D. Boyd,et al.  Assessing socio-technical mindsets: Public deliberations on carbon capture and storage in the context of energy sources and climate change , 2013 .

[50]  P. Upham,et al.  Public perceptions of CCS: Emergent themes in pan-European focus groups and implications for communications , 2011 .

[51]  Robert K. Merton,et al.  The Focused Interview , 1956 .

[52]  Emma ter Mors,et al.  Effective communication about complex environmental issues: Perceived quality of information about carbon dioxide capture and storage (CCS) depends on stakeholder collaboration , 2010 .

[53]  R. Petty,et al.  Attitude strength : antecedents and consequences , 1995 .

[54]  Robert Cameron Mitchell,et al.  The Impact of "No Opinion" Response Options on Data Quality: Non-Attitude Reduction or an Invitation to Satisfice? , 2001 .

[55]  Peter Neijens,et al.  DELIBERATIVE POLLS: TOWARD IMPROVED MEASURES OF “INFORMED” PUBLIC OPINION? , 1998 .