'Neither agree, nor disagree': a critical analysis of the middle answer category in Voting Advice Applications

This paper explores the meanings attributed to the middle category of a 5–point Likert scale that is commonly used by Voting Advice Applications (VAAs). Data was collected from 71 users of the VAA 'Helpmevote' (October 2010 for the Greek local elections), who were asked to justify their middle point answers. According to thematic analysis of the participants' answers, the middle points were used to convey lack of knowledge, but also dilemmas and rejection of the items' assumptions. Such findings address methodological issues related to the design of VAAs and set some goals for their future design.

[1]  Marco Lisi,et al.  Voting Advice Applications in Europe: The State of the Art , 2010 .

[2]  A. Hernández.  Escalas de respuesta tipo Likert. ¿Es relevante la alternativa 'indiferente'? , 2001 .

[3]  Es R. Masters.  THE RELATIONSHIP BETWEEN NUMBER OF RESPONSE CATEGORIES AND RELIABILITY OF LIKERT‐TYPE QUESTIONNAIRES1 , 1974 .

[4]  K. Kaplan.  On the ambivalence-indifference problem in attitude theory and measurement: A suggested modification of the semantic differential technique. , 1972 .

[5]  Juan Sebastián Fernández-Prados,et al.  Análisis de las alternativas de respuestas intermedias mediante el modelo de escalas de clasificación , 2000 .

[6]  Robert L. Armstrong,et al.  The Midpoint on a Five-Point Likert-Type Scale , 1987 .

[7]  D. Holt,et al.  The Effects of Offering a Middle Response Option with Opinion Questions , 1980 .

[8]  Outi Ruusuvirta,et al.  Do online vote selectors influence electoral participation and the directionof the vote , 2009 .

[9]  A. Ahuvia,et al.  Traditional, Interpretive, and Reception Based Content Analyses: Improving the Ability of Content Analysis to Address Issues of Pragmatic and Theoretical Concern , 2001 .

[10]  A. Downs.  An Economic Theory of Political Action in a Democracy , 1957, Journal of Political Economy.

[11]  M. Wattenberg,et al.  Parties Without Partisans , 2002 .

[12]  Stephen A. Ayidiya,et al.  RESPONSE EFFECTS IN MAIL SURVEYS , 1990 .

[13]  E. Figgou.  Social psychological and lay understandings of prejudice, racism and discrimination : an exploration of their dilemmatic aspects. , 2002 .

[14]  Enrique Leon,et al.  UvA-DARE (Digital Academic Repository) Picking your party online: an investigation of Ireland's first online voting advice application , 2009 .

[15]  G. Moors,et al.  Exploring the effect of a middle response category on response style in attitude measurement , 2007, Quality & quantity.

[16]  Bernard Dubois,et al.  An Analysis of the Meaning of the Question Mark Response Category in Attitude Scales , 1975 .

[17]  Stefaan Walgrave,et al.  ‘Do the Vote Test’: The Electoral Effects of a Popular Vote Advice Application at the 2004 Belgian Elections , 2008 .

[18]  M. Goldberg.  A Cognitive Model of Innovative Behavior: the Interaction of Product and Self-Attitudes , 1971 .

[19]  F. J. Klopfer,et al.  The Middlemost Choice on Attitude Items , 1980 .

[20]  G. F. Bishop,et al.  EXPERIMENTS WITH THE MIDDLE RESPONSE ALTERNATIVE IN SURVEY QUESTIONS , 1987 .

[21]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[22]  J. L. Smith,et al.  Semi-Structured Interviewing and Qualitative Analysis , 1995 .

[23]  Stuart Macdonald,et al.  A Directional Theory of Issue Voting , 1989, American Political Science Review.

[24]  C. Coombs,et al.  “Don't Know” Item Ambiguity or Respondent Uncertainty? , 1976 .

[25]  L. Thurstone.  Attitudes Can Be Measured , 1928, American Journal of Sociology.

[26]  Michael Billig,et al.  Ideology and Opinions: Studies in Rhetorical Psychology , 1991 .

[27]  Jean M. Converse,et al.  Predicting No Opinion in the Polls , 1976 .

[28]  A. Ladner,et al.  Are Voting Advice Applica- tions (VVAs) more than Toys? First findings on Impact and Accountability of VAAs. , 2008 .

[29]  L. Cronbach.  Response Sets and Test Validity , 1946 .

[30]  J. Potter,et al.  Some problems underlying the theory of social representations , 1985 .

[31]  Steven D. Ashworth,et al.  The Impact of Item Readability on the Endorsement of the Midpoint Response in Surveys , 2007 .

[32]  Jan Fivaz,et al.  Impact of Voting Advice Applications (VAAs) on Voter Turnout and Their Potential Use for Civic Education , 2010 .

[33]  Patrick Sturgis,et al.  Fictitious Issues Revisited: Political Interest, Knowledge and the Generation of Nonattitudes , 2010 .

[34]  M. E. Shaw,et al.  Scales for the measurement of attitudes , 1967 .

[35]  M. Wattenberg,et al.  Parties without partisans : political change in advanced industrial democracies , 2000 .

[36]  Stefaan Walgrave,et al.  Voting Aid Applications and the Effect of Statement Selection , 2009 .

[37]  Norbert Schwarz,et al.  Response Effects in Surveys , 1987 .

[38]  Patrick Sturgis,et al.  Middle Alternatives Revisited , 2010 .

[39]  Christopher H. Achen.  Mass Political Attitudes and the Survey Response , 1975, American Political Science Review.

[40]  John P. Robinson,et al.  Questions and answers in attitude surveys , 1982 .

[41]  R. Johns,et al.  One Size Doesn’t Fit All: Selecting Response Scales For Attitude Items , 2005 .

[42]  D. Edwards.  Discourse and cognition , 1996 .

[43]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[44]  Jan Kleinnijenhuis,et al.  The Influence of Internet Consultants , 2008 .

[45]  Victor Thiessen,et al.  Methodological Artifacts in Measures of Political Efficacy and Trust: A Multiple Correspondence Analysis , 2001, Political Analysis.

[46]  M. Billig,et al.  The Political Psychology of Contemporary Anti-Politics: A Discursive Approach to the End-of-Ideology Era , 2001 .

[47]  Kurt Danziger,et al.  Naming the Mind: How Psychology Found Its Language , 1997 .

[48]  S. Presser,et al.  Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording, and Context , 1996 .

[49]  S. Presser,et al.  The Measurement of a Middle Position in Attitude Surveys , 1980 .

[50]  K. Gemenis.  Estimating parties’ policy positions through voting advice applications: Some methodological considerations , 2013 .

[51]  P. Converse.  The Nature of Belief Systems in Mass Publics , 2004 .

[52]  Ain Ramonaite,et al.  Voting Advice Applications in Lithuania: Promoting Programmatic Competition or Breeding Populism? , 2010 .

[53]  Duane F. Alwin,et al.  INFORMATION TRANSMISSION IN THE SURVEY INTERVIEW: NUMBER OF RESPONSE CATEGORIES AND THE RELIABILITY OF ATTITUDE MEASUREMENT , 1992 .