Why Semantic Differentials in Web-Based Research Should Be Made from Visual Analogue Scales and Not from 5-Point Scales

In a web experiment, participants were randomly assigned to two semantic differentials either made from discrete 5-point ordinal rating scales or from continuous visual analogue scales (VASs) with 250 gradations. Respondents adjusted their ratings with VASs more often to maximize the precision of answers, which had a beneficial effect on data quality. No side effects like differences in means, higher dropout, more nonresponse, or higher response times were observed. Overall, the combination of semantic differentials and VASs results in a number of advantages. Potential for further research is discussed.

[1]  Katelyn Y. A. McKenna,et al.  Oxford Handbook of Internet Psychology , 2007 .

[2]  Sigrid Haunberger.  Edith de Leeuw, Joop J. Hox, Don A. Dillman (eds.) International Handbook of Survey Methodology. New York/London: Erlbaum/Taylor, 2008 [Rezension] , 2009 .

[3]  Seymour Sudman,et al.  Thinking about Answers: The Application of Cognitive Process to Survey Methodology , 1996 .

[4]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[5]  D. Dillman,et al.  International handbook of survey methodology. , 2008 .

[6]  Dirk Heerwegh,et al.  Explaining Response Latencies and Changing Answers Using Client-Side Paradata from a Web Survey , 2003 .

[7]  J. Gerich,et al.  Visual analogue scales for mode-independent measurement in self-administered questionnaires , 2007, Behavior research methods.

[8]  Ulf-Dietrich Reips,et al.  Psychological Aspects of Cyberspace: How Internet-Mediated Research Changes Science , 2008 .

[9]  Henkjan Honing,et al.  Web-based versus lab-based studies: A response to Kendall (2008) , 2008 .

[10]  Paul S. Myles,et al.  The pain visual analog scale: is it linear or nonlinear? , 1999, Anesthesia and analgesia.

[11]  J. Krosnick,et al.  Survey research. , 1999, Annual review of psychology.

[12]  Joeri Hofmans,et al.  On the linearity of predefined and self-anchoring Visual Analogue Scales. , 2008, The British journal of mathematical and statistical psychology.

[13]  Roger Tourangeau,et al.  Evaluating the Effectiveness of Visual Analog Scales , 2006 .

[14]  Ulf-Dietrich Reips,et al.  Sliders for the Smart: Type of Rating Scale on the Web Interacts With Educational Level , 2011 .

[15]  Paul van Schaik,et al.  A Comparison of Multi-Item Likert and Visual Analogue Scales for the Assessment of Transactionally Defined Coping Function , 2004 .

[16]  Marek Fuchs.  Mobile Web Surveys: A Preliminary Discussion of Methodological Implications , 2007 .

[17]  Ulf-Dietrich Reips,et al.  Design and Formatting in Internet-Based Research , 2010 .

[18]  Ulf-Dietrich Reips.  Standards for Internet-based experimenting. , 2002, Experimental psychology.

[19]  Ulf-Dietrich Reips,et al.  Sleep, sex, and the Web: Surveying the difficult-to-reach clinical population suffering from sexsomnia , 2007, Behavior research methods.

[20]  M. Averbuch,et al.  Assessment of Visual Analog versus Categorical Scale for Measurement of Osteoarthritis Pain , 2004, Journal of clinical pharmacology.

[21]  Samuel J. Best,et al.  Internet Data Collection , 2004 .

[22]  P. Myles,et al.  The Linearity of the Visual Analogue Scale in Patients with Severe Acute Pain , 2005, Anaesthesia and intensive care.

[23]  Michael Bosnjak,et al.  Participation in Non-Restricted Web-Surveys: A Typology and Explanatory Model for Item-Nonresponse , 2001 .

[24]  Ulf-Dietrich Reips,et al.  The methodology of Internet-based experiments , 2009 .

[25]  Azy Barak,et al.  Psychological Aspects of Cyberspace: Theory, Research, Applications , 2008 .

[26]  Jolene D. Smyth,et al.  Effects of Using Visual Design Principles to Group Response Options in Web Surveys , 2006 .

[27]  R. Cork,et al.  A Comparison Of The Verbal Rating Scale And The Visual Analog Scale For Pain Assessment , 2003 .

[28]  Anja S. Göritz,et al.  Incentives in Web Studies: Methodological Issues and a Review , 2006 .

[29]  P. McReynolds,et al.  On the history of rating scales , 1987 .

[30]  C. Osgood.  The nature and measurement of meaning. , 1952, Psychological bulletin.

[31]  N. Schwarz,et al.  Asking Questions About Behavior: Cognition, Communication, and Questionnaire Construction , 2001 .

[32]  Roger Tourangeau,et al.  Evaluating the Effectiveness of Visual Analog Scales : A Web Experiment , 2006 .

[33]  Ulf-Dietrich Reips,et al.  How internet-mediated research changes science , 2008 .

[34]  M. Traugott,et al.  Web survey design and administration. , 2001, Public opinion quarterly.

[35]  Stefan Stieger,et al.  What are participants doing while filling in an online questionnaire: A paradata collection tool and an empirical study , 2010, Comput. Hum. Behav..

[36]  N. Schwarz.  Self-reports: How the questions shape the answers. , 1999 .

[37]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[38]  F. Conrad,et al.  Spacing, Position, and Order Interpretive Heuristics for Visual Features of Survey Questions , 2004 .

[39]  N. Schwarz,et al.  Thinking About Answers: The Application of Cognitive Processes to Survey Methodology , 1995, Quality of Life Research.

[40]  Roger Tourangeau,et al.  Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding. , 2008, Public opinion quarterly.

[41]  Ulf-Dietrich Reips,et al.  Interval-level measurement with visual analogue scales in Internet-based research: VAS Generator , 2008, Behavior research methods.