Factors affecting the amount of effort expended in responding to questions in behavioural choice experiments

Abstract A brief review of theoretical and empirical literature on the effort expended in making choices is followed by the description of an experiment in which participants were asked to respond to a series of road charging scenarios. Participants were asked to estimate the charges payable, to indicate their confidence in that estimate, to say how difficult they had found it to understand the scenario, and to indicate whether they would change their behaviour if the charges were introduced. The time they took to answer each question was recorded and background data was collected on their personal characteristics and attitudes as well as on their attitude to decision-making. Analysis of the resulting data shows that the time taken to estimate the charge and decide on a response varied not only with the characteristics of the scenario and with the order of presentation (indicating a learning, or fatigue, effect), but also with personal characteristics (notably age, educational attainment and self-reported decision-making style). The time taken to estimate a charge was significantly (and positively) related to the degree of difficulty reported and, although additional time devoted to making an estimate generally resulted in more accurate estimates, for the simplest scenarios, increased time taken was associated with reduced accuracy. These findings, particularly on the existence of groups with very different levels of motivation to make careful assessment of costs and benefits, and on the factors influencing the time taken to respond to questions, have implications for our understanding of real-world decision-making and for the way that we should collect and categorise choice data and model the decision-making process. The use of simple questions designed to elicit participants' attitudes to decision-making is seen to show great promise in this context.

[1]  Jane Fedorowicz,et al.  Tolerance for Ambiguity and IT Competency among Accountants , 2005, J. Inf. Syst..

[2]  J. Schade,et al.  Acceptability of urban transport pricing strategies , 2003 .

[3]  P Bonsall MOTIVATING THE RESPONDENT: HOW FAR SHOULD YOU GO? IN: IN PERPETUAL MOTION: TRAVEL BEHAVIOR RESEARCH OPPORTUNITIES AND APPLICATION CHALLENGES , 2002 .

[4]  R. Petty,et al.  The need to evaluate. , 1996 .

[5]  J. Maule,et al.  Responses to complex pricing signals: Theory, evidence and implications for road pricing , 2007 .

[6]  Peter Bonsall,et al.  DIFFERENT user reaction and efficient DIFFERENTiation of charges and tolls - psychological constraints of user reactions towards Differentiated charging; evaluation and recommendations Deliverable D4.2 , 2008 .

[7]  Michel Wedel,et al.  Response Latencies in the Analysis of Conjoint Choice Experiments , 2000 .

[8]  Peter Bonsall,et al.  Motivating the Respondent , 2002 .

[9]  R. Pollay A model of decision times in difficult decision situations. , 1970, Psychological review.

[10]  P Bonsall,et al.  Complex congestion charging - an assessment of motorists' comprehension and the impact on their driving behaviour , 2007 .

[11]  Charles S. Watson,et al.  Effects of decision criterion on response latencies of binary decisions , 1994, Perception & psychophysics.

[12]  W. Cain,et al.  Latency and accuracy of discriminations of odor quality between binary mixtures and their components. , 2000, Chemical senses.

[13]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[14]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[15]  J Onken,et al.  Individual differences in the use of simplification strategies in a complex decision-making task. , 1985, Journal of experimental psychology. Human perception and performance.

[16]  J. Cacioppo,et al.  The need for cognition. , 1982 .

[17]  Eric J. Johnson,et al.  A componential analysis of cognitive effort in choice , 1990 .

[18]  S. Budner Intolerance of ambiguity as a personality variable. , 1962, Journal of personality.

[19]  Richard W. Pollay,et al.  The Structure of Executive Decisions and Decision Times. , 1970 .

[20]  J. Rose,et al.  Means matter, but variance matter too: Decomposing response latency influences on variance heterogeneity in stated preference experiments , 2006 .