Process Tracing Analysis of Hurricane Information Displays

To study people's processing of hurricane forecast advisories, we conducted a computer-based experiment that examined 11 research questions about the information seeking patterns of students assuming the role of a county emergency manager in a sequence of six hurricane forecast advisories for each of four different hurricanes. The results show that participants considered a variety of different sources of information-textual, graphic, and numeric-when tracking hurricanes. Click counts and click durations generally gave the same results but there were some significant differences. Moreover, participants' information search strategies became more efficient over forecast advisories and with increased experience tracking the four hurricanes. These changes in the search patterns from the first to the fourth hurricane suggest that the presentation of abstract principles in a training manual was not sufficient for them to learn how to track hurricanes efficiently but they were able to significantly improve their search efficiency with a modest amount (roughly an hour) of practice. Overall, these data indicate that information search patterns are complex and deserve greater attention in studies of dynamic decision tasks.

[1]  R. Hertwig,et al.  The priority heuristic: making choices without trade-offs. , 2006, Psychological review.

[2]  J. Ford,et al.  Process tracing methods: Contributions, problems, and neglected research questions , 1989 .

[3]  Michael Schulte-Mecklenbeck,et al.  A Handbook of Process Tracing Methods for Decision Research. A Critical Review and User's Guide , 2011 .

[4]  M. Lindell,et al.  Communicating Environmental Risk in Multiethnic Communities , 2003 .

[5]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[6]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[7]  Earl J. Baker,et al.  Hurricane Evacuation Behavior , 1991, International Journal of Mass Emergencies & Disasters.

[8]  Carla S. Prater,et al.  Effects of Track and Threat Information on Judgments of Hurricane Strike Probability , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[9]  Paula J. Durlach,et al.  Change Blindness and Its Implications for Complex Monitoring and Control Systems Design and Operator Training , 2004, Hum. Comput. Interact..

[10]  Larry D. Rosen,et al.  An eye fixation analysis of multialternative choice , 1975, Memory & cognition.

[11]  Frank A. Drews,et al.  Chapter 2. Attention , 2008 .

[12]  D. Uttal,et al.  The malleability of spatial skills: a meta-analysis of training studies. , 2013, Psychological bulletin.

[13]  Gerald L. Lohse,et al.  A Comparison of Two Process Tracing Methods for Choice Tasks , 1996 .

[14]  L Christensen,et al.  The effect of social influence on response to hurricane warnings*. , 1980, Disasters.

[15]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[16]  Chester L. Olson,et al.  Comparative Robustness of Six Tests in Multivariate Analysis of Variance , 1974 .

[17]  John H. Sorensen,et al.  Hazard Warning Systems: Review of 20 Years of Progress , 2000 .

[18]  E. Peters Beyond Comprehension , 2012 .

[19]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[20]  Baruch Fischhoff,et al.  Evaluating Risk Communications: Completing and Correcting Mental Models of Hazardous Processes, Part II , 1994 .

[21]  Martijn C. Willemsen,et al.  Visiting the decision factory : observing cognition with MouselabWEB and other information acquisition methods , 2011 .

[22]  J. Stevens Applied Multivariate Statistics for the Social Sciences , 1986 .

[23]  J. Hair Multivariate data analysis : a global perspective , 2010 .

[24]  Joseph G. Johnson,et al.  Pupil Dilation and Eye Tracking , 2011 .

[25]  Priti Shah,et al.  Chapter 3. Working Memory , 2008 .

[26]  J. Stevens,et al.  Applied multivariate statistics for the social sciences, 4th ed. , 2002 .

[27]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[28]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[29]  M. Lindell,et al.  Evacuation planning in emergency management , 1981 .

[30]  Anthony Leiserowitz,et al.  Misinterpretations of the “Cone of Uncertainty” in Florida during the 2004 Hurricane Season , 2007 .

[31]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[32]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[33]  T. Drabek Human System Responses to Disaster: An Inventory of Sociological Findings , 2011 .

[34]  Michael K. Lindell,et al.  Strike probability judgments and protective action recommendations in a dynamic hurricane tracking task , 2015, Natural Hazards.

[35]  Richard K. Lowe Components of Expertise in the Perception and Interpretation of Meteorological Charts , 2001, Interpreting Remote Sensing Imagery.

[36]  M. Lindell Cognitive and Outcome Feedback in Multiple-Cue Probability Learning Tasks. , 1976 .

[37]  Kenneth Broad,et al.  Dynamic Simulation as an Approach to Understanding Hurricane Risk Response: Insights from the Stormview Lab , 2013, Risk analysis : an official publication of the Society for Risk Analysis.

[38]  Ronald W. Perry,et al.  Behavioral foundations of community emergency planning , 1992 .

[39]  Donald H. House,et al.  Visualizing Uncertainty in Predicted Hurricane Tracks , 2013 .

[40]  E. Baker Public Response to Hurricane Probability Forecasts , 1995 .

[41]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[42]  Michael K Lindell,et al.  The Protective Action Decision Model: Theoretical Modifications and Additional Evidence , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[43]  Waldemar Karwowski,et al.  Visual, Tactile, and Multimodal Information Processing , 2006 .

[44]  K A Ericcson,et al.  Acquisition of a memory skill. , 1980, Science.

[45]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.