Evaluating a Geovisualization Prototype with Two Approaches: Remote Instructional vs. Face-to-Face Exploratory

Two evaluations of a prototype designed to help expert users visualize key census statistics are conducted. The results yielded are compared in terms of usability issues, task completion (interaction) and ideation facilitated. Ways in which this information may be affected by the use of different data collection techniques, participants and tasks are considered. We report differences in the results of the evaluations in each of the three areas and suggest that flexible and non-disruptive methods be used to investigate whether geovisualization tools can support knowledge construction. We recommend using exploratory tasks, employing 'think aloud' strategies, requiring users to suggest and explain hypotheses and using screen capture to contextualise the data collected

[1]  J. Morse.  Interpreting qualitative data: Methods for analysing talk, text and interaction , 1996 .

[2]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[3]  Jason Dykes,et al.  Cartographic visualization: exploratory spatial data analysis with local indicators of spatial association using Tcl/Tk and cdv , 1998 .

[4]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[5]  Robert A. Virzi,et al.  Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? , 1992 .

[6]  D. Silverman.  Interpreting Qualitative Data: Methods for Analysing Talk, Text and Interaction , 1994 .

[7]  A. MacEachren,et al.  Research Challenges in Geovisualization , 2001, KN - Journal of Cartography and Geographic Information.

[8]  Alan M. MacEachren,et al.  Understanding how scientists use data-display devices for interactive visual computing with geographical models , 2004 .

[9]  Alfred Inselberg,et al.  The plane with parallel coordinates , 1985, The Visual Computer.

[10]  Owen Williams.  Census Geography Data Unit (UKBORDERS) , 2005 .

[11]  Jason Dykes,et al.  CARTOGRAPHIC VISUALIZATION FOR SPATIAL ANALYSIS , 1999 .

[12]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[13]  J. Calderhead.  STIMULATED RECALL: A METHOD FOR RESEARCH ON TEACHING , 1981 .

[14]  Karen A. Gresty,et al.  Reflecting on the think-aloud method for evaluating e-learning , 2006, Br. J. Educ. Technol..

[15]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .