Ethnographic Methods for Experimental Design: Case Studies in Visual Search

Researchers at Sandia National Laboratories are integrating qualitative and quantitative methods from anthropology, human factors and cognitive psychology in the study of military and civilian intelligence analyst workflows in the United States’ national security community. Researchers who study human work processes often use qualitative theory and methods, including grounded theory, cognitive work analysis, and ethnography, to generate rich descriptive models of human behavior in context. In contrast, experimental psychologists typically do not receive training in qualitative induction, nor are they likely to practice ethnographic methods in their work, since experimental psychology tends to emphasize generalizability and quantitative hypothesis testing over qualitative description. However, qualitative frameworks and methods from anthropology, sociology, and human factors can play an important role in enhancing the ecological validity of experimental research designs.

[1]  Anthony J. Hornof,et al.  High-cost banner blindness: Ads increase perceived workload, hinder visual search, and are forgotten , 2005, TCHI.

[2]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[3]  Colin G. Drury,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[4]  R. Klein,et al.  On the manifestations of memory in visual search. , 2000, Spatial vision.

[5]  N. Naikar Cognitive Work Analysis: Foundations, Extensions, and Challenges , 2011 .

[6]  Catherine M. Burns,et al.  Applications of cognitive work analysis , 2008 .

[7]  Yvonne Wengström,et al.  Combining qualitative and quantitative research within mixed method research designs: A methodological review , 2011, International Journal of Nursing Studies.

[8]  Linden J. Ball,et al.  Putting ethnography to work: the case for a cognitive ethnography of design , 2000, Int. J. Hum. Comput. Stud..

[9]  R. Clark,et al.  Cognitive task analysis for training , 1996 .

[10]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[11]  J. M. Christian Bastien,et al.  Usability testing: a review of some methodological and technical aspects of the method , 2010, Int. J. Medical Informatics.

[12]  Susan M. Stevens-Adams,et al.  Effects of Professional Visual Search Experience on Domain-General and Domain-Specific Visual Cognition , 2015, HCI.

[13]  David Benyon,et al.  Ethnography, theory and systems design: from intuition to insight , 2000, Int. J. Hum. Comput. Stud..

[14]  Valerie L. Shalin,et al.  Cognitive task analysis , 2000 .