Supporting Naturalistic Decision Making Through Location-Based Photography: A Study of Simulated Military Reconnaissance

Close Target Reconnaissance (CTR) patrols can be characterized by activities that involve naturalistic decision making to develop situation awareness through processes of sense-making. Any technology that is introduced into such activity needs to be sufficiently “invisible” so as not to disrupt or otherwise interfere with the activities of search and interpretation. It is proposed that some technologies, such as imaging devices, can support recognition-primed decision making (RPDM). It is suggested that providing CTR patrols with cameras could supplement existing technologies, such as night vision goggles or binoculars, and provide an opportunity to capture useful intelligence. The concept of location-based photography (in which metadata are collected in parallel with images) provides a means of effectively producing patrol reports in real time. A prototype system is described and trialled comparing conventional practices surrounding note-taking and report writing with the use of location-based photography. The results show little difference in time spent patrolling under the two conditions but significant improvement in reporting under the location-based photography condition. One explanation of these differences relate to the manner in which note taking provides support for sense-making but could interfere with RPDM (through the need to analyze the situation in sufficient detail to make notes), whereas imaging can be performed as part of the RPDM activity. Tagged images change the nature in which the reports are written in that sense-making is performed largely post hoc, which allows flexibility in interpretation and analysis.

[1]  Dave Roberts,et al.  Designing for the User with OVID: Bridging the Gap Between Software Engineering and User Interface Design , 1998 .

[2]  Benjamin B. Bederson,et al.  Capture, Annotate, Browse, Find, Share: Novel Interfaces for Personal Photo Management , 2007, Int. J. Hum. Comput. Interact..

[3]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[4]  Chris Baber,et al.  Supporting Crime Scene Investigation , 2007 .

[5]  Gary Klein,et al.  Rapid Decision Making on the Fire Ground , 1986 .

[6]  Gary Klein,et al.  Making Sense of Sensemaking 2: A Macrocognitive Model , 2006, IEEE Intelligent Systems.

[7]  Simon King,et al.  MMM2: mobile media metadata for media sharing , 2005, CHI EA '05.

[8]  Gary Klein,et al.  Making Sense of Sensemaking 1: Alternative Perspectives , 2006, IEEE Intelligent Systems.

[9]  T. Rickards Sense making in organizations , 1997 .

[10]  Peter J. Thomas,et al.  Ensemble Computing , 2001, Int. J. Hum. Comput. Interact..

[11]  George W. Furnas,et al.  Making sense of sensemaking , 2005, CHI Extended Abstracts.

[12]  Chris Baber,et al.  Crime scene investigation as distributed cognition , 2006 .

[13]  Ann Blandford,et al.  User Experience of Camera Phones in Social Contexts , 2008 .

[14]  Chris Baber,et al.  Mobile technology for crime scene examination , 2009, Int. J. Hum. Comput. Stud..

[15]  Jürgen Ziegler,et al.  Intuitive Human-Computer Interaction-Toward a User-Friendly Information Society , 2002, Int. J. Hum. Comput. Interact..

[16]  John R. Boyd,et al.  The Essence of Winning and Losing , 2012 .

[17]  Marc Davis,et al.  Photo annotation on a camera phone , 2004, CHI EA '04.

[18]  Marc Davis,et al.  Metadata creation system for mobile images , 2004, MobiSys '04.

[19]  D. Wright,et al.  Memory conformity: exploring misinformation effects when presented by another person. , 2000, British journal of psychology.

[20]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[21]  Brenda Dervin,et al.  Sense-making theory and practice: an overview of user interests in knowledge seeking and use , 1998, J. Knowl. Manag..

[22]  Chris Baber,et al.  Wearable Computers: A Human Factors Review , 2001, Int. J. Hum. Comput. Interact..

[23]  Daniel Fallman Mediated Reality Through Glasses or Binoculars? Exploring Use Models of Wearable Computing in the Context of Aircraft Maintenance , 2003, Int. J. Hum. Comput. Interact..

[24]  Dave Roberts,et al.  Crafting the Compelling User Experience , 2002, Int. J. Hum. Comput. Interact..