Opportunities and Challenges for Augmented Environments: A Distributed Cognition Perspective

Currently a new generation of inexpensive digital recording devices and storage facilities is revolutionizing data collection in behavioral science, extending it into situations that have not been typically accessible and enabling the exami- nation of the fine details of action captured in meaningful settings. The ability to record and share such data has not only created a critical moment in the practice and scope of behavioral research but also presents unprecedented opportunities and challenges for the design of future augmented environments. In this chapter, we discuss these challenges and argue that fully capitalizing on the associated oppor- tunities requires theoretical and methodological frameworks to effectively analyze data that capture the richness of real-world human activity. We sample five recent research projects from our laboratory chosen to exemplify a distributed cognition perspective and highlight opportunities and challenges relevant to the design and evaluation of augmented environments.

[1]  James D. Hollan,et al.  Bridging Ethnography and Engineering through the Graphical Language of Petri Nets , 2005 .

[2]  B. Nardi.  Context and consciousness: activity theory and human-computer interaction , 1995 .

[3]  Robin Wooffitt,et al.  Conversation Analysis: Principles, Practices and Applications , 1998 .

[4]  Marina Basu.  The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[5]  E. Thompson.  Mind in Life , 2007 .

[6]  J. Porac,et al.  Cognition and Communication at Work , 1999 .

[7]  Kevin Warwick.  Natural-born cyborgs: Minds, technologies and the future of human intelligence , 2003 .

[8]  E. Hutchins.  Cognition in the wild , 1995 .

[9]  B. Rogoff.  The Cultural Nature of Human Development , 2003 .

[10]  Edwin Hutchins.  How a Cockpit Remembers Its Speeds , 1995 .

[11]  Edwin Hutchins,et al.  How a Cockpit Remembers Its Speeds , 1995, Cogn. Sci..

[12]  E. Boer,et al.  A collaborative approach for human-centered driver assistance systems , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[13]  J. Lave,et al.  Understanding Practice: Perspectives on Activity and Context , 1996 .

[14]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[15]  Bill N. Schilit,et al.  Beyond paper: supporting active reading with free form digital ink annotations , 1998, CHI.

[16]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[17]  James D. Hollan,et al.  Capturing and Restoring the Context of Everyday Work: A Case Study at a Law Office , 2009, HCI.

[18]  R. Pea.  Practices of distributed intelligence and designs for education , 1993 .

[19]  Ganesh S. Oak.  Information Visualization Introduction , 2022 .

[20]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[21]  W. Freeman,et al.  Reclaiming cognition : the primacy of action, intention and emotion , 1999 .

[22]  Anne Marie Piper,et al.  Supporting medical conversations between deaf and hearing individuals with tabletop displays , 2008, CSCW.

[23]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[25]  J. Lave.  Cognition in Practice: Notes , 1988 .

[26]  M. Cole.  Cultural psychology: a once and future discipline? , 1996, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[27]  Paul A. Viola,et al.  Fast and Robust Classification using Asymmetric AdaBoost and a Detector Cascade , 2001, NIPS.

[28]  James D. Hollan,et al.  Chapter 2 – Information Visualization , 1997 .

[29]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[30]  Michael B. Kac,et al.  Directions in Sociolinguistics: The Ethnography of Communication , 1975 .

[31]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[32]  J. Chatwin.  Conversation analysis. , 2004, Complementary therapies in medicine.

[33]  S. Vereza.  Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[34]  Charles Goodwin.  Language and Gesture: Gesture, aphasia, and interaction , 2000 .

[35]  Charles Goodwin,et al.  Emotion within Situated Activity , 2000 .

[36]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[37]  R. D'Andrade.  The Development of Cognitive Anthropology , 1995 .

[38]  Edwin Hutchins,et al.  Distributed Cognition in an Airline Cockpit , 1996 .

[39]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[40]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[41]  James D. Hollan,et al.  Papiercraft: A gesture-based command system for interactive paper , 2008, TCHI.

[42]  Susan Goldin.  Hearing gesture : how our hands help us think , 2003 .

[43]  Edwin Hutchins,et al.  The uses of paper in commercial airline flight operations , 2006, CSCW '06.

[44]  James D. Hollan,et al.  Edit wear and read wear , 1992, CHI.

[45]  J. A. Robinson,et al.  Temporal reference systems and autobiographical memory , 1986 .

[46]  Alessandro Duranti,et al.  Linguistic anthropology : a reader , 2009 .

[47]  R. Bauman,et al.  Explorations in the Ethnography of Speaking: Notes , 1989 .

[48]  E. Tulving.  [Episodic memory: from mind to brain]. , 2004, Revue neurologique.

[49]  Paul Dourish,et al.  Where the action is , 2001 .

[50]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[51]  D. McNeill.  Gesture and Thought , 2005 .

[52]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[53]  Discussing Conversation Analysis , 2003 .

[54]  Paul J. Thibault,et al.  Discussing conversation analysis : the work of Emanuel A. Schegloff , 2003 .

[55]  A. Clark.  Being There: Putting Brain, Body, and World Together Again , 1996 .

[56]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[57]  D. Lewkowicz,et al.  A dynamic systems approach to the development of cognition and action. , 2007, Journal of cognitive neuroscience.

[58]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[59]  Javier R. Movellan,et al.  3D Tracking of Morphable Objects Using Conditionally Gaussian Nonlinear Filters , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[60]  Johan F. Hoorn,et al.  Distributed cognition , 2005, Cognition, Technology & Work.

[61]  P. Agre.  Lucy A. Suchman, Plans and Situated Actions: The Problem of Human-Machine Commuinication (Cambridge University Press, Cambridge 1987) , 1990, Artif. Intell..

[62]  M. S. Shum,et al.  The role of temporal landmarks in autobiographical memory processes. , 1998, Psychological bulletin.

[63]  Alva Noë,et al.  Action in Perception , 2006, Representation and Mind.

[64]  Scott R. Klemmer,et al.  ButterflyNet: Mobile Capture and Access for Biologists , 2005 .

[65]  Guido E. Vallejos.  Mindware: An introduction to the philosophy of cognitive science , 2010 .