An ethnographic, action-based approach to human experience in virtual environments

This paper addresses a sensitive issue, of presence experienced by people interacting with a virtual environment (VE). Understanding 'presence', both theoretically and empirically, is important for designers interested in building effective computer-mediated environments for learning and work activities. The concept of presence has been treated mostly as a state of mind, to be investigated through 'objective' and 'subjective' measurement devices. The authors propose to add a different approach, which can address presence as an action-based process. This approach considers presence as the ongoing result of the actions performed in an environment and the local and cultural resources deployed by actors. In this sense, 'presence' can be captured by monitoring the sequence of participants' actions and the aspects of the environment that are involved in this process; discourse/interaction analysis represents a fitting method for this goal. Sequences of interaction with a virtual library are used to illustrate some core aspects of an ethnographic, action-based approach to presence, such as the action possibilities envisaged by participants, the configuration of the virtual objects, the norms that regulate the interaction, the resources that are imported in the VE. These aspects are a necessary step to understand users' presence in the VE and to plan consequent interventions to ameliorate the design of the interface.

[1]  Luciano Gamberini,et al.  Situated Breakdown Analysis for the Evaluation of a Virtual Environment , 2002 .

[2]  C. Murray,et al.  The experience of body boundaries by Siamese twins , 2001 .

[3]  Terry Winograd,et al.  Understanding computers and cognition , 1986 .

[4]  John Bowers,et al.  Talk and embodiment in collaborative virtual environments , 1996, CHI.

[5]  D. Norman The psychology of everyday things", Basic Books Inc , 1988 .

[6]  Mel Slater,et al.  A Virtual Presence Counter , 2000, Presence: Teleoperators & Virtual Environments.

[7]  Anna Spagnolli,et al.  Legitimating technologies: Ambiguity as a premise for negotiation in a networked institution , 2001, Inf. Technol. People.

[8]  Mark Mon-Williams,et al.  What does virtual reality NEED?: human factors issues in the design of three-dimensional computer environments , 1996, Int. J. Hum. Comput. Stud..

[9]  L. Suchman Plans and situated actions , 1987 .

[10]  James L. McClelland,et al.  Phenomenology of perception. , 1978, Science.

[11]  Thomas B. Sheridan,et al.  Descartes, Heidegger, Gibson, and God: Toward an Eclectic Ontology of Presence , 1999, Presence.

[12]  R. L. Campbell,et al.  Artifacts as psychological theories: the case of human-computer interaction , 1989 .

[13]  Mary Czerwinski,et al.  Human factors in virtual environments , 1998, Virtual Reality.

[14]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[15]  J. Malpas Place and Experience: A Philosophical Topography , 1999 .

[16]  David W. Schloerb,et al.  A Quantitative Measure of Telepresence , 1995, Presence: Teleoperators & Virtual Environments.

[17]  Y. Engeström,et al.  Perspectives on activity theory: Play, learning, and instruction , 1999 .

[18]  Deborah Walters,et al.  Embodied interaction in social virtual environments , 2000, CVE '00.

[19]  F. Biocca,et al.  Communication in the age of virtual reality , 1995 .

[20]  L Gamberini,et al.  Responding to a fire emergency in a virtual environment: different patterns of action for different situations. , 2003, Ergonomics.

[21]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[22]  D. Schiffrin Approaches to Discourse , 1997 .

[23]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[24]  FreemanJonathan,et al.  Using Behavioral Realism to Estimate Presence , 2000 .

[25]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[26]  Ken Hinckley,et al.  A survey of design issues in spatial input , 1994, UIST '94.

[27]  Rob Kling,et al.  Computerization and controversy (2nd ed.): value conflicts and social choices , 1995 .

[28]  I. S. Mackenzie,et al.  Virtual Environments and Advanced Interface Design , 1995 .

[29]  G. Riva,et al.  Modifications of Body-Image Induced by Virtual Reality , 1998, Perceptual and motor skills.

[30]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[31]  Brian Webb,et al.  Structure, causality, visibility and interaction: propositions for evaluating engagement in narrative multimedia , 2000, Int. J. Hum. Comput. Stud..

[32]  Woodrow Barfield,et al.  Virtual environments and advanced interface design , 1995 .

[33]  Wijnand A. IJsselsteijn,et al.  Using Behavioral Realism to Estimate Presence: A Study of the Utility of Postural Responses to Motion Stimuli , 2000, Presence: Teleoperators & Virtual Environments.

[34]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[35]  Shoshana Zuboff In the Age of the Smart Machine , 1988 .

[36]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[37]  J. Shaoul Human Error , 1973, Nature.

[38]  Morten Kyng,et al.  Design at Work , 1992 .

[39]  Steve Pettifer,et al.  Navigation, Wayfinding, and Place Experience within a Virtual City , 2000, Presence: Teleoperators & Virtual Environments.

[40]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[41]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[42]  Judith Sixsmith,et al.  The corporeal body in virtual reality. , 1999 .

[43]  Helen Z. Margetts,et al.  Computerization and Controversy: Value Conflicts and Social Choices , 1993, J. Inf. Technol..

[44]  Mike Crang,et al.  Virtual Geographies: Bodies, Space and Relations , 1999 .

[45]  Holger Regenbrecht,et al.  Real and Illusory Interactions Enhance Presence in Virtual Environments , 2002, Presence: Teleoperators & Virtual Environments.

[46]  A. Duranti Language and Bodies in Social Space: Samoan Ceremonial Greetings , 1992 .

[47]  Eva Lindh Waterworth,et al.  Focus, Locus, and Sensus: The Three Dimensions of Virtual Experience , 2001, Cyberpsychology Behav. Soc. Netw..

[48]  Lucy Suchman,et al.  Understanding practice: video as a medium for reflection and design (excerpt) , 1992 .

[49]  Mary Beth Rosson,et al.  Critical incidents and critical threads in empirical usability evaluation , 1993 .

[50]  J. Atkinson,et al.  A change-of-state token and aspects of its sequential placement , 1985 .

[51]  Giuseppe Riva,et al.  Real Presence: How Different Ontologies Generate Different Criteria for Presence, Telepresence, and Virtual Presence , 1999, Presence.

[52]  Elizabeth Towell,et al.  Presence in Text-Based Networked Virtual Environments or MUDS , 1997, Presence: Teleoperators & Virtual Environments.

[53]  B. Latour,et al.  Laboratory Life: The Construction of Scientific Facts , 1979 .

[54]  Graham Button,et al.  Published in: Technology in Working Order: Studies of Work, Interaction, and Technology, , 2022 .

[55]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[56]  Woodrow Barfield,et al.  Presence and performance within virtual environments , 1995 .

[57]  Frank Biocca,et al.  Virtual Reality Technology: A Tutorial , 1992 .

[58]  Shoshana Zuboff,et al.  In the Age of the Smart Machine: The Future of Work and Power , 1989 .

[59]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[60]  E. Schegloff Some Practices for Referring to Persons in Talk-in-Interaction: A Partial Sketch of a Systematics , 1996 .

[61]  Giuseppe Riva,et al.  The need for a socio-cultural perspective in the implementation of virtual environments , 2000, Virtual Reality.

[62]  J. C. Flanagan Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[63]  Janet Fulk,et al.  Organizations and Communication Technology , 1990 .

[64]  G. Mantovani New Communication Environments: From Everyday to Virtual , 1996 .

[65]  John M. Flach,et al.  The Reality of Experience: Gibson's Way , 1998, Presence.

[66]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[67]  D. Norman The psychology of everyday things , 1990 .

[68]  Wanda J. Orlikowski,et al.  Studying Information Technology in Organizations: Research Approaches and Assumptions , 1991, Inf. Syst. Res..

[69]  Cristina Zucchermaglio,et al.  Organizational Learning and Technological Change , 1995, NATO ASI Series.

[70]  Matthew Lombard,et al.  MEASURING PRESENCE: A LITERATURE-BASED APPROACH TO THE DEVELOPMENT OF A STANDARDIZED PAPER-AND-PENCIL INSTRUMENT , 2000 .

[71]  Clay Spinuzzi,et al.  Context and consciousness: Activity theory and human-computer interaction , 1997 .

[72]  J. Chatwin Conversation analysis. , 2004, Complementary therapies in medicine.

[73]  Frank Biocca,et al.  The Cyborg's Dilemma: Progressive Embodiment in Virtual Environments , 2006, J. Comput. Mediat. Commun..

[74]  T. Gieryn,et al.  A Space for Place in Sociology , 2000 .

[75]  Cristina Masters,et al.  Bodies of Technology , 2005 .

[76]  Luciano Gamberini,et al.  Exploring the Suitability of Virtual Environments for Safety Training: Signals, Norms and Ambiguity in a Simulated Emergency Escape , 2001, Cognition, Technology & Work.

[77]  Michael J. Singer,et al.  On Selecting the Right Yardstick , 1999, Presence.

[78]  Herbert A. Simon,et al.  Information-processing models of cognition , 1981, J. Am. Soc. Inf. Sci..

[79]  Y. Tuan,et al.  Space and Place: The Perspective of Experience. , 1978 .

[80]  Maurice Merleau-Ponty Phenomenology of Perception , 1964 .

[81]  Johanna Nichols,et al.  Evidentiality: The Linguistic Coding of Epistemology , 1986 .

[82]  V. Kaptelinin Activity theory: implications for human-computer interaction , 1995 .

[83]  Timothy Koschmann,et al.  The Concept of Breakdown in Heidegger, Leont'ev, and Dewey and Its Implications for Education , 1998 .

[84]  P. Gagliardi Symbols and Artifacts: Views of the Corporate Landscape , 1990 .

[85]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[86]  G. Lakoff Philosophy in the flesh , 1999 .

[87]  A. Battersby Plans and the Structure of Behavior , 1968 .

[88]  J. Porac,et al.  Cognition and Communication at Work , 1999 .

[89]  J. M. Atkinson Structures of Social Action: Contents , 1985 .

[90]  C. Goodwin Action and embodiment within situated human interaction , 2000 .

[91]  D. So Philosophy in the Flesh: the Embodied Mind and its Challenge to Western Thought , 2000 .

[92]  W. Hanks Referential Practice: Language and Lived Space among the Maya , 1990 .

[93]  Anita M. Pomerantz Agreeing and disagreeing with assessments: some features of preferred/dispreferred turn shapes , 1984 .

[94]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[95]  R. Kling,et al.  Book Review: Computerization and Controversy: Value Conflicts and Social Choices , 1991 .

[96]  I Hutchby,et al.  Interaction and grammar. , 1998 .

[97]  A. Costall,et al.  Socializing Affordances , 1995 .