The roles of sensory modalities in collaborative virtual environments (CVEs)

This study was conducted to assess the effects of sensorial modalities on user performance, perception, and behavior in collaborative virtual environments (CVEs). Participants played a CVE game, air hockey, together with a remote partner under different sensory modality conditions, depending on the type of sensory feedback provided: visual-only (V), visual-haptic (V+H), and visual-haptic-audio feedback (V+H+A). Three types of measurements were used as dependent variables: (1) task performance measured as playing time, (2) user perception including the sense of presence, the sense of togetherness, and perceived collaboration, and (3) behavior measurement including the amount of force applied and the mallet deviation. Results of the study indicated that the task performance, perception, and user behavior in CVEs can be affected due to supported sensory modalities. Therefore, the multiple sensory information types that are required to perform the task at hand should be provided to effectively support collaboration between people in CVEs. The outcomes of this research should have a broad impact on multimodal user interaction, including research on physiological, psychophysical, and psychological mechanisms underlying human perception on multisensory feedback in CVEs.

[1]  Steven M. Drucker,et al.  The social life of small graphical chat spaces , 2000, CHI.

[2]  Woodrow Barfield,et al.  Virtual environments and advanced interface design , 1995 .

[3]  Ernst Koningsveld.  Proceedings of the 16th World Congress of the International Ergonomics Association (IEA) , 2006 .

[4]  Lili Cheng,et al.  Lessons learned: building and deploying shared virtual environments , 2002 .

[5]  Kirsten Rassmus-Gröhn,et al.  Supporting presence in collaborative environments by haptic force feedback , 2000, TCHI.

[6]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[7]  Ralph Schroeder,et al.  Small-Group Behavior in a Virtual and Real Environment: A Comparative Study , 2000, Presence: Teleoperators & Virtual Environments.

[8]  Ralph Schroeder,et al.  Trust in the Core: A Study of Long-term Users of Activeworlds , 2000 .

[9]  Shanyang Zhao,et al.  Toward a Taxonomy of Copresence , 2003, Presence: Teleoperators & Virtual Environments.

[10]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[11]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[12]  Ralph Schroeder,et al.  The long-term uses of shared virtual environments: an exploratory study , 2002 .

[13]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[14]  Sam Redfern,et al.  Collaborative Virtual Environments to Support Communication and Community in Internet-Based Distance Education , 2002, J. Inf. Technol. Educ..

[15]  David W. Schloerb,et al.  A Quantitative Measure of Telepresence , 1995, Presence: Teleoperators & Virtual Environments.

[16]  Ralph Schroeder,et al.  The social life of avatars: presence and interaction in shared virtual environments , 2002 .

[17]  Ralph Schroeder,et al.  Copresence and Interaction in Virtual Environments: An Overview of the Range of Issues , 2005 .

[18]  Christine Youngblut,et al.  The relationship between presence and performance in virtual environments: results of a VERTS study , 2003, IEEE Virtual Reality, 2003. Proceedings..

[19]  Roger J. Hubbold,et al.  Collaborative stretcher carrying: a case study , 2002, EGVE.

[20]  Gloria Mark,et al.  Social conventions in computer-mediated communication: a comparison of three online shared virtual environments , 2002 .

[21]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[22]  Ann-Sofie Axelsson.  The digital divide: status differences in virtual environments , 2002 .

[23]  Woodrow Barfield,et al.  Effects of Stereopsis and Head Tracking on Performance Using Desktop Virtual Environment Displays , 1999, Presence: Teleoperators & Virtual Environments.

[24]  Nadine Miner,et al.  An application of shared virtual reality to situational training , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[25]  Mel Slater,et al.  Immersion, presence and performance in virtual environments: an experiment with tri-dimensional chess , 1996, VRST.

[26]  Mel Slater,et al.  Presence in Shared Virtual Environments and Virtual Togetherness , 2000, Presence: Teleoperators & Virtual Environments.

[27]  S. R. Ellis.  Nature and origins of virtual environments: a bibliographical essay , 1991 .

[28]  Monica Divitini,et al.  Supporting learning communities with collaborative virtual environments: : Different spatial metaphors , 2002 .

[29]  Woodrow Barfield,et al.  A Conceptual Model of the Sense of Presence in Virtual Environments , 1999, Presence: Teleoperators & Virtual Environments.

[30]  Blake Hannaford,et al.  Architectures for shared haptic virtual environments , 1997, Comput. Graph..

[31]  Roger J. Hubbold,et al.  System Challenges for Collaborative Virtual Environments , 2001, Collaborative Virtual Environments.

[32]  Ilona Heldal,et al.  Collaborating in networked immersive spaces: as good as being there together? , 2001, Comput. Graph..

[33]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .