Design and evaluation of virtual environments mechanisms to support remote collaboration on complex process diagrams

Many organizational analysis tasks are solved by collaborating teams. In technology-mediated collaborations, enabling relevant visual cues is a core issue with existing technology. We explore whether avatars can provide relevant cues in collaborative virtual environments. To do so, we develop a research prototype for a collaborative virtual environment that utilises avatars to improve workspace awareness in collaborative tasks. We test this solution through two studies, qualitative and quantitative, in which participants have to collaborate to jointly validate and correct a diagrammatic model of operational procedures.Our evaluations provide both positive and negative results about the proposed prototype. Collaboration patterns changed and became significantly easier, but, task performance was only slightly improved. Together, these findings inform both the ongoing development of collaborative 3D virtual environments and the role of technology-mediated collaboration for validating and fixing models of processes. We present design principles for 3D virtual environment collaboration technology for process diagram creation and validation.We present a proof-of-concept implementation of the technology.We present findings from two studies of collaborative validation of a process diagram, qualitative and quantitative.

[1]  Mathias Weske,et al.  Oryx - An Open Modeling Platform for the BPM Community , 2008, BPM.

[2]  Jan Recker,et al.  How novices design business processes , 2012, Inf. Syst..

[3]  Anne P. Massey,et al.  Collaborative Virtual Environments : Exploring the Link between Collaborative Behaviors and Team Performance , 2011 .

[4]  David R. Traum,et al.  Issues in Multiparty Dialogues , 2003, Workshop on Agent Communication Languages.

[5]  Robert E. Kraut,et al.  Using Visual Information for Grounding and Awareness in Collaborative Tasks , 2012, Hum. Comput. Interact..

[6]  Gerhard Kleining,et al.  Das qualitative Experiment , 1986 .

[7]  Jan Recker,et al.  Empirical investigation of the usefulness of Gateway constructs in process models , 2013, Eur. J. Inf. Syst..

[8]  N. Lazar,et al.  The ASA Statement on p-Values: Context, Process, and Purpose , 2016 .

[9]  N. Kock,et al.  Media Compensation Theory: A Darwinian Perspective on Adaptation to Electronic Communication and Collaboration , 2011 .

[10]  Hideaki Kuzuoka,et al.  Fractured Ecologies: Creating Environments for Collaboration , 2003, Hum. Comput. Interact..

[11]  Roya Ayman,et al.  Communication Medium and Member Familiarity , 2005 .

[12]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[13]  Jan Mendling,et al.  Tracing the Process of Process Modeling with Modeling Phase Diagrams , 2011, Business Process Management Workshops.

[14]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[15]  Steve Benford,et al.  Fragmented interaction: establishing mutual orientation in virtual environments , 1998, CSCW '98.

[16]  Eleni Stroulia,et al.  Virtual worlds - past, present, and future: New directions in social computing , 2009, Decis. Support Syst..

[17]  Jeremy N. Bailenson,et al.  The Unbearable Likeness of Being Digital: The Persistence of Nonverbal Social Norms in Online Virtual Environments , 2007, Cyberpsychology Behav. Soc. Netw..

[18]  Michael Rosemann,et al.  Potential pitfalls of process modeling: part A , 2006, Bus. Process. Manag. J..

[19]  Peter Rittgen IT support in collaborative modelling of business processes – a comparative experiment , 2010 .

[20]  Peter Rittgen,et al.  Negotiating Models , 2007, CAiSE.

[21]  Jan Recker,et al.  Improving Remote Collaborative Process Modelling using Embodiment in 3D Virtual Environments , 2013, APCCM.

[22]  Jan Recker,et al.  Process Model Comprehension: The Effects of Cognitive Abilities, Learning Style, and Strategy , 2014, Commun. Assoc. Inf. Syst..

[23]  Stefanie Rinderle-Ma,et al.  Change patterns and change support features - Enhancing flexibility in process-aware information systems , 2008, Data Knowl. Eng..

[24]  Jan Mendling,et al.  A study on the effects of routing symbol design on process model comprehension , 2013, Decis. Support Syst..

[25]  Hideaki Kuzuoka,et al.  Creating coherent environments for collaboration , 2001, ECSCW.

[26]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[27]  Jan Recker,et al.  Opportunities and constraints: the current struggle with BPMN , 2010, Bus. Process. Manag. J..

[28]  Mariëlle den Hengst,et al.  Collaborative Business Engineering: A Decade of Lessons from the Field , 2004, J. Manag. Inf. Syst..

[29]  Sonja Kabicher,et al.  Visual Change Tracking for Business Process Models , 2011, ER.

[30]  Wil M. P. van der Aalst,et al.  Formalization and verification of event-driven process chains , 1999, Inf. Softw. Technol..

[31]  Theo P. van der Weide,et al.  Information modeling: The process and the required competencies of its participants , 2006, Data Knowl. Eng..

[32]  Bill Curtis,et al.  Process modeling , 1992, CACM.

[33]  Susanne Patig,et al.  Requirements of Process Modeling Languages - Results from an Empirical Investigation , 2011, Wirtschaftsinformatik.

[34]  Larry F. Hodges,et al.  User Interface Constraints for Immersive Virtual Environment Applications , 1995 .

[35]  Thomas Herrmann,et al.  Collaborative Usage and Development of Models: State of the Art, Challenges and Opportunities , 2013, Int. J. e Collab..

[36]  Peter Rittgen,et al.  Success Factors of e-Collaboration in Business Process Modeling , 2010, CAiSE.

[37]  Katja Hutter,et al.  Virtual worlds as knowledge management platform – a practice‐perspective , 2011, Inf. Syst. J..

[38]  Kate J. Garland,et al.  Computer experience: a poor predictor of computer attitudes , 2004, Comput. Hum. Behav..

[39]  Jan Recker,et al.  Using virtual worlds for collaborative business process modeling , 2011, Bus. Process. Manag. J..

[40]  Pierre Dillenbourg,et al.  Proximity and view awareness to reduce referential ambiguity in a shared 3D virtual environment , 2002, CSCL.

[41]  Mark Strembeck,et al.  Factors of process model comprehension - Findings from a series of experiments , 2012, Decis. Support Syst..

[42]  Brian C. Nelson,et al.  Collaboration modality, cognitive load, and science inquiry learning in virtual inquiry environments , 2010 .

[43]  Venkataraman Ramesh,et al.  Understanding Conceptual Schemas: Exploring the Role of Application and IS Domain Knowledge , 2006, Inf. Syst. Res..

[44]  R. Stebbins Exploratory research in the social sciences , 2001 .

[45]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[46]  John D. Murphy,et al.  Avatars, People, and Virtual Worlds: Foundations for Research in Metaverses , 2009, J. Assoc. Inf. Syst..

[47]  Heinrich H. Bülthoff,et al.  A Communication Task in HMD Virtual Environments: Speaker and Listener Movement Improves Communication , 2010 .

[48]  Stijn Hoppenbrouwers,et al.  A Fundamental View on the Process of Conceptual Modeling , 2005, ER.

[49]  Jeffrey Parsons,et al.  Is Query Reuse Potentially Harmful? Anchoring and Adjustment in Adapting Existing Database Queries , 2010, Inf. Syst. Res..

[50]  Jan Mendling,et al.  Collaboration Features in current BPM Tools , 2012, EMISA Forum.

[51]  Moe Thandar Wynn,et al.  Business process verification - finally a reality! , 2009, Bus. Process. Manag. J..

[52]  Viswanath Venkatesh,et al.  Hype or Help? A Longitudinal Field Study of Virtual World Use for Team Collaboration , 2012, J. Assoc. Inf. Syst..

[53]  Holger Regenbrecht,et al.  The Impact of Collaborative Style on the Perception of 2D and 3D Videoconferencing Interfaces , 2012 .

[54]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[55]  Wei Chen,et al.  Approaches for Model Validation: Methodology and Illustration on a Sheet Metal Flanging Process , 2006 .

[56]  Jan Pries-Heje,et al.  FEDS: a Framework for Evaluation in Design Science Research , 2016, Eur. J. Inf. Syst..

[57]  Deborah H. Gruenfeld,et al.  Group Composition and Decision Making: How Member Familiarity and Information Distribution Affect Process and Performance , 1996 .

[58]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[59]  Jan Mendling,et al.  An Exploratory Study of IT-Enabled Collaborative Process Modeling , 2010, Business Process Management Workshops.

[60]  Hiroshi Ishii,et al.  Iterative design of seamless collaboration media , 1994, CACM.

[61]  Rudy Darken,et al.  Navigating large virtual spaces , 1996, Int. J. Hum. Comput. Interact..

[62]  Marta Indulska,et al.  Business Process Modeling: Current Issues and Future Challenges , 2009, CAiSE.

[63]  Jan Mendling,et al.  Supporting Process Model Validation through Natural Language Generation , 2014, IEEE Transactions on Software Engineering.

[64]  Jan Mendling,et al.  How collaborative technology supports cognitive processes in collaborative process modeling: A capabilities-gains-outcome model , 2013, Inf. Syst..

[65]  Robert J. Moore,et al.  Doing Virtually Nothing: Awareness and Accountability in Massively Multiplayer Online Worlds , 2007, Computer Supported Cooperative Work (CSCW).

[66]  Jean-Louis Malouin,et al.  Model validation in operations research , 1983 .

[67]  Alexander L. Wolf,et al.  Software process validation: quantitatively measuring the correspondence of a process to a model , 1999, TSEM.

[68]  Robert E. Kraut,et al.  Visual Information as a Conversational Resource in Collaborative Physical Tasks , 2003, Hum. Comput. Interact..

[69]  Yukiko I. Nakano,et al.  Towards a Model of Face-to-Face Grounding , 2003, ACL.

[70]  Jan Recker,et al.  Understanding the Behavior of Workshop Facilitators in Systems Analysis and Design Projects: Developing Theory from Process Modeling Projects , 2015, Commun. Assoc. Inf. Syst..

[71]  Jan Recker,et al.  The Effects of Content Presentation Format and User Characteristics on Novice Developers' Understanding of Process Models , 2011, Commun. Assoc. Inf. Syst..

[72]  Daniel M. Johnson,et al.  Preliminary Evaluation of an Augmented Reality Collaborative Process Modelling System , 2012, 2012 International Conference on Cyberworlds.

[73]  Manfred Reichert,et al.  Towards Gesture-Based Process Modeling on Multi-touch Devices , 2012, CAiSE Workshops.

[74]  Nicole C. Krämer,et al.  8. Virtual gestures: embodiment and non-verbal behavior in computer-mediated communication , 2011 .

[75]  Jan C. Recker,et al.  A Socio-Pragmatic Constructionist Framework for Understanding Quality in Process Modelling , 2007 .

[76]  Cédric Dumas,et al.  Influence of contextual objects on spatial interactions and viewpoints sharing in virtual environments , 2013, Virtual Reality.

[77]  Ilona Heldal,et al.  Factors influencing flow of object focussed collaboration in collaborative virtual environments , 2006, Virtual Reality.