Understanding the Impact of Immersion and Authenticity on Satisfaction Behavior in Learning Analytics Tasks

As business analytics (BA) applications permeate across various industry sectors, the workforce needs to be trained and upskilled to meet the challenges of understanding and implementing analytics methodologies. To achieve payoffs from the resource investments in BA training, it is critical for enterprises to understand an individual’s learning behavior along with the process and outcome-centric satisfaction associated with a collaborative analytics training task. This study focuses on identifying the factors that influence the process of learning during BA training to entry-level BA users. Drawing on the theories of situated cognition, goal setting, and flow, we propose a model that explains how trainees in a group learn through a process that is influenced by the characteristics of BA training context through context authenticity, the traits of trainees through task motivation and preference towards teamwork. Using an experimental design built on data collection and a unique task of real visits to a historic cemetery, we found that context authenticity and task motivation have significant impact on focused immersion, which in turn significantly impacts process and outcome satisfaction for learning an analytics task. Results of this study extend and validate the theories of situated cognition, goal setting, and flow within the context of business analytics training. Based on these findings, we provide recommendations for practitioners for designing effective analytics tasks for better training outcomes.

[1]  Paul Gray,et al.  The Current State of Business Intelligence in Academia , 2014, Commun. Assoc. Inf. Syst..

[2]  J. Brown,et al.  Bridging epistemologies: The generative dance between organizational knowledge and organizational knowing , 1999 .

[3]  Naresh K. Malhotra,et al.  Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research , 2006, Manag. Sci..

[4]  N. Seel Epistemology, situated cognition, and mental models: 'Like a bridge over troubled water' , 2001 .

[5]  Michael Giamellaro,et al.  Deep immersion academic learning (DIAL): An analysis of science learning in context , 2012 .

[6]  Rana Tassabehji,et al.  The impact of big data analytics on firms’ high value business performance , 2016, Information Systems Frontiers.

[7]  B. Wyble,et al.  The attentional blink: Past, present, and future of a blind spot in perceptual awareness , 2010, Neuroscience & Biobehavioral Reviews.

[8]  Henrik Kampling,et al.  The Role of Immersive Virtual Reality in Individual Learning , 2018, HICSS.

[9]  E. A. Locke Motivation, Cognition, and Action: An Analysis of Studies of Task Goals and Knowledge , 2000 .

[10]  E. A. Locke,et al.  Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. , 2002, The American psychologist.

[11]  Lakshmi Goel,et al.  Decision-making in-socio and in-situ: Facilitation in virtual worlds , 2012, Decis. Support Syst..

[12]  Qing Hu,et al.  From transactional user to VIP: how organizational and cognitive factors affect ERP assimilation at individual level , 2011, Eur. J. Inf. Syst..

[13]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[14]  Beth A. Bechky Sharing Meaning Across Occupational Communities: The Transformation of Understanding on a Production Floor , 2003, Organ. Sci..

[15]  John Hulland,et al.  Use of partial least squares (PLS) in strategic management research: a review of four recent studies , 1999 .

[16]  Sasha A. Barab,et al.  A co-evolutionary model for supporting the emergence of authenticity , 2000 .

[17]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[18]  Theresa K. Lant,et al.  Organizational Cognition and Interpretation , 2017 .

[19]  Laku Chidambaram,et al.  Relational Development in Computer-Supported Groups , 1996, MIS Q..

[20]  Narda R. Quigley,et al.  Team deep-level diversity, relationship conflict, and team members' affective reactions: A cross-level investigation , 2014 .

[21]  Marko Sarstedt,et al.  An assessment of the use of partial least squares structural equation modeling in marketing research , 2012 .

[22]  Gillian King,et al.  Personality and Cognitive Ability Predictors of Performance in Graduate Business School. , 1994 .

[23]  Lakshmi Goel,et al.  How cues of what can be done in a virtual world influence learning: An affordance perspective , 2013, Inf. Manag..

[24]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[25]  M. Hakel,et al.  Effects of Objective and Subjective Task Complexity on Performance , 1997 .

[26]  Wynne W. Chin,et al.  A Partial Least Squares Latent Variable Modeling Approach for Measuring Interaction Effects: Results from a Monte Carlo Simulation Study and an Electronic - Mail Emotion/Adoption Study , 2003, Inf. Syst. Res..

[27]  David S. Baker,et al.  Factors Contributing to Cognitive Absorption and Grounded Learning Effectiveness in a Competitive Business Marketing Simulation , 2017 .

[28]  Kil-Soo Suh,et al.  Impact of communication medium on task performance and satisfaction: an examination of media-richness theory , 1999, Inf. Manag..

[29]  Sadan Kulturel-Konak,et al.  Review Of Gender Differences In Learning Styles: Suggestions For STEM Education , 2011 .

[30]  Michael Workman,et al.  Redesigning computer call center work: a longitudinal field experiment , 2004 .

[31]  Bruce A. Reinig,et al.  Toward an Understanding of Satisfaction with the Process and Outcomes of Teamwork , 2003, J. Manag. Inf. Syst..

[32]  Terry Dartnall,et al.  Does the World Leak Into the Mind? Active Externalism, "Internalism" and Epistemology , 2005, Cogn. Sci..

[33]  Rebecca Duray,et al.  Teamwork Orientation, Group Cohesiveness, and Student Learning: A Study of the Use of Teams in Online Distance Education , 2006 .

[34]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[35]  Lakshmi Goel,et al.  Situated Learning: Conceptualization and Measurement , 2010 .

[36]  Henry L. Tosi A Theory of Goal Setting and Task Performance , 1991 .

[37]  Roger H. L. Chiang,et al.  Big Data Research in Information Systems: Toward an Inclusive Research Agenda , 2016, J. Assoc. Inf. Syst..

[38]  S. Green,et al.  The effects of three social decision schemes on decision group process , 1980 .

[39]  M. Csíkszentmihályi Flow: The Psychology of Optimal Experience , 1990 .

[40]  Jong-Moon Chung,et al.  Foundation for the Study of Computer-Supported Collaborative Learning Requiring Immersive Presence , 2004, J. Manag. Inf. Syst..

[41]  Joseph F. Hair,et al.  Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research , 2014 .

[42]  R. Linn Educational measurement, 3rd ed. , 1989 .

[43]  Wei Peng,et al.  The influence of competition, cooperation, and player relationship in a motor performance centered computer game , 2012, Comput. Hum. Behav..

[44]  Paul A. Kirschner,et al.  Using integrated electronic environments for collaborative teaching/learning , 2001 .

[45]  Johannes Strobel,et al.  The role of authenticity in design-based learning environments: The case of engineering education , 2013, Comput. Educ..

[46]  Stephanie L. Castro,et al.  The effects of teamwork on individual learning and perceptions of team performance: A comparison of face‐to‐face and online project settings , 2010 .

[47]  Andrew B. Hargadon,et al.  Special Issue: Frontiers of Organization Science, Part 1 of 2: Identifying Situated Cognition in Organizations , 2005, Organ. Sci..

[48]  M. Lindell,et al.  Accounting for common method variance in cross-sectional research designs. , 2001, The Journal of applied psychology.

[49]  Abhijit Chaudhury,et al.  Assimilation of Big Data Innovation: Investigating the Roles of IT, Social Media, and Relational Capital , 2018, Information Systems Frontiers.

[50]  Jessie Pallud,et al.  Impact of interactive technologies on stimulating learning experiences in a museum , 2017, Inf. Manag..

[51]  Michael Giamellaro,et al.  Primary Contextualization of Science Learning through Immersion in Content-Rich Settings , 2014 .

[52]  J. Colquitt,et al.  Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research. , 2000, The Journal of applied psychology.

[53]  Jason D. Shaw,et al.  Interdependence and Preference for Group Work: Main and Congruence Effects on the Satisfaction and Performance of Group Members , 2000 .

[54]  B. Heffler Individual Learning Style and the Learning Style Inventory , 2001 .

[55]  David C. Yen,et al.  How business process reengineering affects information technology investment and employee performance under different performance measurement , 2015, Inf. Syst. Frontiers.

[56]  Bilge Aykol,et al.  Flow within theatrical consumption: The relevance of authenticity , 2017 .

[57]  P. Christopher Earley,et al.  Influence of information, choice and task complexity upon goal acceptance, performance, and personal goals. , 1985 .

[58]  Yichuan Wang,et al.  Business Intelligence and Analytics Education: Hermeneutic Literature Review and Future Directions in IS Education , 2015, AMCIS.

[59]  Bradley L. Kirkman,et al.  The impact of cultural values on job satisfaction and organizational commitment in self-managing work teams: The mediating role of employee resistance. , 2001 .

[60]  Shih-Chia Huang,et al.  Big Data Analytics and Business Intelligence in Industry , 2017, Inf. Syst. Frontiers.

[61]  I. Nonaka,et al.  The Concept of “Ba”: Building a Foundation for Knowledge Creation , 1998 .

[62]  Babita Gupta,et al.  Business Intelligence and Big Data in Higher Education: Status of a Multi-Year Model Curriculum Development Effort for Business School Undergraduates, MS Graduates, and MBAs , 2015, Commun. Assoc. Inf. Syst..

[63]  J. Wagner Studies of Individualism-Collectivism: Effects on Cooperation in Groups , 1995 .

[64]  J. Bransford How people learn , 2000 .

[65]  Jan Elen,et al.  In search of attributes that support self-regulation in blended learning environments , 2017, Education and Information Technologies.

[66]  H. Triandis,et al.  Individualism and Collectivism: Cross-cultural Perspectives on Self-ingroup Relationships We Wish to Thank Our Research Collaborators for Stimulating Ideas, Data, and Moral Support in Carrying out a Complex Set of Studies. They , 2022 .

[67]  W. Reinartz,et al.  An Empirical Comparison of the Efficacy of Covariance-Based and Variance-Based SEM , 2009 .

[68]  Wingyan Chung,et al.  Business Analytics in Context: Evaluating New Curricular Modules in an Undergraduate Statistics Course , 2015 .

[69]  Paul A. Kirschner,et al.  Authentic assessment, student and teacher perceptions: the practical value of the five‐dimensional framework , 2006 .

[70]  Paula M. Rice,et al.  Teamwork orientation and personal learning: The role of individual cultural values and value congruence , 2017 .

[71]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[72]  Gina J. Medsker,et al.  RELATIONS BETWEEN WORK GROUP CHARACTERISTICS AND EFFECTIVENESS: IMPLICATIONS FOR DESIGNING EFFECTIVE WORK GROUPS , 1993 .

[73]  Young-Gul Kim,et al.  Critical Factors for Assimilation of Object-Oriented Programming Languages , 2002, J. Manag. Inf. Syst..

[74]  M. Covington Goal theory, motivation, and school achievement: an integrative review. , 2000, Annual review of psychology.

[75]  J. Brown,et al.  Knowledge and Organization: A Social-Practice Perspective , 2001 .

[76]  B. Zimmerman Academic studing and the development of personal skill: A self-regulatory perspective , 1998 .