How do facilitation interventions foster learning? The role of evaluation and coordination as causal mediators in idea convergence

Abstract Teams need to co-construct meaning to establish shared understanding of crowdsourced ideas. This is challenging because team members are often faced with an excessive amount of ideas, they have no access to the ideator to clarify ideas, have limited meeting duration, and do not necessarily share a common working history. Facilitation interventions can aid the co-construction of meaning. However, it is uncertain if facilitation interventions that were successful in traditional convergence settings can be applied to convergence with crowdsourced ideas and what mechanisms can explain the positive association between facilitation interventions and co-creation of meaning. In this study, I tested three facilitation techniques and the mediating role of evaluation and coordination in a laboratory experiment involving 199 participants. The participants were given an IT-supported convergence task with crowdsourced ideas. The findings show that facilitated teams receiving high attention guidance and discussion encouragement outperform non-facilitated teams and that evaluation and coordination are the mechanisms through which these effects come about. The findings are beneficial for the design of conversational agents in convergence settings and for team leaders who want to establish shared understanding in convergence settings with crowdsourced ideas.

[1]  Robert O. Briggs,et al.  Causal Relationships in Creative Problem Solving: Comparing Facilitation Interventions for Ideation , 2004, J. Manag. Inf. Syst..

[2]  J. Hair Multivariate data analysis : a global perspective , 2010 .

[3]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[4]  M. Mortensen,et al.  The Secrets of Great Teamwork. , 2016, Harvard business review.

[5]  D. Mackinnon,et al.  Equivalence of the Mediation, Confounding and Suppression Effect , 2000, Prevention Science.

[6]  Alan R. Dennis,et al.  Investigating the Moderators of the Group Support Systems Use with Meta-Analysis , 2002, J. Manag. Inf. Syst..

[7]  Jian Ma,et al.  Effects of Group Support Systems and Content Facilitation on Knowledge Acquisition , 2002, J. Manag. Inf. Syst..

[8]  John E. Mathieu,et al.  A Temporally Based Framework and Taxonomy of Team Processes , 2001 .

[9]  Youngjin Yoo,et al.  The Impact of Knowledge Coordination on Virtual Team Performance Over Time , 2007, MIS Q..

[10]  G. Jouret Inside Cisco's Search for the Next Big Idea , 2009 .

[11]  Dustin Tingley,et al.  IDENTIFYING MECHANISMS BEHIND POLICY INTERVENTIONS VIA CAUSAL MEDIATION ANALYSIS , 2015 .

[12]  Gary W. Dickson,et al.  Exploring Modes of Facilitative Support for GDSS Technology , 1993, MIS Q..

[13]  Olivier Toubia,et al.  Idea Generation, Creativity, and Prototypicality , 2017, Mark. Sci..

[14]  Robert M. Davison,et al.  The Effects of Process and Content Facilitation Restrictiveness on GSS-Mediated Collaborative Learning , 2002 .

[15]  A. Hayes Beyond Baron and Kenny: Statistical Mediation Analysis in the New Millennium , 2009 .

[16]  Ronald Maier,et al.  Beyond Brainstorming: Exploring Convergence in Teams , 2017, J. Manag. Inf. Syst..

[17]  K. Wei,et al.  Effects of facilitation and leadership on meeting outcomes in a group support system environment , 1999 .

[18]  Robert O. Briggs,et al.  A conceptual foundation of the thinkLet concept for Collaboration Engineering , 2006, Int. J. Hum. Comput. Stud..

[19]  Olivier Toubia Idea Generation, Creativity, and Incentives , 2006 .

[20]  Gerardine DeSanctis,et al.  Providing Decisional Guidance for Multicriteria Decision Making in Groups , 2000, Inf. Syst. Res..

[21]  P. Todd,et al.  Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload , 2010 .

[22]  Guy Paré,et al.  A systematic assessment of rigor in information systems ranking-type Delphi studies , 2013, Inf. Manag..

[23]  Alanah J. Davis,et al.  Understanding Methodological Differences to Study Convergence in Group Support System Sessions , 2008, CRIWG.

[24]  M. D. Myers,et al.  Qualitative Research in Business & Management , 2008 .

[25]  Kyle Lewis,et al.  Knowledge and Performance in Knowledge-Worker Teams: A Longitudinal Study of Transactive Memory Systems , 2004, Manag. Sci..

[26]  Kosuke Imai,et al.  mediation: R Package for Causal Mediation Analysis , 2014 .

[27]  Detmar W. Straub,et al.  Validation Guidelines for IS Positivist Research , 2004, Commun. Assoc. Inf. Syst..

[28]  J. Alberto Espinosa,et al.  Time Separation, Coordination, and Performance in Technical Teams , 2012, IEEE Transactions on Engineering Management.

[29]  J.F. Nunamaker,et al.  The impact of process structure on novice, virtual collaborative writing teams , 2005, IEEE Transactions on Professional Communication.

[30]  Eric F. Rietzschel,et al.  Productivity is not enough: A comparison of interactive and nominal brainstorming groups on idea generation and selection. , 2006 .

[31]  P. Kirschner,et al.  Team learning: building shared mental models , 2011 .

[32]  Tammy L. Rapp,et al.  Team Effectiveness 1997-2007: A Review of Recent Advancements and a Glimpse Into the Future , 2008 .

[33]  Karl T. Ulrich,et al.  Idea Generation and the Quality of the Best Idea , 2009, Manag. Sci..

[34]  Kosuke Imai,et al.  Experimental designs for identifying causal mechanisms , 2013 .

[35]  R. Bostrom,et al.  Group Facilitation and Group Support Systems , 1993 .

[36]  O. Bjelland,et al.  An Inside View of IBM's 'Innovation Jam' , 2008 .

[37]  Georg von Krogh,et al.  Focus Intensely on a Few Great Innovation Ideas , 2009 .

[38]  Leslie A. DeChurch,et al.  Information elaboration and team performance: Examining the psychological origins and environmental contingencies , 2014 .

[39]  James E. Driskell,et al.  Collective Orientation and Team Performance: Development of an Individual Differences Measure , 2010, Hum. Factors.

[40]  Corinne Faure,et al.  Beyond Brainstorming: Effects of Different Group Procedures on Selection of Ideas and Satisfaction with the Process , 2004 .

[41]  Sara A. McComb,et al.  Merging internal and external processes: examining the mental model convergence process through team communication , 2010 .

[42]  Jan Marco Leimeister,et al.  Rating Scales for Collective Intelligence in Innovation Communities: Why Quick and Easy Decision Making Does Not Get it Right , 2010, ICIS.

[43]  Jay F. Nunamaker,et al.  Electronic meeting systems , 1991, CACM.

[44]  Morten T. Hansen,et al.  The innovation value chain. , 2007, Harvard business review.

[45]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[46]  L. Keele,et al.  Identification, Inference and Sensitivity Analysis for Causal Mediation Effects , 2010, 1011.1079.

[47]  Robert O. Briggs,et al.  Facilitator-in-a-Box: Process Support Applications to Help Practitioners Realize the Potential of Collaboration Technology , 2013, J. Manag. Inf. Syst..

[48]  Fred Niederman,et al.  Towards an Instrument to Measure Participants' Perceptions on Facilitation in Group Support Systems Meetings , 2002 .

[49]  Steven D. Silver Designing technology for managing the information exchange of decision making teams , 2014, Decis. Support Syst..

[50]  Karim R Lakhani,et al.  Using the crowd as an innovation partner. , 2013, Harvard business review.

[51]  Ronald Maier,et al.  Convergence on Self-Generated vs. Crowdsourced Ideas in Crisis Response: Comparing Social Exchange Processes and Satisfaction with Process , 2017, HICSS.

[52]  Joseph S. Valacich,et al.  Facilitation, GSS, and Training as Sources of Process Restrictiveness and Guidance for Structured Group Decision Making: An Empirical Assessment , 1996, Inf. Syst. Res..

[53]  Rachel K. E. Bellamy,et al.  At Face Value , 2021, Bigger Than Life.

[54]  Robert O. Briggs,et al.  Collaboration Engineering: Foundations and Opportunities: Editorial to the Special Issue on the Journal of the Association of Information Systems , 2009, J. Assoc. Inf. Syst..

[55]  Steve W. J. Kozlowski,et al.  The Dynamics of Emergence: Cognition and Cohesion in Work Teams , 2012 .

[56]  Gerrit van Bruggen,et al.  How Incorporating Feedback Mechanisms in a DSS Affects DSS Evaluations , 2009, Inf. Syst. Res..

[57]  Fred Niederman,et al.  Issues and Concerns About Computer-Supported Meetings: The Facilitator's Perspective , 1996, MIS Q..

[58]  C. D. De Dreu,et al.  Work group diversity and group performance: an integrative model and research agenda. , 2004, The Journal of applied psychology.

[59]  Ronald Maier,et al.  Exploring the Effects of Contest Mechanisms on Idea Shortlisting in an Open Idea Competition , 2016, ICIS.

[60]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[61]  Gert-Jan de Vreede,et al.  Two Case Studies of Achieving Repeatable Team Performance through Collaboration Engineering , 2014, MIS Q. Executive.

[62]  Marko Sarstedt,et al.  Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research , 2014 .

[63]  Ann Majchrzak,et al.  Coordinating Expertise Among Emergent Groups Responding to Disasters , 2007, Organ. Sci..

[64]  Ning Nan,et al.  Using Multi-Agent Simulation to Explore the Contribution of Facilitation to GSS Transition , 2009, J. Assoc. Inf. Syst..

[65]  Jay F. Nunamaker,et al.  Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems , 2003, J. Manag. Inf. Syst..

[66]  Alexander Benedikt Merz,et al.  Mechanisms to Select Ideas in Crowdsourced Innovation Contests - A Systematic Literature Review and Research Agenda , 2018, ECIS.

[67]  Alexander Richter,et al.  Designing an Idea Screening Framework for Employee-Driven Innovation , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[68]  P. Paulus,et al.  Building on the ideas of others: An examination of the idea combination process , 2011 .

[69]  Kosuke Imai,et al.  Identification and Sensitivity Analysis for Multiple Causal Mechanisms: Revisiting Evidence from Framing Experiments , 2013, Political Analysis.

[70]  Jan Marco Leimeister,et al.  Creating Shared Understanding in Heterogeneous Work Groups: Why It Matters and How to Achieve It , 2014, J. Manag. Inf. Syst..

[71]  Karl T. Ulrich,et al.  Opportunity Spaces in Innovation: Empirical Analysis of Large Samples of Ideas , 2011, Manag. Sci..

[72]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[73]  Jesús Sánchez Gómez,et al.  How team feedback and team trust influence information processing and learning in virtual teams: A moderated mediation model , 2015, Comput. Hum. Behav..

[74]  Kyle Lewis Measuring transactive memory systems in the field: scale development and validation. , 2003, The Journal of applied psychology.

[75]  M. Boos,et al.  Facilitating Group Decision-Making: Facilitator's Subjective Theories on Group Coordination , 2009 .

[76]  M. Baker A model for negotiation in teaching-learning dialogues , 1994 .

[77]  Ronald Maier,et al.  Opening the Black Box of Team Processes and Emergent States: A Literature Review and Agenda for Research on Team Facilitation , 2014, 2014 47th Hawaii International Conference on System Sciences.

[78]  Milam W. Aiken,et al.  Automated facilitation of electronic meetings , 2003, Inf. Manag..

[79]  A. Edmondson Psychological Safety and Learning Behavior in Work Teams , 1999 .

[80]  Eduardo Salas,et al.  Towards an understanding of macrocognition in teams: developing and defining complex collaborative processes and products , 2010 .

[81]  Mark A. Fuller,et al.  Facilitator Influence in Group Support Systems: Intended and Unintended Effects , 1998, Inf. Syst. Res..

[82]  A. Kluger,et al.  Feedback Interventions , 1998 .

[83]  Marko Sarstedt,et al.  The Use of Partial Least Squares Structural Equation Modeling in Strategic Management Research: A Review of Past Practices and Recommendations for Future Applications , 2012 .

[84]  Marco Aurélio Gerosa,et al.  Single or Multiple Conversational Agents?: An Interactional Coherence Comparison , 2018, CHI.

[85]  Robert O. Briggs,et al.  Designing ThinkLets for Convergence , 2007, AMCIS.