Convergence of Crowdsourcing Ideas: A Cognitive Load perspective

Many organizations use crowdsourcing for problem solving, innovation, and consultation. In open innovation and community crowdsourcing initiatives the volume of generated ideas may prevent a careful evaluation if each individual contribution. To overcome this challenge, crowd workers can perform a convergence activity. Convergence involves reducing a large set of ideas to a focused subset of ideas that are worthy of further consideration. While convergence is a critical process for situations were large volumes of ideas must be processed, little is known what affects convergence quality and satisfaction with the convergence process and outcomes. We propose an experimental study that adopts Cognitive Load Theory as its theoretical lens to investigate the effects of task complexity, idea presentation, and instructional guidance on convergence quality and satisfaction. This study has the potential to further our understanding of convergence processes in crowdsourcing and inform the design and guidance of crowdsourcing initiatives.

[1]  Robert Axelrod,et al.  Schema Theory: An Information Processing Model of Perception and Cognition , 1973, American Political Science Review.

[2]  M. Coleman,et al.  A computer readability formula designed for machine scoring. , 1975 .

[3]  D. Campbell.  Task Complexity: A Review and Analysis , 1988 .

[4]  Wanda J. Orlikowski,et al.  The Problem of Statistical Power in MIS Research , 1989, MIS Q..

[5]  William A. Kahn.  Psychological Conditions of Personal Engagement and Disengagement at Work , 1990 .

[6]  G. Spreitzer.  PSYCHOLOGICAL EMPOWERMENT IN THE WORKPLACE: DIMENSIONS, MEASUREMENT, AND VALIDATION , 1995 .

[7]  Confirmation Model.  UNDERSTANDING INFORMATION SYSTEMS CONTINUANCE: AN EXPECTATION- , 2001 .

[8]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[9]  Jay F. Nunamaker,et al.  Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems , 2003, J. Manag. Inf. Syst..

[10]  Salvatore T. March,et al.  Information Systems Research , 2004, IFIP International Federation for Information Processing.

[11]  R. Moreno.  Decreasing Cognitive Load for Novice Students: Effects of Explanatory versus Corrective Feedback in Discovery-Based Multimedia , 2004 .

[12]  John Sweller,et al.  Cognitive Load Theory: Instructional Implications of the Interaction between Information Structures and Cognitive Architecture , 2004 .

[13]  Robert O. Briggs,et al.  Causal Relationships in Creative Problem Solving: Comparing Facilitation Interventions for Ideation , 2004, J. Manag. Inf. Syst..

[14]  H. Tabbers,et al.  Multimedia instructions and cognitive load theory: effects of modality and cueing. , 2004, The British journal of educational psychology.

[15]  Kar Yan Tam,et al.  The Effects of Information Format and Shopping Task on Consumers' Online Shopping Behavior: A Cognitive Fit Perspective , 2004, J. Manag. Inf. Syst..

[16]  Richard E. Potter,et al.  The Role of Individual Memory and Attention Processes During Electronic Brainstorming , 2004, MIS Q..

[17]  Shuk Ying Ho,et al.  Web Personalization as a Persuasion Strategy: An Elaboration Likelihood Model Perspective , 2005, Inf. Syst. Res..

[18]  Fred Paas,et al.  Instructional design for advanced learners: Establishing connections between the theoretical frameworks of cognitive load and deliberate practice , 2005 .

[19]  T. Gog,et al.  Optimising worked example instruction: Different ways to increase germane cognitive load. , 2006 .

[20]  Thomas Lee Rodgers,et al.  Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation , 2006, J. Assoc. Inf. Syst..

[21]  Fred Paas,et al.  Making instructional animations more effective: a cognitive load approach , 2007 .

[22]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[23]  Hsiu-Fen Lin.  Knowledge sharing and firm innovation capability: an empirical study , 2007 .

[24]  Mark Adkins,et al.  Which collaboration patterns are most challenging: A global survey of facilitators , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[25]  Krista E. DeLeeuw,et al.  A Comparison of Three Measures of Cognitive Load: Evidence for Separable Measures of Intrinsic, Extraneous, and Germane Load , 2008 .

[26]  Robert O. Briggs,et al.  The Yield Shift Theory of Satisfaction and Its Application to the IS/IT Domain , 2008, J. Assoc. Inf. Syst..

[27]  F. Paas,et al.  Towards a Framework for Attention Cueing in Instructional Animations: Guidelines for Research and Design , 2009 .

[28]  K. Holmqvist,et al.  Reading Information Graphics: the Role of Spatial Contiguity and Dual Attentional Guidance , 2022 .

[29]  Alfred P. Rovai,et al.  The Internet and Higher Education , 2009 .

[30]  Silvia Heinz,et al.  Cognitive Load in eCommerce Applications - Measurement and Effects on User Satisfaction , 2009, Adv. Hum. Comput. Interact..

[31]  Karl T. Ulrich,et al.  Idea Generation and the Quality of the Best Idea , 2009, Manag. Sci..

[32]  George Bradford.  A relationship study of student satisfaction with learning online and cognitive load: Initial results , 2011, Internet High. Educ..

[33]  Gwendolyn L. Kolfschoten,et al.  A Training Approach for the Transition of Repeatable Collaboration Processes to Practitioners , 2011 .

[34]  Wen-Hao Huang,et al.  Evaluating learners' motivational and cognitive processing in an online game-based learning environment , 2011, Comput. Hum. Behav..

[35]  Charles Miller.  Aesthetics and e-assessment: the interplay of emotional design and learner performance , 2011 .

[36]  Tzu-Chien Liu,et al.  Split-attention and redundancy effects on mobile learning in physical environments , 2012, Comput. Educ..

[37]  Paul Jen-Hwa Hu,et al.  Theory-Informed Design and Evaluation of an Advanced Search and Knowledge Mapping System in Nanotechnology , 2012, J. Manag. Inf. Syst..

[38]  Jongpil Cheon,et al.  Examining the relationships of different cognitive load types related to user interface in web-based instruction , 2012 .

[39]  Ramesh Sharda,et al.  Should I send this message? Understanding the impact of interruptions, social hierarchy and perceived task complexity on user performance and perceived workload , 2013, Decis. Support Syst..

[40]  Ann Majchrzak,et al.  Towards an Information Systems Perspective and Research Agenda on Crowdsourcing for Innovation , 2013, J. Strateg. Inf. Syst..

[41]  Robert O. Briggs,et al.  Facilitator-in-a-Box: Process Support Applications to Help Practitioners Realize the Potential of Collaboration Technology , 2013, J. Manag. Inf. Syst..

[42]  Karim R Lakhani,et al.  Using the crowd as an innovation partner. , 2013, Harvard business review.

[43]  Christopher L. Tucci,et al.  Value Capture and Crowdsourcing , 2013 .

[44]  Jan Marco Leimeister,et al.  Crowdsourcing: How to Benefit from (Too) Many Great Ideas , 2013, MIS Q. Executive.

[45]  F. Fischer,et al.  Toward a Script Theory of Guidance in Computer-Supported Collaborative Learning , 2013, Educational psychologist.

[46]  Barry L. Bayus,et al.  Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community , 2013, Manag. Sci..

[47]  Judith Gebauer,et al.  The Impact of User Interface Design on Idea Integration in Electronic Brainstorming: An Attention-Based View , 2013, J. Assoc. Inf. Syst..

[48]  Lada A. Adamic,et al.  Crowdsourcing with All-Pay Auctions: A Field Experiment on Taskcn , 2014, Manag. Sci..

[49]  Bing H. Ngu,et al.  Cognitive load in percentage change problems: unitary, pictorial, and equation approaches to instruction , 2014 .

[50]  Upkar Varshney,et al.  A model for improving quality of decisions in mobile health , 2014, Decis. Support Syst..

[51]  Gert-Jan de Vreede,et al.  Participant Engagement in Community Crowdsourcing , 2015, ECIS.

[52]  Ronald Maier,et al.  Exploring Idea Quality Evolution During Convergence , 2015, ICIS.

[53]  Chih-Ming Chen,et al.  Effects of Different Video Lecture Types on Sustained Attention, Emotion, Cognitive Load, and Learning Performance , 2015, IIAI-AAI.

[54]  Jan Marco Leimeister,et al.  Rate or Trade? Identifying Winning Ideas in Open Idea Sourcing , 2016, Inf. Syst. Res..

[55]  Triparna de Vreede.  Let the ideas flow: Antecedents of engagement in community-based crowdsourcing , 2016 .

[56]  Ronald Maier,et al.  IT-Supported Formal Control: How Perceptual (in)Congruence Affects the Convergence of Crowd-Sourced Ideas , 2016, International Conference on Interaction Sciences.

[57]  K. D. Joshi,et al.  The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: Giving Voice to the Less Powerful Through Value Sensitive Design , 2016, MIS Q..

[58]  Gretchen Irwin Casterella,et al.  The Effects of Information Request Language and Template Usage on Query Formulation , 2016, J. Assoc. Inf. Syst..

[59]  Ronald Maier,et al.  Exploring the Effects of Contest Mechanisms on Idea Shortlisting in an Open Idea Competition , 2016, ICIS.

[60]  Karl T. Ulrich,et al.  Idea Generation and the Role of Feedback: Evidence from Field Experiments with Innovation Tournaments , 2017 .

[61]  Chaoyun Liang,et al.  Is game-based learning better in flow experience and various types of cognitive load than non-game-based learning? Perspective from multimedia and media richness , 2017, Comput. Hum. Behav..