How crowdsourcing improves prediction of market-oriented outcomes

Firms often struggle to be proficient in predicting uncertain market conditions and forecasting the outcomes of their business initiatives. This research introduces crowdsourcing as an innovative tool that can enhance market information processing, and in turn, improve prediction of market-oriented outcomes (e.g., sales). We field test a forecasting tournament with employees at a Fortune 100 consumer packaged goods firm, and examine the extent to which predictions based on the “wisdom of the crowd” outperform those generated by traditional forecasting approaches. We find that crowdsourcing produces results superior to the firm's incumbent approaches almost three-fourths of the time across a broad range of business decisions. Additionally, we conduct a survey with participants to open up the “black box” of crowdsourcing. We find that differences in information acquisition and interpretation are the underlying mechanisms that can explain the improved prediction accuracy found through crowdsourcing.

[1]  Peter S. Fader,et al.  An Empirical Comparison of New Product Trial Forecasting Models , 1998 .

[2]  D. Teece,et al.  DYNAMIC CAPABILITIES AND STRATEGIC MANAGEMENT , 1997 .

[3]  Ken G. Smith,et al.  The age of temporary advantage , 2010 .

[4]  Berend Wierenga,et al.  The Success of Marketing Management Support Systems , 1999 .

[5]  Neil A. Morgan,et al.  Benchmarking Marketing Capabilities for Sustainable Competitive Advantage , 2005 .

[6]  Justin Wolfers,et al.  Using Prediction Markets to Track Information Flows: Evidence from Google , 2009, AMMA.

[7]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[8]  A. Brem,et al.  Prediction Markets: A literature review 2014 , 2014 .

[9]  J. Armstrong,et al.  Findings from Evidence-Based Forecasting: Methods for Reducing Forecast Error , 2006 .

[10]  Paul C. Tetlock,et al.  The Promise of Prediction Markets , 2008, Science.

[11]  Sanjoy Ghose,et al.  Forecast information and traditional retailer performance in a dual-channel competitive market , 2010 .

[12]  Kay-Yut Chen,et al.  New Product Blockbusters: The Magic and Science of Prediction Markets , 2007 .

[13]  Marko Sarstedt,et al.  PLS-SEM: Indeed a Silver Bullet , 2011 .

[14]  J. Hair.  Multivariate data analysis , 1972 .

[15]  Angela P. Wetzel.  Internet, mail, and mixed‐mode surveys: The tailored design method , 2010 .

[16]  G. Day,et al.  Managerial Representations of Competitive Advantage , 1994 .

[17]  Simon Rodan,et al.  More than Network Structure: How Knowledge Heterogeneity Influences Managerial Performance and Innovativeness , 2004 .

[18]  Kenneth B. Kahn.  An exploratory investigation of new product forecasting practices , 2002 .

[19]  Gilbert A. Churchill,et al.  Marketing Research: Methodological Foundations , 1976 .

[20]  R. Calantone,et al.  The Impact of Market Knowledge Competence on New Product Advantage: Conceptualization and Empirical Examination , 1998 .

[21]  James M. Sinkula,et al.  A framework for market-based organizational learning: Linking values, knowledge, and behavior , 1997 .

[22]  B. Skiera,et al.  Sourcing, Filtering, and Evaluating New Product Ideas: An Empirical Exploration of the Performance of Idea Markets , 2012 .

[23]  Martin Spann,et al.  Internet-Based Virtual Stock Markets for Business Forecasting , 2003, Manag. Sci..

[24]  Neeraj Bharadwaj,et al.  Marketing Initiatives, Expected Cash Flows, and Shareholders'Wealth , 2008 .

[25]  G. Huber.  Organizational Learning: The Contributing Processes and the Literatures , 1991 .

[26]  Daniel A. Levinthal,et al.  Exploration and Exploitation in Organizational Learning , 2007 .

[27]  Dusya Vera,et al.  Dynamic capabilities and operational capabilities: A knowledge management perspective , 2007 .

[28]  Kathleen M. Eisenhardt,et al.  DYNAMIC CAPABILITIES, WHAT ARE THEY? , 2000 .

[29]  Kurt Matzler,et al.  Predicting New Product Success with Prediction Markets in Online Communities , 2013 .

[30]  Vidal Díaz de Rada,et al.  Internet, Phone, Mail and Mixed-Mode Surveys: The Tailored Design Method. Don A. Dillman, Jolene D. Smyth y Leah Melani Christian. (New Jersey, John Wiley and Sons, 2014) , 2016 .

[31]  H. Winklhofer,et al.  Export sales forecasting by UK firms: Technique utilization and impact on forecast accuracy , 2003 .

[32]  Neeraj Bharadwaj,et al.  Innovation in Data‐Rich Environments , 2015 .

[33]  E. Bonabeau.  Decisions 2.0: the power of collective intelligence , 2009 .

[34]  John C. Narver,et al.  Market Orientation and the Learning Organization , 1995 .

[35]  James M. Sinkula.  Market Information Processing and Organizational Learning , 1994 .

[36]  Tasadduq A. Shervani,et al.  Marketing, Business Processes, and Shareholder Value: An Organizationally Embedded View of Marketing Activities and the Discipline of Marketing , 1999 .

[37]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[38]  Ajay K. Kohli,et al.  Market Intelligence Dissemination across Functional Boundaries , 1996 .

[39]  Douglas W. Vorhies,et al.  Improving customer-focused marketing capabilities and firm financial performance via marketing exploration and exploitation , 2011 .

[40]  J. Scott Armstrong,et al.  Methods to Elicit Forecasts from Groups: Delphi and Prediction Markets Compared , 2007 .

[41]  C. Moorman.  Organizational Market Information Processes: Cultural Antecedents and New Product Outcomes , 1995 .

[42]  Alexander Brem,et al.  Prediction Markets: A literature review 2014 , 2014 .

[43]  E. Sandberg,et al.  Enabling service innovation: A dynamic capabilities approach , 2013 .

[44]  John C. Narver,et al.  The Effect of a Market Orientation on Business Profitability , 1990 .

[45]  G. Day.  The Capabilities of Market-Driven Organizations , 1994 .

[46]  Chrysanthos Dellarocas,et al.  Harnessing Crowds: Mapping the Genome of Collective Intelligence , 2009 .

[47]  Karl T. Ulrich,et al.  Special Issue on Design and Development: Product Development Decisions: A Review of the Literature , 2001, Manag. Sci..

[48]  J. Ord,et al.  Principles of forecasting: A handbook for researchers and practitioners , 2002 .

[49]  Rolph E. Anderson,et al.  Multivariate Data Analysis (7th ed. , 2009 .

[50]  Marko Sarstedt,et al.  An assessment of the use of partial least squares structural equation modeling in marketing research , 2012 .

[51]  Neil A. Morgan.  Marketing and business performance , 2012 .

[52]  Rex B. Kline,et al.  Principles and Practice of Structural Equation Modeling , 1998 .

[53]  W. Gartner,et al.  Factors affecting new product forecasting accuracy in new firms , 1993 .

[54]  Christopher L. Tucci,et al.  Crowdsourcing As a Solution to Distant Search , 2012 .

[55]  Lisa Werner,et al.  Principles of forecasting: A handbook for researchers and practitioners , 2002 .

[56]  G. Day.  Closing the Marketing Capabilities Gap , 2011 .

[57]  Frances J. Milliken,et al.  Searching for Common Threads: Understanding the Multiple Effects of Diversity in Organizational Groups , 1996 .

[58]  Stanley F. Slater,et al.  Intelligence generation and superior customer value , 2000 .