Crowdsourcing, Open Innovation and Collective Intelligence in the Scientific Method - A Research Agenda and Operational Framework

The lonely researcher trying to crack a problem in her office still plays an important role in fundamental research. However, a vast exchange, often with participants from different fields is taking place in modern research activities and projects. In the "Research Value Chain" (a simplified depiction of the Scientific Method as a process used for the analyses in this paper), interactions between researchers and other individuals (intentional or not) within or outside their respective institutions can be regarded as occurrences of Collective Intelligence. "Crowdsourcing" (Howe 2006) is a special case of such Collective Intelligence. It leverages the wisdom of crowds (Surowiecki 2004) and is already changing the way groups of people produce knowledge, generate ideas and make them actionable. A very famous example of a Crowdsourcing outcome is the distributed encyclopedia "Wikipedia". Published research agendas are asking how techniques addressing "the crowd" can be applied to non-profit environments, namely universities, and fundamental research in general. This paper discusses how the non-profit "Research Value Chain" can potentially benefit from Crowdsourcing. Further, a research agenda is proposed that investigates a) the applicability of Crowdsourcing to fundamental science and b) the impact of distributed agent principles from Artificial Intelligence research on the robustness of Crowdsourcing. Insights and methods from different research fields will be combined, such as complex networks, spatially embedded interacting agents or swarms and dynamic networks. Although the ideas in this paper essentially outline a research agenda, preliminary data from two pilot studies show that nonscientists can support scientific projects with high quality contributions. Intrinsic motivators (such as "fun") are present, which suggests individuals are not (only) contributing to such projects with a view to large monetary rewards.

[1]  Eric Schenk,et al.  Crowdsourcing: What can be Outsourced to the Crowd, and Why ? , 2009 .

[2]  Douglas R. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1981 .

[3]  L. Munari.  How the body shapes the way we think — a new view of intelligence , 2009 .

[4]  K. Lakhani,et al.  The Principles of Distributed Innovation , 2007, Innovations: Technology, Governance, Globalization.

[5]  Daniel Roos,et al.  The machine that changed the world : the story of lean production , 1991 .

[6]  Daren C. Brabham.  Crowdsourcing as a model for problem solving: Leveraging the collective intelligence of online communities for public good , 2010 .

[7]  Sean Lane,et al.  Collective Intelligence for Competitive Advantage: Crowdsourcing and Open Innovation , 2010 .

[8]  S. Castell,et al.  Serious Play , 2014 .

[9]  E. Hippel,et al.  Lead users: a source of novel product concepts , 1986 .

[10]  David Roman,et al.  Crowdsourcing and the question of expertise , 2009, Commun. ACM.

[11]  H. Etzkowitz,et al.  The Future of the University and the University of the Future: Evolution of Ivory Tower to Entrepreneurial Paradigm , 2000 .

[12]  S. Winter,et al.  An evolutionary theory of economic change , 1983 .

[13]  G. Masiero,et al.  Universities in the marketplace: the commercialization of higher education , 2003 .

[14]  Jock Given,et al.  The wealth of networks: How social production transforms markets and freedom , 2007, Inf. Econ. Policy.

[15]  Béatrice S. Hasler,et al.  Collaborative Work in 3D Virtual Environments: A Research Agenda and Operational Framework , 2009, HCI.

[16]  M. Edelstein.  Citizen Science: A Study of People, Expertise and Sustainable Development , 1998 .

[17]  K. Stöhr.  A multicentre collaboration to investigate the cause of severe acute respiratory syndrome , 2003, The Lancet.

[18]  Computer Staff,et al.  The Machine That Changed the World , 1992 .

[19]  M. Carroll.  The Belknap Press of Harvard University Press , 1970 .

[20]  Robbie T. Nakatsu,et al.  A comparative study of important risk factors involved in offshore and domestic outsourcing of software development projects: A two-panel Delphi study , 2009, Inf. Manag..

[21]  Monica Reggiani,et al.  An insightful comparison between experiments in mobile robotics and in science , 2009, Auton. Robots.

[22]  Rick Kazman,et al.  The metropolis model a new logic for development of crowdsourced systems , 2009, CACM.

[23]  L. A. Hausman.  How we Think , 1921 .

[24]  J. Sayers.  Against Method , 2016 .

[25]  Susan Crawford,et al.  Peer review and the changing research record , 1990, J. Am. Soc. Inf. Sci..

[26]  Nabil Amara,et al.  The impact of transaction costs on the institutional structuration of collaborative academic research , 1998 .

[27]  Julie A. Adams,et al.  Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence , 2001, AI Mag..

[28]  J. Schnoor,et al.  Citizen Science , 2017 .

[29]  Henry Chesbrough,et al.  Open Innovation: The New Imperative for Creating and Profiting from Technology , 2003 .

[30]  Thomas R. Hensley,et al.  Victims of Groupthink , 1986 .

[31]  D. Johnson,et al.  A difference. , 1990, Advancing clinical care : official journal of NOAADN.

[32]  James Surowiecki.  The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[33]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[34]  Raimar Richers.  The theory of economic development , 1961 .

[35]  S. Winter,et al.  An Evolutionary Theory of Economic Change.by Richard R. Nelson; Sidney G. Winter , 1987 .

[36]  A. Pentland,et al.  Collective intelligence , 2006, IEEE Comput. Intell. Mag..

[37]  W. Heath.  The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies , 2008 .

[38]  G. Melin.  Pragmatism and self-organization: Research collaboration on the individual level , 2000 .

[39]  I. Janis.  Victims of Groupthink: A psychological study of foreign-policy decisions and fiascoes. By Irving L. Janis. (Boston: Houghton Mifflin, 1972. viii + 276 pp. Map, illustrations, chart, notes, sources, bibliography, and index. Cloth, $7.95; paper $4.50.) , 1973 .

[40]  Guillermo Ricardo Simari,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 2000 .

[41]  Don Tapscott,et al.  Wikinomics: How Mass Collaboration Changes Everything , 2006 .

[42]  L. Jeppesen,et al.  The Value of Openness in Scientific Problem Solving , 2007 .

[43]  J. Armstrong,et al.  The Seer-Sucker Theory: The Value of Experts in Forecasting , 2005 .

[44]  Hajo Hippner,et al.  Crowdsourcing , 2012, Business & Information Systems Engineering.

[45]  Gabriella Kazai,et al.  On the Evaluation of the Quality of Relevance Assessments Collected through Crowdsourcing , 2009 .

[46]  G. Rao,et al.  Open Innovation , 2019, Strategic Decisions.

[47]  Chrysanthos Dellarocas,et al.  Harnessing Crowds: Mapping the Genome of Collective Intelligence , 2009 .

[48]  John Cullen,et al.  Democratizing Innovation , 2020, Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship.

[49]  Peter Norvig,et al.  Can Distributed Volunteers Accomplish Massive Data Analysis Tasks , 2001 .

[50]  Michael Schrage,et al.  Serious Play: How the World's Best Companies Simulate to Innovate , 1999 .

[51]  Derek Bok,et al.  Universities in the Marketplace , 2003 .

[52]  D. MacKenzie,et al.  The use of knowledge about society , 2008 .

[53]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[54]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[55]  Ted S. Sindlinger,et al.  Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business , 2010 .

[56]  J. Schumpeter.  The Theory of Economic Development: An Inquiry into Profits, Capital, Credit, Interest, and the Business Cycle , 1934 .

[57]  F. Hayek.  The economic nature of the firm: The use of knowledge in society , 1945 .

[58]  Edmund A. Mennis.  The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations , 2006 .

[59]  H. Etzkowitz.  Entrepreneurial scientists and entrepreneurial universities in American academic science , 1983, Minerva.

[60]  P. David.  Can ‘Open Science’ be Protected from the Evolving Regime of IPR Protections? , 2004 .

[61]  Barry Bozeman,et al.  The Impact of Research Collaboration on Scientific Productivity , 2005 .

[62]  Taya M. Malone,et al.  The Future of Work: How the New Order of Business Will Shape Your Organization, Your Management Style and Your Life , 2004 .

[63]  Y. Benkler,et al.  The Wealth of Networks , 2008 .