Online Multiplayer Games for Crowdsourcing the Development of Digital Assets - The Case of Ingress

Crowdsourcing has emerged as a cost-efficient solution for companies to resolve certain tasks requiring vast amounts of human input. In order to motivate participants to harness their best efforts for the crowdsourcing task, companies are gamifying or creating complete games around crowdsourcing problems. The location-based game Ingress integrated the development of a geographically distributed database of points of interest in its game design. Players submitted and later peer-reviewed PoI candidates for Niantic for free, who then used the crowdsourced database as backbone for such popular games as Pokemon GO and Harry Potter: Wizards Unite. This study analyzes the solution in Ingress from two main perspectives: (1) how the game motivates players to participate in the crowdsourcing tasks and (2) how crowdsourcing fits into the game creator Niantic’s revenue model. The results show that Ingress players are provided multi-layered motivation to participate in crowdsourcing. The crowdsourcing tasks influence the game world, but are not limited inside it, and can be used elsewhere. Adopting crowdsourcing as a business strategy has served Niantic well, making Niantic an international multi-billion dollar company. Therefore it is predicted that more online multiplayer games implementing crowdsourcing as a revenue stream are likely to emerge in the near future.

[1]  Nathan Hulsey,et al.  The Gift that Keeps On Giving: Google, Ingress and the Gift of Surveillance , 2014 .

[2]  Panagiotis G. Ipeirotis Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[3]  Thomas Kohler,et al.  Crowdsourcing business models that last , 2017 .

[4]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[5]  Deborah I. Fels,et al.  Gamification in theory and action: A survey , 2015, Int. J. Hum. Comput. Stud..

[6]  Hartwig H. Hochmair,et al.  Where to catch ‘em all? – a geographic analysis of Pokémon Go locations , 2017, Geo spatial Inf. Sci..

[7]  Daren C. Brabham Motivations for Participation in a Crowdsourcing Application to Improve Public Engagement in Transit Planning , 2012 .

[8]  Daren C. Brabham MOVING THE CROWD AT THREADLESS , 2010 .

[9]  Ralf Steinmetz,et al.  Geodata Classification for Automatic Content Creation in Location-Based Games , 2017, JCSG.

[10]  Sonja Marjanovic,et al.  Crowdsourcing based business models: In search of evidence for innovation 2.0 , 2012 .

[11]  O. Venger Internet Research in Online Environments for Children: Readability of Privacy and Terms of Use Policies; The Uses of (Non)Personal Data by Online Environments and Third-Party Advertisers , 2017 .

[12]  Julian Togelius,et al.  Crowdsourcing the Aesthetics of Platform Games , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[13]  Miguel Angel Luengo-Oroz,et al.  Crowdsourcing Malaria Parasite Quantification: An Online Game for Analyzing Images of Infected Thick Blood Smears , 2012, Journal of medical Internet research.

[14]  K. D. Joshi,et al.  Why Individuals Participate in Micro-task Crowdsourcing Work Environment: Revealing Crowdworkers' Perceptions , 2016, J. Assoc. Inf. Syst..

[15]  Juho Hamari,et al.  The Gamification of Work: Lessons From Crowdsourcing , 2018, Journal of Management Inquiry.

[16]  Ian P. McCarthy,et al.  How to Work a Crowd: Developing Crowd Capital Through Crowdsourcing , 2014, ArXiv.

[17]  Jan Marco Leimeister,et al.  Is There PAPA in Crowd Work?: A Literature Review on Ethical Dimensions in Crowdsourcing , 2016, 2016 Intl IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld).

[18]  Oded Nov,et al.  What motivates Wikipedians? , 2007, CACM.

[19]  S. Reijnders,et al.  Immersion, authenticity and the theme park as social space: Experiencing the Wizarding World of Harry Potter , 2018 .

[20]  Khaled Shaalan,et al.  Mobile Gaming Trends and Revenue Models , 2016, IEA/AIE.

[21]  A. Allison The Cool Brand, Affective Activism and Japanese Youth , 2009 .

[22]  Cynthia Breazeal,et al.  Crowdsourcing HRI through Online Multiplayer Games , 2010, AAAI Fall Symposium: Dialog with Robots.

[23]  Julie McDonough Dolmaya The ethics of crowdsourcing , 2021 .

[24]  Karl Michael Popp,et al.  Software Industry Business Models , 2011, IEEE Software.

[25]  Shira Chess,et al.  Augmented regionalism: Ingress as geomediated gaming narrative , 2014 .

[26]  Martin Schader,et al.  Personalized task recommendation in crowdsourcing information systems - Current state of the art , 2014, Decis. Support Syst..

[27]  James Newman Kaizo Mario Maker , 2018 .

[28]  Vaninha Vieira,et al.  Towards a Framework for Gamification Design on Crowdsourcing Systems: The G.A.M.E. Approach , 2015, 2015 12th International Conference on Information Technology - New Generations.

[29]  Alexander Maedche,et al.  Gamified crowdsourcing: Conceptualization, literature review, and future agenda , 2017, Int. J. Hum. Comput. Stud..

[30]  Ryen W. White,et al.  Influence of Pokémon Go on Physical Activity: Study and Implications , 2016, Journal of medical Internet research.

[31]  Sue Morris,et al.  WADs, Bots and Mods: Multiplayer FPS Games as Co-creative Media , 2003, DiGRA Conference.

[32]  Chris Callison-Burch,et al.  Worker Demographics and Earnings on Amazon Mechanical Turk: An Exploratory Analysis , 2019, CHI Extended Abstracts.

[33]  Juho Hamari,et al.  Gamification in Crowdsourcing: A Review , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[34]  Heiko Gewald,et al.  Does Money Matter? Motivational Factors for Participation in Paid- and Non-Profit-Crowdsourcing Communities , 2013, Wirtschaftsinformatik.

[35]  Björn W. Schuller,et al.  iHEARu-PLAY: Introducing a game for crowdsourced data collection for affective computing , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[36]  M. Hossain,et al.  Users' motivation to participate in online crowdsourcing platforms , 2012, 2012 International Conference on Innovation Management and Technology Research.

[37]  Johannes Schöning,et al.  The Geography of Pokémon GO: Beneficial and Problematic Effects on Places and Movement , 2017, CHI.

[38]  Alys Young,et al.  Qualitative Research and Translation Dilemmas , 2004 .

[39]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[40]  Craig Standing,et al.  The Ethical Use of Crowdsourcing , 2018 .

[41]  Katie Shilton,et al.  Putting mobile application privacy in context: An empirical study of user privacy expectations for mobile devices , 2016, Inf. Soc..

[42]  Walt Scacchi,et al.  Computer Game Mods, Modders, Modding, and the Mod Scene , 2010, First Monday.

[43]  Erkki Sutinen,et al.  A Review of Location-based Games: Do They All Support Exercise, Social Interaction and Cartographical Training? , 2019, CSEDU.

[44]  William W. Cohen,et al.  Crowdsourced Comprehension: Predicting Prerequisite Structure in Wikipedia , 2012, BEA@NAACL-HLT.

[45]  Olli Sotamaa,et al.  When the Game Is Not Enough: Motivations and Practices Among Computer Game Modding Culture , 2010, Games Cult..

[46]  Janis Cloos,et al.  Is Your Privacy for Sale? An Experiment on the Willingness to Reveal Sensitive Information , 2019, Games.

[47]  Angelo Bonfanti,et al.  Crowdcrafting as a new manufacturing model: the experience of Berto Salotti , 2018 .

[48]  Fernando González-Ladrón-de-Guevara,et al.  Towards an integrated crowdsourcing definition , 2012, J. Inf. Sci..

[49]  Cynthia Breazeal,et al.  Crowdsourcing human-robot interaction: Application from virtual to physical worlds , 2011, 2011 RO-MAN.

[50]  Rajiv Kishore,et al.  Rules of Crowdsourcing: Models, Issues, and Systems of Control , 2013, Inf. Syst. Manag..

[51]  Melissa Densmore,et al.  Online Gaming for Crowd-sourcing Phrase-equivalents , 2014, COLING.

[52]  Norjansalika Janom,et al.  Business model of crowdsourcing: Review paper , 2015, 2015 IEEE 6th Control and System Graduate Research Colloquium (ICSGRC).

[53]  S. Kühn,et al.  Playing Super Mario induces structural brain plasticity: gray matter changes resulting from training with a commercial video game , 2014, Molecular Psychiatry.

[54]  Alexander Maedche,et al.  Cooperation or competition - When do people contribute more? A field experiment on gamification of crowdsourcing , 2019, Int. J. Hum. Comput. Stud..

[55]  Timo Knuutila,et al.  Revenue Models of Application Developers in Android Market Ecosystem , 2012, ICSOB.

[56]  Christopher G. Harris Dirty Deeds Done Dirt Cheap: A Darker Side to Crowdsourcing , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[57]  Sami Hyrynsalmi,et al.  The Dark Side of Gamification: How We Should Stop Worrying and Study also the Negative Impacts of Bringing Game Design Elements to Everywhere , 2017, GamiFIN.

[58]  Michael Davis,et al.  Ingress in Geography: Portals to Academic Success? , 2017 .

[59]  Sami Hyrynsalmi,et al.  Letters from the War of Ecosystems – An Analysis of Independent Software Vendors in Mobile Application Marketplaces , 2014 .

[60]  Sean C. Duncan Minecraft, beyond construction and survival , 2011 .