Understanding Human-Machine Networks: A Cross-Disciplinary Survey

In the current hyper-connected era, modern Information and Communication Technology systems form sophisticated networks where not only do people interact with other people, but also machines take an increasingly visible and participatory role. Such human-machine networks (HMNs) are embedded in the daily lives of people, both for personal and professional use. They can have a significant impact by producing synergy and innovations. The challenge in designing successful HMNs is that they cannot be developed and implemented in the same manner as networks of machines nodes alone, nor following a wholly human-centric view of the network. The problem requires an interdisciplinary approach. Here, we review current research of relevance to HMNs across many disciplines. Extending the previous theoretical concepts of socio-technical systems, actor-network theory, cyber-physical-social systems, and social machines, we concentrate on the interactions among humans and between humans and machines. We identify eight types of HMNs: public-resource computing, crowdsourcing, web search engines, crowdsensing, online markets, social media, multiplayer online games and virtual worlds, and mass collaboration. We systematically select literature on each of these types and review it with a focus on implications for designing HMNs. Moreover, we discuss risks associated with HMNs and identify emerging design and development trends.

[1]  Kristen LeFevre,et al.  Privacy wizards for social networking sites , 2010, WWW '10.

[2]  Jeff Jones,et al.  The Emergence and Dynamical Evolution of Complex Transport Networks from Simple Low-Level Behaviours , 2015, Int. J. Unconv. Comput..

[3]  Carolyn A. Lin An Interactive Communication Technology Adoption Model , 2003 .

[4]  Xi Zhang,et al.  Understanding the users' continuous adoption of 3D social virtual world in China: A comparative case study , 2014, Comput. Hum. Behav..

[5]  Wei Cheng,et al.  ARTSense: Anonymous reputation and trust in participatory sensing , 2013, 2013 Proceedings IEEE INFOCOM.

[6]  Yulin Fang,et al.  Understanding Sustained Participation in Open Source Software Projects , 2009, J. Manag. Inf. Syst..

[7]  Ronald Marsh,et al.  Wildlife@Home: Combining Crowd Sourcing and Volunteer Computing to Analyze Avian Nesting Video , 2013, 2013 IEEE 9th International Conference on e-Science.

[8]  Iordanis Koutsopoulos,et al.  Optimal incentive-driven design of participatory sensing systems , 2013, 2013 Proceedings IEEE INFOCOM.

[9]  John Law,et al.  Notes on the theory of the actor-network: Ordering, strategy, and heterogeneity , 1992 .

[10]  Cory Ondrejka,et al.  Aviators, Moguls, Fashionistas and Barons: Economics and Ownership in Second Life , 2004 .

[11]  Lori N. K. Leonard,et al.  Trust in consumer-to-consumer electronic commerce , 2008, Inf. Manag..

[12]  Andreas Krause,et al.  Community sense and response systems: your phone as quake detector , 2014, CACM.

[13]  Tarek F. Abdelzaher,et al.  GreenGPS: a participatory sensing fuel-efficient maps application , 2010, MobiSys '10.

[14]  M. Castells Rise of the Network Society: The Information Age: Economy, Society and Culture , 1996 .

[15]  Claudio Carpineto,et al.  A Survey of Automatic Query Expansion in Information Retrieval , 2012, CSUR.

[16]  Wu-chun Feng,et al.  MOON: MapReduce On Opportunistic eNvironments , 2010, HPDC '10.

[17]  Meredith Ringel Morris,et al.  Collaborative search revisited , 2013, CSCW.

[18]  Kim Sheehan,et al.  Toward a Typology of Internet Users and Online Privacy Concerns , 2002, Inf. Soc..

[19]  Danah Boyd,et al.  Social Network Sites: Definition, History, and Scholarship , 2007, J. Comput. Mediat. Commun..

[20]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[21]  Ramesh Govindan,et al.  Medusa: a programming framework for crowd-sensing applications , 2012, MobiSys '12.

[22]  Mikaila Mariel Lemonik Arthur Emergent Norm Theory , 2013 .

[23]  V. Sharma,et al.  A simple approach to provide QoS and fairness in Internet , 2004, 2004 International Conference on Signal Processing and Communications, 2004. SPCOM '04..

[24]  Guido Hertel,et al.  Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel , 2003 .

[25]  Heiko A. von der Gracht,et al.  Integrating prediction market and Delphi methodology into a foresight support system — Insights from an online game , 2015 .

[26]  Tamás Vicsek,et al.  To join or not to join: collective foraging strategies , 2015 .

[27]  Y. Lin,et al.  Using eye movement parameters for evaluating human-machine interface frameworks under normal control operation and fault detection situations , 2003, Int. J. Hum. Comput. Stud..

[28]  Robert J. Moore,et al.  "Alone together?": exploring the social dynamics of massively multiplayer online games , 2006, CHI.

[29]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[30]  Francesco Chiti,et al.  A broadband wireless communications system for emergency management , 2008, IEEE Wireless Communications.

[31]  Salvatore Venticinque,et al.  An SLA-based Broker for Cloud Infrastructures , 2013, Journal of Grid Computing.

[32]  Michael S. Bernstein,et al.  The future of crowd work , 2013, CSCW.

[33]  Minjae Lee,et al.  RNA design rules from a massive open laboratory , 2014, Proceedings of the National Academy of Sciences.

[34]  B. Aguirre,et al.  A Test of the Emergent Norm Theory of Collective Behavior , 1998 .

[35]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[36]  Hosung Park,et al.  What is Twitter, a social network or a news media? , 2010, WWW '10.

[37]  Miguel A. Labrador,et al.  Data interpolation for participatory sensing systems , 2013, Pervasive Mob. Comput..

[38]  Domenico Talia,et al.  P2P-MapReduce: Parallel data processing in dynamic Cloud environments , 2012, J. Comput. Syst. Sci..

[39]  Mirco Musolesi,et al.  Anticipatory Mobile Computing , 2013, ACM Comput. Surv..

[40]  Lada A. Adamic,et al.  Exposure to ideologically diverse news and opinion on Facebook , 2015, Science.

[41]  J. Leimeister,et al.  What We Really Know About Antecedents of Trust: A Critical Review of the Empirical Information Systems Literature on Trust , 2013 .

[42]  Kim B. Clark,et al.  The Architecture of Participation: Does Code Architecture Mitigate Free Riding in the Open Source Development Model? , 2006, Manag. Sci..

[43]  Giovanni Quattrone,et al.  The Life of the Party: Impact of Social Mapping in OpenStreetMap , 2013, ICWSM.

[44]  Hector Garcia-Molina,et al.  The Eigentrust algorithm for reputation management in P2P networks , 2003, WWW '03.

[45]  Sang-Won Lee,et al.  On social Web sites , 2010, Inf. Syst..

[46]  Stephen S. Standifird Reputation and e-commerce: eBay auctions and the asymmetrical impact of positive and negative ratings , 2001 .

[47]  A. Kaplan,et al.  Users of the world, unite! The challenges and opportunities of Social Media , 2010 .

[48]  Eric T. G. Wang,et al.  Understanding knowledge sharing in virtual communities: An integration of social capital and social cognitive theories , 2006, Decis. Support Syst..

[49]  Patricia J. Rogers,et al.  Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions , 2008 .

[50]  Baik Hoh,et al.  Sell your experiences: a market mechanism based incentive for participatory sensing , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[51]  Ling Liu,et al.  Protecting Location Privacy with Personalized k-Anonymity: Architecture and Algorithms , 2008, IEEE Transactions on Mobile Computing.

[52]  Rajiv Kishore,et al.  Rules of Crowdsourcing: Models, Issues, and Systems of Control , 2013, Inf. Syst. Manag..

[53]  Alexander Hars,et al.  Working for free? Motivations of participating in open source projects , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[54]  Susan Wiedenbeck,et al.  On-line trust: concepts, evolving themes, a model , 2003, Int. J. Hum. Comput. Stud..

[55]  Bruce M. Maggs,et al.  Efficient content location using interest-based locality in peer-to-peer systems , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[56]  S. Noble,et al.  The influence of C2C communications in online brand communities on customer purchase behavior , 2010 .

[57]  Chao Wen,et al.  It is not for fun: An examination of social network site usage , 2012, Inf. Manag..

[58]  Refik Molva,et al.  Safebook: A privacy-preserving online social network leveraging on real-life trust , 2009, IEEE Communications Magazine.

[59]  Ching-I Teng,et al.  Customization, immersion satisfaction, and online gamer loyalty , 2010, Comput. Hum. Behav..

[60]  Julie A. McCann,et al.  A survey of autonomic computing—degrees, models, and applications , 2008, CSUR.

[61]  Jeffrey O. Kephart,et al.  An architectural approach to autonomic computing , 2004 .

[62]  Cristina Pérez-Solà,et al.  The Bitcoin P2P Network , 2014, Financial Cryptography Workshops.

[63]  Mika Raento,et al.  Smartphones , 2009 .

[64]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[65]  Karim R. Lakhani,et al.  Community, Joining, and Specialization in Open Source Software Innovation: A Case Study , 2003 .

[66]  Geoff Coulson,et al.  Free Riding on Gnutella Revisited: The Bell Tolls? , 2005, IEEE Distributed Syst. Online.

[67]  Premkumar T. Devanbu,et al.  Latent social structure in open source projects , 2008, SIGSOFT '08/FSE-16.

[68]  Stephen P. Boyd,et al.  QoS and fairness constrained convex optimization of resource allocation for wireless cellular and ad hoc networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[69]  Akbar Ghaffarpour Rahbar,et al.  PowerTrust: A Robust and Scalable Reputation System for Trusted Peer-to-Peer Computing , 2007, IEEE Transactions on Parallel and Distributed Systems.

[70]  Richard E. Boyatzis,et al.  An overview of intentional change from a complexity perspective , 2006 .

[71]  Kevin Y Yip,et al.  Comparing classical pathways and modern networks: towards the development of an edge ontology. , 2007, Trends in biochemical sciences.

[72]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[73]  Chaomei Chen,et al.  Interactive overlays of journals and the measurement of interdisciplinarity on the basis of aggregated journal-journal citations , 2013, J. Assoc. Inf. Sci. Technol..

[74]  Y YenNeil,et al.  Mobile Crowd Sensing and Computing , 2015 .

[75]  Gerardo Hermosillo,et al.  Learning From Crowds , 2010, J. Mach. Learn. Res..

[76]  Bin Wang,et al.  From virtual community members to C2C e-commerce buyers: Trust in virtual communities and its effect on consumers' purchase intention , 2010, Electron. Commer. Res. Appl..

[77]  M. Hogg,et al.  Social Identity, Self-Categorization, and the Communication of Group Norms , 2006 .

[78]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[79]  Wen Hu,et al.  Preserving privacy in participatory sensing systems , 2010, Comput. Commun..

[80]  Ilkka Arminen,et al.  Social functions of location in mobile telephony , 2006, Personal and Ubiquitous Computing.

[81]  André Brock,et al.  From the Blackhand Side: Twitter as a Cultural Conversation , 2012 .

[82]  Brian Weis,et al.  The Multicast Group Security Architecture , 2004, RFC.

[83]  Oded Nov,et al.  Volunteer computing: a model of the factors determining contribution to community-based scientific research , 2010, WWW '10.

[84]  David Baker,et al.  Algorithm discovery by protein folding game players , 2011, Proceedings of the National Academy of Sciences.

[85]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, SIGKDD Explor..

[86]  Starr Roxanne Hiltz,et al.  Trust and Privacy Concern Within Social Networking Sites: A Comparison of Facebook and MySpace , 2007, AMCIS.

[87]  John Riedl,et al.  Recommender systems in e-commerce , 1999, EC '99.

[88]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[89]  Daren C. Brabham Crowdsourcing as a Model for Problem Solving , 2008 .

[90]  Lars Backstrom,et al.  Balanced label propagation for partitioning massive graphs , 2013, WSDM.

[91]  JoongHo Ahn,et al.  Helpfulness of Online Consumer Reviews: Readers' Objectives and Review Cues , 2012, Int. J. Electron. Commer..

[92]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[93]  Michael S. Bernstein,et al.  Soylent: a word processor with a crowd inside , 2010, UIST.

[94]  M. Newman,et al.  Why social networks are different from other types of networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[95]  Jinwoo Kim,et al.  Why People Continue to Play Online Games: In Search of Critical Design Factors to Increase Customer Loyalty to Online Contents , 2004, Cyberpsychology Behav. Soc. Netw..

[96]  Eric A. von Hippel,et al.  How Open Source Software Works: 'Free' User-to-User Assistance? , 2000 .

[97]  Lada A. Adamic,et al.  The role of social networks in information diffusion , 2012, WWW.

[98]  Ryen W. White,et al.  Personalizing web search results by reading level , 2011, CIKM '11.

[99]  Wazir Zada Khan,et al.  Mobile Phone Sensing Systems: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[100]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[101]  Carlo Ratti,et al.  Real-Time Urban Monitoring Using Cell Phones: A Case Study in Rome , 2011, IEEE Transactions on Intelligent Transportation Systems.

[102]  Fei-Yue Wang,et al.  The Emergence of Intelligent Enterprises: From CPS to CPSS , 2010, IEEE Intelligent Systems.

[103]  Robert J. Moore,et al.  The social side of gaming: a study of interaction patterns in a massively multiplayer online game , 2004, CSCW.

[104]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[105]  Gary L. Lilien,et al.  Location, Location, Location: How Network Embeddedness Affects Project Success in Open Source Systems , 2006, Manag. Sci..

[106]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[107]  Qinghua Li,et al.  Efficient and Privacy-Aware Data Aggregation in Mobile Sensing , 2014, IEEE Transactions on Dependable and Secure Computing.

[108]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[109]  Amit P. Sheth,et al.  Physical-Cyber-Social Computing: An Early 21st Century Approach , 2013, IEEE Intelligent Systems.

[110]  Clayton Fink,et al.  Hashtag Lifespan and Social Networks during the London Riots , 2013, SBP.

[111]  Amanda Spink,et al.  Determining the informational, navigational, and transactional intent of Web queries , 2008, Inf. Process. Manag..

[112]  Hind Benbya,et al.  Toward a complexity theory of information systems development , 2006, Inf. Technol. People.

[113]  Felix F. Wu,et al.  Network reconfiguration in distribution systems for loss reduction and load balancing , 1989 .

[114]  D. Langley,et al.  Patterns of Herding and their Occurrence in an Online Setting , 2014 .

[115]  P. Leonardi Materiality, Sociomateriality, and Socio-Technical Systems: What Do These Terms Mean? How are They Related? Do We Need Them? , 2012 .

[116]  Michael Szell,et al.  Multirelational organization of large-scale social networks in an online world , 2010, Proceedings of the National Academy of Sciences.

[117]  Guy Doumeingts,et al.  Architectures for enterprise integration and interoperability: Past, present and future , 2008, Comput. Ind..

[118]  Apostolis K. Salkintzis Evolving public safety communication systems by integrating WLAN and TETRA networks , 2006, IEEE Communications Magazine.

[119]  Kwang-Il Goh,et al.  Towards real-world complexity: an introduction to multiplex networks , 2015, ArXiv.

[120]  Bruno S. Silvestre,et al.  Unpacking the Social Media Phenomenon: Towards a Research Agenda , 2012 .

[121]  Zhu Wang,et al.  Opportunistic IoT: Exploring the harmonious interaction between human and the internet of things , 2013, J. Netw. Comput. Appl..

[122]  Georgia Koutrika,et al.  Can social bookmarking improve web search? , 2008, WSDM '08.

[123]  Viswanath Venkatesh,et al.  Determinants of Perceived Ease of Use: Integrating Control, Intrinsic Motivation, and Emotion into the Technology Acceptance Model , 2000, Inf. Syst. Res..

[124]  Colin Camerer,et al.  Not So Different After All: A Cross-Discipline View Of Trust , 1998 .

[125]  Sarah Spiekermann,et al.  Online social networks: why we disclose , 2010, J. Inf. Technol..

[126]  Schahram Dustdar,et al.  A collaboration model for community-based Software Development with social machines , 2014, CollaborateCom 2014.

[127]  Loet Leydesdorff,et al.  Journal maps, interactive overlays, and the measurement of interdisciplinarity on the basis of Scopus data (1996–2012) , 2013, J. Assoc. Inf. Sci. Technol..

[128]  David Lusseau,et al.  The emergent properties of a dolphin social network , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[129]  Shipeng Yu,et al.  Ranking annotators for crowdsourced labeling tasks , 2011, NIPS.

[130]  César A. Hidalgo,et al.  Unique in the Crowd: The privacy bounds of human mobility , 2013, Scientific Reports.

[131]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[132]  David A. Maltz,et al.  A performance comparison of multi-hop wireless ad hoc network routing protocols , 1998, MobiCom '98.

[133]  T. Graepel,et al.  Private traits and attributes are predictable from digital records of human behavior , 2013, Proceedings of the National Academy of Sciences.

[134]  N Moray,et al.  Trust, control strategies and allocation of function in human-machine systems. , 1992, Ergonomics.

[135]  Jan Marco Leimeister,et al.  Understanding the Formation of Trust in IT Artifacts , 2012, ICIS.

[136]  Alon Y. Halevy,et al.  Crowdsourcing systems on the World-Wide Web , 2011, Commun. ACM.

[137]  David W. Binkley,et al.  Interprocedural slicing using dependence graphs , 1988, SIGP.

[138]  Elisa Bertino,et al.  Quality Control in Crowdsourcing Systems: Issues and Directions , 2013, IEEE Internet Computing.

[139]  Jeremy Rose,et al.  Socio-Theoretic Accounts of IS: The Problem of Agency , 2005, Scand. J. Inf. Syst..

[140]  Panagiotis G. Ipeirotis,et al.  Quality management on Amazon Mechanical Turk , 2010, HCOMP '10.

[141]  Deb Sledgianowski,et al.  Using Social Network Sites: The Effects of Playfulness, Critical Mass and Trust in a Hedonic Context , 2009, J. Comput. Inf. Syst..

[142]  Hsi-Peng Lu,et al.  Why people use social networking sites: An empirical study integrating network externalities and motivation theory , 2011, Comput. Hum. Behav..

[143]  David P. Anderson,et al.  High-Throughput All-Atom Molecular Dynamics Simulations Using Distributed Computing , 2010, J. Chem. Inf. Model..

[144]  Sriram Raghavan,et al.  Searching the Web , 2001, ACM Trans. Internet Techn..

[145]  S. Gorman,et al.  Volunteered Geographic Information and Crowdsourcing Disaster Relief: A Case Study of the Haitian Earthquake , 2010 .

[146]  James A. Landay,et al.  UbiGreen: investigating a mobile tool for tracking and supporting green transportation habits , 2009, CHI.

[147]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[148]  Philip S. Yu,et al.  Dynamic Load Balancing on Web-Server Systems , 1999, IEEE Internet Comput..

[149]  S. Shyam Sundar,et al.  Balancing human agency and object agency: an end-user interview study of the internet of things , 2012, UbiComp.

[150]  Jeffrey T. Hancock,et al.  Experimental evidence of massive-scale emotional contagion through social networks , 2014, Proceedings of the National Academy of Sciences.

[151]  Katherine J. Stewart,et al.  Special Issue: Trust in an Organizational Context: Trust Transfer on the World Wide Web , 2003, Organ. Sci..

[152]  KemmeBettina,et al.  Peer-to-peer architectures for massively multiplayer online games , 2013 .

[153]  Kevin Crowston,et al.  The social structure of free and open source software development , 2005, First Monday.

[154]  Lakshmi Goel,et al.  Predicting users' return to virtual worlds: a social perspective , 2013, Inf. Syst. J..

[155]  Salil S. Kanhere,et al.  A survey on privacy in mobile participatory sensing applications , 2011, J. Syst. Softw..

[156]  Donald A. Norman,et al.  Affect and machine design: Lessons for the development of autonomous machines , 2003, IBM Syst. J..

[157]  Shun-Yun Hu,et al.  VON: a scalable peer-to-peer network for virtual environments , 2006, IEEE Network.

[158]  Martin Schader,et al.  Managing the Crowd: Towards a Taxonomy of Crowdsourcing Processes , 2011, AMCIS.

[159]  J. Herbsleb,et al.  Two case studies of open source software development: Apache and Mozilla , 2002, TSEM.

[160]  Nigel Shadbolt,et al.  A Taxonomic Framework for Social Machines , 2014 .

[161]  Alán Aspuru-Guzik,et al.  The Harvard Clean Energy Project: Large-Scale Computational Screening and Design of Organic Photovoltaics on the World Community Grid , 2011 .

[162]  E. Trist,et al.  The Causal Texture of Organizational Environments , 1965 .

[163]  B. Frey,et al.  Motivation Crowding Theory: A Survey of Empirical Evidence , 2000 .

[164]  Alexandre Ardichvili,et al.  Learning and Knowledge Sharing in Virtual Communities of Practice: Motivators, Barriers, and Enablers , 2008 .

[165]  Manuel Blum,et al.  reCAPTCHA: Human-Based Character Recognition via Web Security Measures , 2008, Science.

[166]  Efthimis N. Efthimiadis,et al.  Analyzing and evaluating query reformulation strategies in web search logs , 2009, CIKM.

[167]  Constance Steinkuehler,et al.  Where Everybody Knows Your (Screen) Name: Online Games as "Third Places" , 2006, DiGRA Conference.

[168]  WigginsAndrea,et al.  Free/Libre open-source software development , 2008 .

[169]  J. H. Davis,et al.  An Integrative Model of Organizational Trust: Past, Present, and Future , 2007 .

[170]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[171]  Eric Lonstein,et al.  Prize-based contests can provide solutions to computational biology problems , 2013, Nature Biotechnology.

[172]  Sergey Brin,et al.  Reprint of: The anatomy of a large-scale hypertextual web search engine , 2012, Comput. Networks.

[173]  Akbar Zaheer,et al.  Trust as an Organizing Principle Bill McEvily , 2003 .

[174]  Arvid Kappas,et al.  Applying a Text-Based Affective Dialogue System in Psychological Research: Case Studies on the Effects of System Behaviour, Interaction Context and Social Exclusion , 2014, Cognitive Computation.

[175]  Robert J. Moore,et al.  The life and death of online gaming communities: a look at guilds in world of warcraft , 2007, CHI.

[176]  Kajal T. Claypool,et al.  Latency and player actions in online games , 2006, CACM.

[177]  Fan Ye,et al.  Mobile crowdsensing: current state and future challenges , 2011, IEEE Communications Magazine.

[178]  B. Latour Reassembling the Social: An Introduction to Actor-Network-Theory , 2005 .

[179]  Aniket Kittur,et al.  CrowdForge: crowdsourcing complex work , 2011, UIST.

[180]  Mo Li,et al.  How Long to Wait? Predicting Bus Arrival Time With Mobile Phone Based Participatory Sensing , 2012, IEEE Transactions on Mobile Computing.

[181]  Douglas R. Vogel,et al.  Individual motivations and demographic differences in social virtual world uses: An exploratory investigation in Second Life , 2011, Int. J. Inf. Manag..

[182]  Jon Kleinberg,et al.  Authoritative sources in a hyperlinked environment , 1999, SODA '98.

[183]  Cecilia Mascolo,et al.  Exploiting place features in link prediction on location-based social networks , 2011, KDD.

[184]  Chen Zhang,et al.  Emergence of New Project Teams from Open Source Software Developer Networks: Impact of Prior Collaboration Ties , 2008, Inf. Syst. Res..

[185]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[186]  Jun Wang,et al.  TRIBLER: a social‐based peer‐to‐peer system , 2008, IPTPS.

[187]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[188]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[189]  R. Hanson,et al.  Information aggregation and manipulation in an experimental market , 2006 .

[190]  Barry L. Bayus,et al.  Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community , 2013, Manag. Sci..

[191]  Coye Cheshire Online Trust, Trustworthiness, or Assurance? , 2011, Daedalus.

[192]  Vijay S. Pande,et al.  Folding@home: Lessons from eight years of volunteer distributed computing , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[193]  Sonali K. Shah Motivation, Governance, and the Viability of Hybrid Forms in Open Source Software Development , 2006, Manag. Sci..

[194]  Utpal M. Dholakia,et al.  Open Source Software User Communities: A Study of Participation in Linux User Groups , 2006, Manag. Sci..