Structure of Crowdsourcing Community Networks

Due to the interest of organizations and academics, crowdsourcing is emerging as an area of targeted social networking. The recent popularity and notable rise of crowdsourcing provides us with the opportunity to study these emerging communities to standardize and facilitate the crowdsourcing process for future development of such platforms. In this paper, we conduct a large and comprehensive study of the structure of a number of crowdsourcing communities (CCs). We study various properties of association (ASSO) and interaction (INTR) networks in an attempt to compare them with existing networks, such as online social networks (OSNs) and the World Wide Web (WWW) network. We obtained data for five successful CCs with nearly two million vertices and nearly six million edges, as well as data for four popular social network sites, Flickr, YouTube, Orkut, and LiveJournal, with more than 11 million vertices and over 328 million edges. We also obtained WWW data containing over 18 million vertices and over 64 million edges. We believe this is the first structural comparative study of CC networks with social and WWW networks at this scale. Our study reveals that CC networks—both ASSO and INTR—are smaller and less symmetrical than OSNs. Similar to OSNs and WWW, degree distributions of CC networks follow power-law distribution. CCs and WWW do not suffer influence dilution as is the case in OSNs. Different than OSNs, members of CC networks tend to connect to others with varying degrees, as is the case with WWW.

[1]  Jeff Howe,et al.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2008, Human Resource Management International Digest.

[2]  Eric Schenk,et al.  Crowdsourcing: What can be Outsourced to the Crowd, and Why ? , 2009 .

[3]  F. J. Roethlisberger,et al.  Management and the Worker: An Account of a Research Program Conducted by the Western Electric Company, Hawthorne Works, Chicago , 1939 .

[4]  Roger Guimerà,et al.  Team Assembly Mechanisms Determine Collaboration Network Structure and Team Performance , 2005, Science.

[5]  J. Moreno.  Who Shall Survive: A New Approach to the Problem of Human Interrelations , 2017 .

[6]  David M. Pennock,et al.  Mining the peanut gallery: opinion extraction and semantic classification of product reviews , 2003, WWW '03.

[7]  Ravi Kumar,et al.  Structure and evolution of online social networks , 2006, KDD '06.

[8]  Linton C. Freeman,et al.  The Development of Social Network Analysis—with an Emphasis on Recent Events , 2011 .

[9]  Pushmeet Kohli,et al.  Manifestations of user personality in website choice and behaviour on online social networks , 2013, Machine Learning.

[10]  Fernando González-Ladrón-de-Guevara,et al.  Towards an integrated crowdsourcing definition , 2012, J. Inf. Sci..

[11]  Jan-Erik Johanson,et al.  Role of knowledge conversion and social networks in team performance , 2011, Int. J. Inf. Manag..

[12]  F. Tönnies,et al.  Community and Society , 1988 .

[13]  C. Mills,et al.  The Social Life of a Modern Community. , 1942 .

[14]  Daren C. Brabham.  Crowdsourcing the Public Participation Process for Planning Projects , 2009 .

[15]  Satoshi Morinaga,et al.  Mining product reputations on the Web , 2002, KDD.

[16]  J. L. Moreno,et al.  Part I: Application of the group method to classification. , 1957 .

[17]  Alessandro Vespignani,et al.  Epidemic dynamics and endemic states in complex networks. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  C. Parvanta,et al.  Crowdsourcing 101: A Few Basics to Make You the Leader of the Pack , 2013 .

[19]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[20]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[21]  Frank Kleemann,et al.  Un(der)paid innovators: the commercial utilization of consumer work through crowdsourcing , 2008 .

[22]  Ajay Mehra.  The Development of Social Network Analysis: A Study in the Sociology of Science , 2005 .

[23]  P. Bonacich.  Factoring and weighting approaches to status scores and clique identification , 1972 .

[24]  M. Newman.  Coauthorship networks and patterns of scientific collaboration , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Alon Y. Halevy,et al.  Crowdsourcing systems on the World-Wide Web , 2011, Commun. ACM.

[26]  Eli Blevis,et al.  A survey of crowdsourcing as a means of collaboration and the implications of crowdsourcing for interaction design , 2011, 2011 International Conference on Collaboration Technologies and Systems (CTS).

[27]  Heng-Li Yang,et al.  Team structure and team performance in IS development: a social network perspective , 2004, Inf. Manag..

[28]  Garry Robins,et al.  Psychological predispositions and network structure: The relationship between individual predispositions, structural holes and network closure , 2006, Soc. Networks.

[29]  Andrei Z. Broder,et al.  Graph structure in the Web , 2000, Comput. Networks.

[30]  Albert-László Barabási,et al.  Internet: Diameter of the World-Wide Web , 1999, Nature.

[31]  Matthew Lease,et al.  Crowdsourcing 101: putting the WSDM of crowds to work for you , 2011, WSDM '11.

[32]  Mark E. J. Newman.  A measure of betweenness centrality based on random walks , 2005, Soc. Networks.

[33]  A. Barabasi,et al.  Evolution of the social network of scientific collaborations , 2001, cond-mat/0104162.

[34]  Seungyeop Han,et al.  Analysis of topological characteristics of huge online social networking services , 2007, WWW '07.

[35]  Maja Vukovic,et al.  Crowdsourcing for Enterprises , 2009, 2009 Congress on Services - I.

[36]  Qinghua Zhu,et al.  Exploring the Motivation of Participants in Crowdsourcing Contest , 2012, ICIS.

[37]  J. Krause,et al.  Personality in the context of social networks , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[39]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[40]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[42]  Gabriella Kazai,et al.  In Search of Quality in Crowdsourcing for Search Engine Evaluation , 2011, ECIR.

[43]  Daren C. Brabham.  MOVING THE CROWD AT THREADLESS , 2010 .

[44]  Rob Shields,et al.  Cultural Topology: The Seven Bridges of Königsburg, 1736 , 2012 .

[45]  Hildrun Kretschmer,et al.  The structure of scientific collaboration networks in Scientometrics , 2008, Scientometrics.

[46]  Brian A Vander Schee.  Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business , 2009 .

[47]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[48]  Massimo Marchiori,et al.  Error and attacktolerance of complex network s , 2004 .

[49]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[50]  Aniket Kittur.  Corralling crowd power , 2015, Commun. ACM.

[51]  Daren C. Brabham.  Crowdsourcing as a Model for Problem Solving , 2008 .

[52]  Sergey Brin,et al.  The Anatomy of a Large-Scale Hypertextual Web Search Engine , 1998, Comput. Networks.