Turning social news curation into microtask crowdsourcing: a vision and research agenda

Over the past decade, online crowdsourcing has established itself as an emerging paradigm that industry and government have been using to harness the cognitive abilities of a multitude of users distributed around the world. In this context, microtask crowdsourcing has become the method of choice for addressing a wide range of diverse problems. Microtasks typically require a minimum of time and cognitive effort, but combined individual efforts have made it possible to accomplish great achievements. The goal of this paper is to contribute to the ongoing effort of understanding whether the same success that microtask crowdsourcing has achieved in other domains can be obtained in the field of social news curation. In particular, we ask whether it is possible to turn online news curation, typically a social and collaborative activity on the Web, into a model in which curatorial activities are mapped into microtasks to be performed by a crowd of online users.

[1]  Michael S. Bernstein,et al.  Crowd Research: Open and Scalable University Laboratories , 2017, UIST.

[2]  Edson Mello Lucas,et al.  Towards a typology of social news apps from a Crowd Computing perspective , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[4]  Jano Moreira de Souza,et al.  Strategic planning in semantic crowdware large groups decision , 2012, Proceedings of the 2012 IEEE 16th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[5]  Ana Paula Pimentel,et al.  Evaluation of a Collaborative Curation Platform from the Perspective of Selective Exposure , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[7]  Elisa Bertino,et al.  Quality Control in Crowdsourcing Systems: Issues and Directions , 2013, IEEE Internet Computing.

[8]  Paul Mulholland,et al.  Curation, curation, curation , 2013, NHT '13.

[9]  Jano Moreira de Souza,et al.  Designing, building and evaluating a social news curation environment using the action design research methodology , 2017, Cluster Computing.

[10]  Jorge Gonçalves,et al.  CrowdCog , 2020, Proc. ACM Hum. Comput. Interact..

[11]  Kwong-Sak Leung,et al.  Task Matching in Crowdsourcing , 2011, 2011 International Conference on Internet of Things and 4th International Conference on Cyber, Physical and Social Computing.

[12]  André van der Hoek,et al.  A Vision of Crowd Development , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[13]  Michael S. Bernstein,et al.  Soylent: a word processor with a crowd inside , 2010, UIST.

[14]  Kwong-Sak Leung,et al.  TaskRec: A Task Recommendation Framework in Crowdsourcing Systems , 2015, Neural Processing Letters.

[15]  A. Bandura.  Perceived Self-Efficacy in Cognitive Development and Functioning , 1993, Educational Psychologist.

[16]  Sandeep Purao,et al.  Action Design Research , 2011, MIS Q..

[17]  Daren C. Brabham.  Crowdsourcing the Public Participation Process for Planning Projects , 2009 .

[18]  Martin Schader,et al.  Personalized task recommendation in crowdsourcing information systems - Current state of the art , 2014, Decis. Support Syst..

[19]  Paulo S. C. Alencar,et al.  CollabRDL: A language to coordinate collaborative reuse , 2017, J. Syst. Softw..

[20]  Hugo Paredes,et al.  Hybrid Machine-Crowd Interaction for Handling Complexity: Steps Toward a Scaffolding Design Framework , 2019, Macrotask Crowdsourcing.

[21]  Michael Vitale,et al.  The Wisdom of Crowds , 2015, Cell.

[22]  Daniel J. Veit,et al.  More than fun and money. Worker Motivation in Crowdsourcing - A Study on Mechanical Turk , 2011, AMCIS.

[23]  Ana Paula Pimentel,et al.  Exploring Social Validation on A Collaborative Curation Platform , 2019, 2019 IEEE 23rd International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[24]  Jano Moreira de Souza,et al.  Engaging citizens with news stories through social curation: a design research project , 2015, IHC.

[25]  Bonnie A. Nardi,et al.  Not Just in it for the Money: A Qualitative Investigation of Workers' Perceived Benefits of Micro-task Crowdsourcing , 2015, 2015 48th Hawaii International Conference on System Sciences.

[26]  Andrew McGregor,et al.  AutoMan: a platform for integrating human-based and digital computation , 2012, OOPSLA '12.

[27]  Milan Stankovic,et al.  Web technologies for open innovation , 2011, WebSci '11.

[28]  Robbie T. Nakatsu,et al.  A taxonomy of crowdsourcing based on task complexity , 2014, J. Inf. Sci..

[29]  Jano Moreira de Souza,et al.  Exploring asymmetric collaboration in social news curation , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[30]  M. E. Shaw.  Group dynamics : the psychology of small group behavior , 1971 .

[31]  Thomas D. LaToza,et al.  Microtask Programming , 2019, IEEE Transactions on Software Engineering.

[32]  D. Campbell.  Task Complexity: A Review and Analysis , 1988 .

[33]  Mahmood Hosseini,et al.  The four pillars of crowdsourcing: A reference model , 2014, 2014 IEEE Eighth International Conference on Research Challenges in Information Science (RCIS).

[34]  Xiaodong Lin,et al.  Location privacy-aware task recommendation for spatial crowdsourcing , 2017, 2017 9th International Conference on Wireless Communications and Signal Processing (WCSP).

[35]  Jano Moreira de Souza,et al.  Towards an observatory for mobile participatory sensing applications , 2017, 2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[36]  Norman M. Sadeh,et al.  Curated city: capturing individual city guides through social curation , 2014, CHI.

[37]  Michael S. Bernstein,et al.  Ensemble: exploring complementary strengths of leaders and crowds in creative collaboration , 2014, CSCW.