Crowdsourcing approaches for knowledge organization systems: Crowd collaboration or crowd work?

Development of Internet technologies has empowered ordinary users to create, contribute, share and connect with other members of the community. As users learn to exploit the potential of networked communications, they participate in a process, which facilitates a shift from individual to collective contributions and introduces an opportunity for multi‐vocal and multi‐faceted representation of cultural heritage. Open access to crowdsourced collections requires reconsideration of the traditional authoritative approach of cultural heritage institutions. The arduous nature of the work rendered voluntarily in cultural heritage crowdsourcing initiatives calls for reconsideration of power relationships and giving power to devoted contributors supported by modern “intelligent” technology to regulate the process of representation and organization. Taking into consideration the fact that crowdsourced data are not without flaws, the question is how to better utilize the collective intelligence to create quality information. In this context, various issues such as power, control, trust, inter‐contributor consensus, heterogeneity of opinions will be raised and discussed by the panelists. Each of the panelists comes from a different field of expertise (Computer science, Information science, Economics, Communication studies, cultural heritage) and various cultural backgrounds and geographical locations (United States, Europe and Israel). This diversity will be reflected in the presented perspectives on the crowdsourcing topic.

[1]  M. Foucault,et al.  Discipline and Punish: The Birth of the Prison. , 1978 .

[2]  Elena Paslaru Bontas Simperl,et al.  CrowdMap: Crowdsourcing Ontology Alignment with Microtasks , 2012, SEMWEB.

[3]  R. D'amico Discipline and Punish: The Birth of the Prison , 1978, Telos.

[4]  Benjamin B. Bederson,et al.  Human computation: a survey and taxonomy of a growing field , 2011, CHI.

[5]  Barbara H. Kwaśnik,et al.  Approaches to Providing Context in Knowledge Representation Structures , 2011 .

[6]  Mark A. Musen,et al.  The PROMPT suite: interactive tools for ontology merging and mapping , 2003, Int. J. Hum. Comput. Stud..

[7]  George A. Vouros,et al.  Human-centered ontology engineering: The HCOME methodology , 2006, Knowledge and Information Systems.

[8]  Barbara H. Kwasnik,et al.  Translation of classifications: Issues and solutions as exemplified in the Korean Decimal Classification. , 2004 .

[9]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993 .

[10]  Mark A Musen,et al.  Using the wisdom of the crowds to find critical errors in biomedical ontologies: a study of SNOMED CT , 2015, J. Am. Medical Informatics Assoc..

[11]  Jiahui Liu,et al.  Between ontology and folksonomy: a study of collaborative and implicit ontology evolution , 2008, IUI '08.

[12]  Elena Paslaru Bontas Simperl,et al.  Collaborative ontology engineering: a survey , 2013, The Knowledge Engineering Review.

[13]  Andreas Papasalouros,et al.  Automated Learning of Social Ontologies , 2011 .

[14]  J. Euzenat,et al.  Ontology Matching , 2007, Springer Berlin Heidelberg.

[15]  Krzysztof Janowicz,et al.  Collaborative Ontology Development for the Geosciences , 2014, Trans. GIS.

[16]  Jennifer Trant Tagging, Folksonomy and Art Museums: Early Experiments and Ongoing Research , 2009, J. Digit. Inf..

[17]  Mark A. Musen,et al.  Mechanical turk as an ontology engineer?: using microtasks as a component of an ontology-engineering workflow , 2013, WebSci.

[18]  James A. Hendler,et al.  Towards the semantic web: knowledge representation in a dynamic, distributed environment , 2001 .

[19]  Yi-Fan Chen,et al.  Examining social tagging behaviour and the construction of an online folksonomy from the perspectives of cultural capital and social capital , 2012, J. Inf. Sci..

[20]  Belén Díaz Agudo,et al.  Two-layered approach to knowledge representation using conceptual maps and description logics , 2004 .

[21]  Samson W. Tu,et al.  Supporting Collaborative Ontology Development in Protégé , 2008, SEMWEB.

[22]  Jakob Voß,et al.  Tagging, Folksonomy & Co - Renaissance of Manual Indexing? , 2007, ArXiv.

[23]  Kevin Crowston,et al.  Problems in the Use-Centered Development of a Taxonomy of Web Genres , 2011, Genres on the Web.

[24]  K. D. Joshi,et al.  A collaborative approach to ontology design , 2002, CACM.

[25]  Lora Aroyo,et al.  Measuring Crowd Truth for Medical Relation Extraction , 2013, AAAI Fall Symposia.

[26]  Victoria L. Rubin,et al.  Stretching Conceptual Structures in Classifications Across Languages and Cultures , 2003 .

[27]  York Sure-Vetter,et al.  The DILIGENT knowledge processes , 2005, J. Knowl. Manag..

[28]  Judit Bar-Ilan,et al.  Toward multiviewpoint ontology construction by collaboration of non‐experts and crowdsourcing: The case of the effect of diet on health , 2017, J. Assoc. Inf. Sci. Technol..

[29]  Dimitris Apostolou,et al.  Consensus Building in Collaborative Ontology Engineering Processes , 2006 .

[30]  Mark A. Musen,et al.  Crowdsourcing the Verification of Relationships in Biomedical Ontologies , 2013, AMIA.

[31]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[32]  Henry Jenkins Confronting the Challenges of Participatory Culture: Media Education for the 21st Century , 2006 .

[33]  Carola Eschenbach,et al.  Formal Ontology in Information Systems , 2008 .

[34]  Pierre Lévy,et al.  Collective Intelligence: Mankind's Emerging World in Cyberspace , 1997 .

[35]  Barry Smith Ontology (Science) , 2008, FOIS.

[36]  A MusenMark,et al.  The PROMPT suite , 2003 .

[37]  Smaranda Muresan,et al.  Inducing terminologies from text: A case study for the consumer health domain , 2013, J. Assoc. Inf. Sci. Technol..

[38]  M. Ashburner,et al.  The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration , 2007, Nature Biotechnology.

[39]  Jérôme Euzenat,et al.  Ontology Matching: State of the Art and Future Challenges , 2013, IEEE Transactions on Knowledge and Data Engineering.