Matching individual attributes with task types in collaborative citizen science

In citizen science, participants’ productivity is imperative to project success. We investigate the feasibility of a collaborative approach to citizen science, within which productivity is enhanced by capitalizing on the diversity of individual attributes among participants. Specifically, we explore the possibility of enhancing productivity by integrating multiple individual attributes to inform the choice of which task should be assigned to which individual. To that end, we collect data in an online citizen science project composed of two task types: (i) filtering images of interest from an image repository in a limited time, and (ii) allocating tags on the object in the filtered images over unlimited time. The first task is assigned to those who have more experience in playing action video games, and the second task to those who have higher intrinsic motivation to participate. While each attribute has weak predictive power on the task performance, we demonstrate a greater increase in productivity when assigning participants to the task based on a combination of these attributes. We acknowledge that such an increase is modest compared to the case where participants are randomly assigned to the tasks, which could offset the effort of implementing our attribute-based task assignment scheme. This study constitutes a first step toward understanding and capitalizing on individual differences in attributes toward enhancing productivity in collaborative citizen science. Subjects Human-Computer Interaction, Computer Aided Design, Data Science, Optimization Theory and Computation

[1]  Ya'akov Gal,et al.  Improving Productivity in Citizen Science through Controlled Intervention , 2015, WWW.

[2]  Oded Nov,et al.  Using targeted design interventions to encourage extra‐role crowdsourcing behavior , 2016, J. Assoc. Inf. Sci. Technol..

[3]  M. Veenman,et al.  Relation between intellectual and metacognitive skills: Age and task differences , 2005 .

[4]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[5]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[6]  Oded Nov,et al.  Development of a Mechatronics-Based Citizen Science Platform for Aquatic Environmental Monitoring , 2014, IEEE/ASME Transactions on Mechatronics.

[7]  Anita Greenhill,et al.  Defining and Measuring Success in Online Citizen Science: A Case Study of Zooniverse Projects , 2015, Computing in Science & Engineering.

[8]  Joseph D. Chisholm,et al.  Reduced attentional capture in action video game players , 2010, Attention, perception & psychophysics.

[9]  C. Lintott,et al.  Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey , 2008, 0804.4483.

[10]  C Shawn Green,et al.  Increasing Speed of Processing With Action Video Games , 2009, Current directions in psychological science.

[11]  Robert J. Houghton,et al.  Task Workflow Design and its impact on performance and volunteers' subjective preference in Virtual Citizen Science , 2017, Int. J. Hum. Comput. Stud..

[12]  Kevin Crowston,et al.  Purposeful gaming & socio-computational systems: a citizen science design case , 2012, GROUP.

[13]  Margaret Kosmala,et al.  Aggregating User Input in Ecology Citizen Science Projects , 2015, AAAI.

[14]  Oded Nov,et al.  Increasing citizen science contribution using a virtual peer , 2017, J. Assoc. Inf. Sci. Technol..

[15]  C. Lintott,et al.  Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savanna , 2015, Scientific Data.

[16]  Alexandre Pouget,et al.  Improved Probabilistic Inference as a General Learning Mechanism with Action Video Games , 2010, Current Biology.

[17]  Shinnosuke Nakayama,et al.  Social signals as design interventions for enhancing citizen science contributions* , 2018 .

[18]  R. Caplan Person-environment fit theory and organizations: Commensurate dimensions, time perspectives, and mechanisms , 1987 .

[19]  Robert J. Houghton,et al.  Comparing experts and novices in Martian surface feature change detection and identification , 2018, International Journal of Applied Earth Observation and Geoinformation.

[20]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[21]  David P. Anderson,et al.  Scientists@Home: What Drives the Quantity and Quality of Online Citizen Science Participation? , 2014, PloS one.

[22]  R. Kanfer Motivation theory and industrial and organizational psychology. , 1990 .

[23]  Rick Bonney,et al.  4. Growing the Base for Citizen Science: Recruiting and Engaging Participants , 2017 .

[24]  J. Larson,et al.  An Inquiry into the Nature and Causes of the Wealth of Nations , 2015 .

[25]  B. Ridoutt,et al.  Mapping phosphorus hotspots in Sydney’s organic wastes: a spatially explicit inventory to facilitate urban phosphorus recycling , 2018 .

[26]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[27]  Oded Nov,et al.  Activating social strategies: Face-to-face interaction in technology-mediated citizen science. , 2016, Journal of environmental management.

[28]  S. West,et al.  Recruiting and Retaining Participants in Citizen Science: What Can Be Learned from the Volunteering Literature? , 2016 .

[29]  Oded Nov,et al.  Dusting for science: motivation and participation of digital citizen science volunteers , 2011, iConference.

[30]  C S Green,et al.  Action-Video-Game Experience Alters the Spatial Resolution of Vision , 2007, Psychological science.

[31]  Greg L. West,et al.  Visuospatial experience modulates attentional capture: evidence from action video game players. , 2008, Journal of vision.

[32]  Kait Clark,et al.  Enhanced change detection performance reveals improved strategy use in avid action video game players. , 2011, Acta psychologica.

[33]  Kevin Crowston,et al.  Surveying the citizen science landscape , 2014, First Monday.

[34]  M. Haklay Citizen Science and Volunteered Geographic Information: Overview and Typology of Participation , 2013 .

[35]  C. S. Green,et al.  Action video game modifies visual selective attention , 2003, Nature.

[36]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[37]  Ann Blandford,et al.  Designing for dabblers and deterring drop-outs in citizen science , 2014, CHI.

[38]  Sihem Amer-Yahia,et al.  Task assignment optimization in knowledge-intensive crowdsourcing , 2015, The VLDB Journal.

[39]  X. Zuo,et al.  Action Video Game Training for Healthy Adults: A Meta-Analytic Study , 2016, Front. Psychol..

[40]  Victor Anton,et al.  Monitoring the mammalian fauna of urban areas using remote cameras and citizen science , 2020 .

[41]  Sandra Slaughter,et al.  Understanding the Motivations, Participation, and Performance of Open Source Software Developers: A Longitudinal Study of the Apache Projects , 2006, Manag. Sci..

[42]  M. Kendall A NEW MEASURE OF RANK CORRELATION , 1938 .

[43]  Patricia Y. Leonard,et al.  Growing the Base for Citizen Science , 2012 .

[44]  Qinghua Zhu,et al.  Effects of extrinsic and intrinsic motivation on participation in crowdsourcing contest: A perspective of self-determination theory , 2014, Online Inf. Rev..

[45]  Alice N. Outerbridge,et al.  Impact of job experience and ability on job knowledge, work sample performance, and supervisory ratings of job performance , 1986 .