Social Informatics

This paper examines the workflow and sense-making activities of digital volunteers, showing how they acquire, assess, process and scrutinise crowdsourced information to warrant confidence that the data satisfies the standard of engagement, production and analysis. We do so by studying a digital disaster response organisation Humanity Road through fifteen response oper‐ ations across thirteen countries using digital ethnography over a period of sixteen months. This paper reports on the findings of this study, using a range of sources such as Skype chat logs, field notes, social media postings, and official documents. Our paper introduces a framework that offers a consistent and structured workflow for the communities of practice related to social media and data aggregation communities within the domain of Digital Humanitarian Networks. Our findings suggest practical implications for both the digital humanitarian organisations and government of the disaster-prone countries.

[1]  Загоровская Ольга Владимировна,et al.  Исследование влияния пола и психологических характеристик автора на количественные параметры его текста с использованием программы Linguistic Inquiry and Word Count , 2015 .

[2]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[3]  Florent Perronnin,et al.  Aggregating Continuous Word Embeddings for Information Retrieval , 2013, CVSM@ACL.

[4]  A Sheiham,et al.  Demographic, familial and trait predictors of fruit and vegetable consumption by pre-school children , 2004, Public Health Nutrition.

[5]  R. Larsen,et al.  The Satisfaction with Life Scale , 1985, Journal of personality assessment.

[6]  Elaine O. Nsoesie,et al.  Detection of User Demographics on Social Media: A Review of Methods and Recommendations for Best Practices , 2017, ArXiv.

[7]  D. Jackson,et al.  PERSONALITY MEASURES AS PREDICTORS OF JOB PERFORMANCE: A META‐ANALYTIC REVIEW , 2006 .

[8]  Trisha Greenhalgh,et al.  Telecare Call Centre Work and Ageing in Place , 2016, Computer Supported Cooperative Work (CSCW).

[9]  Seth Neel,et al.  Rawlsian Fairness for Machine Learning , 2016, ArXiv.

[10]  Neil R. Britton,et al.  Permanent Disaster Volunteers: Where Do They Fit? , 1991 .

[11]  Iyad Rahwan,et al.  Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm , 2017, EMNLP.

[12]  Stephanie H. McConaughy,et al.  Social Competence and Behavioral Problems of Learning Disabled Boys Aged 6-11 , 1986, Journal of learning disabilities.

[13]  A. Strauss,et al.  Grounded theory , 2017 .

[14]  Gregory J. Park,et al.  Automatic personality assessment through social media language. , 2015, Journal of personality and social psychology.

[15]  Gerhard Widmer,et al.  Classification of dance music by periodicity patterns , 2003, ISMIR.

[16]  Yann LeCun,et al.  Very Deep Convolutional Networks for Text Classification , 2016, EACL.

[17]  Beverley Raphael,et al.  The role of social media as psychological first aid as a support to community resilience building. , 2012 .

[18]  N. Meinshausen,et al.  LASSO-TYPE RECOVERY OF SPARSE REPRESENTATIONS FOR HIGH-DIMENSIONAL DATA , 2008, 0806.0145.

[19]  L. Huddy,et al.  Group Identity and Political Cohesion , 2015 .

[20]  Lyle H. Ungar,et al.  Beyond Binary Labels: Political Ideology Prediction of Twitter Users , 2017, ACL.

[21]  Johnny Nhan,et al.  Digilantism: An Analysis of Crowdsourcing and the Boston Marathon Bombings , 2015 .

[22]  Krishna P. Gummadi,et al.  Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment , 2016, WWW.

[23]  Maarten Sap,et al.  Developing Age and Gender Predictive Lexica over Social Media , 2014, EMNLP.

[24]  C. B. Colby The weirdest people in the world , 1973 .

[25]  Vincent Egan,et al.  Sensational interests, sustaining fantasies and personality predict physical aggression , 2009 .

[26]  Christopher D. Manning,et al.  Bilingual Word Embeddings for Phrase-Based Machine Translation , 2013, EMNLP.

[27]  Aurelio José Figueredo,et al.  Sensational interests as a form of intrasexual competition , 2004 .

[28]  Jon-Kar Zubieta,et al.  Personality Trait Predictors of Placebo Analgesia and Neurobiological Correlates , 2013, Neuropsychopharmacology.

[29]  P. Costa,et al.  Validation of the five-factor model of personality across instruments and observers. , 1987, Journal of personality and social psychology.

[30]  Dong Nguyen,et al.  Why Gender and Age Prediction from Tweets is Hard: Lessons from a Crowdsourcing Experiment , 2014, COLING.

[31]  Neil R Britton,et al.  Organized Behavior in Disaster: A Review Essay , 1988, International Journal of Mass Emergencies & Disasters.

[32]  Hyun-Woo Kim,et al.  Run amok: Group crowd participation in identifying the bomb and bomber from the Boston marathon bombing , 2014, ISCRAM.

[33]  Robert Plomin,et al.  Erratum: Genome-wide association meta-analysis of 78,308 individuals identifies new loci and genes influencing human intelligence , 2017, Nature Genetics.

[34]  Jon M. Kleinberg,et al.  Inherent Trade-Offs in the Fair Determination of Risk Scores , 2016, ITCS.

[35]  Margaret L. Kern,et al.  Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach , 2013, PloS one.

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Leonard Reinecke,et al.  The social side of gaming: How playing online computer games creates online and offline social support , 2012, Comput. Hum. Behav..

[38]  Roberto J. González Hacking the citizenry?: Personality profiling, ‘big data’ and the election of Donald Trump , 2017 .

[39]  Rena Bivens,et al.  The gender binary will not be deprogrammed: Ten years of coding gender on Facebook , 2017, New Media Soc..

[40]  Tanis Bryan,et al.  “Come on, Dummy” , 1976 .

[41]  Derrick L. Cogburn,et al.  From Networked Nominee to Networked Nation: Examining the Impact of Web 2.0 and Social Media on Political Participation and Civic Engagement in the 2008 Obama Campaign , 2011 .

[42]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[43]  Amanda Lee Hughes,et al.  Social Media in Crisis: When Professional Responders Meet Digital Volunteers , 2015 .

[44]  Lee Sigelman,et al.  The Effects of Negative Political Campaigns: A Meta-Analytic Reassessment , 2007, The Journal of Politics.

[45]  Jure Leskovec,et al.  Antisocial Behavior in Online Discussion Communities , 2015, ICWSM.

[46]  Matt J. Kusner,et al.  Counterfactual Fairness , 2017, NIPS.

[47]  Marie-Francine Moens,et al.  Computational personality recognition in social media , 2016, User Modeling and User-Adapted Interaction.

[48]  Krishna P. Gummadi,et al.  The Case for Process Fairness in Learning: Feature Selection for Fair Decision Making , 2016 .

[49]  Cecilia Mascolo,et al.  A Tale of Many Cities: Universal Patterns in Human Urban Mobility , 2011, PloS one.

[50]  Gene H. Golub,et al.  Singular value decomposition and least squares solutions , 1970, Milestones in Matrix Computation.

[51]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[52]  Philip Resnik,et al.  Political Ideology Detection Using Recursive Neural Networks , 2014, ACL.

[53]  T. Graepel,et al.  Private traits and attributes are predictable from digital records of human behavior , 2013, Proceedings of the National Academy of Sciences.

[54]  Adam Tauman Kalai,et al.  Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings , 2016, NIPS.

[55]  Shahla Ahmadi,et al.  Sensational interests and general personality traits , 1999 .

[56]  K. Fitzpatrick,et al.  Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial , 2017, JMIR mental health.

[57]  Tsunenori Mine,et al.  Predicting Student Grade based on Free-style Comments using Word2Vec and ANN by Considering Prediction Results Obtained in Consecutive Lessons , 2015, EDM.

[58]  Martin Sellbom,et al.  Personality trait predictors of bipolar disorder symptoms , 2009, Psychiatry Research.

[59]  Alexander J. Smola,et al.  Like like alike: joint friendship and interest propagation in social networks , 2011, WWW.

[60]  J. M. Digman PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL , 1990 .

[61]  Patrick Meier,et al.  New information technologies and their impact on the humanitarian sector , 2011, International Review of the Red Cross.

[62]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[63]  K. Bierman,et al.  Disentangling the Impact of Low Cognitive Ability and Inattention on Social Behavior and Peer Relationships , 2000, Journal of clinical child psychology.

[64]  Tung X. Bui,et al.  Design considerations for a virtual information center for humanitarian assistance/disaster relief using workflow modeling , 2001, Decis. Support Syst..

[65]  J. Flynn Massive IQ gains in 14 nations: What IQ tests really measure. , 1987 .

[66]  Thomas Ludwig,et al.  Emergency services' attitudes towards social media: A quantitative and qualitative survey across Europe , 2016, Int. J. Hum. Comput. Stud..

[67]  Thomas J. Weinandy Volunteer and Technical Communities in Humanitarian Response: Lessons in Digital Humanitarianism from Typhoon Haiyan , 2016 .

[68]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[69]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[70]  C. Sell,et al.  Using a Workflow Management System to Manage Emergency Plans , 2009 .

[71]  E. Quarantelli,et al.  Response to Social Crisis and Disaster , 1977 .

[72]  Aki Vehtari,et al.  Efficient implementation of leave-one-out cross-validation and WAIC for evaluating fitted Bayesian models , 2015 .

[73]  G. Kreps Sociological Inquiry and Disaster Research , 1984 .

[74]  N. Dufty Using social media to build community disaster resilience , 2012 .

[75]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[76]  Babak A. Farshchian,et al.  From Episodes to Continuity of Care: a Study of a Call Center for Supporting Independent Living , 2017, Computer Supported Cooperative Work (CSCW).

[77]  Jieyu Zhao,et al.  Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints , 2017, EMNLP.

[78]  S. Gosling,et al.  Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. , 2015, The American psychologist.

[79]  Jon M. Kleinberg,et al.  An Impossibility Theorem for Clustering , 2002, NIPS.

[80]  Kathleen Dolan,et al.  The Impact of Gender Stereotyped Evaluations on Support for Women Candidates , 2010 .

[81]  David Stillwell,et al.  Are social networking profiles reliable indicators of sensational interests , 2011 .

[82]  Tung X. Bui,et al.  Emergent Groups for Emergency Response - Theoretical Foundations and Information Design Implications , 2009, AMCIS.

[83]  John Rust,et al.  Can Well-Being be Measured Using Facebook Status Updates? Validation of Facebook’s Gross National Happiness Index , 2014 .

[84]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[85]  Monica C. Schneider,et al.  Measuring Stereotypes of Female Politicians , 2014 .

[86]  A. Lo,et al.  Consumer Credit Risk Models Via Machine-Learning Algorithms , 2010 .

[87]  J. Gottlieb,et al.  Sociometric Status and Solitary Play of LD Boys and Girls , 1986, Journal of learning disabilities.

[88]  Tao Jiang,et al.  Algorithmic Approaches to Clustering Gene Expression Data , 2002 .

[89]  M. Kosinski,et al.  Computer-based personality judgments are more accurate than those made by humans , 2015, Proceedings of the National Academy of Sciences.

[90]  Daniel L. Wann,et al.  Collective self‐esteem consequences of outgroup derogation when a valued social identity is on trial , 1994 .