Human biases in government algorithms

Machine learning is used in data-driven decision making and in governmental application of algorithms. Along with its many benefits, literature shows that machine learning solutions can introduce human bias to their results that they from training data. In this paper the authors study sentiment analysis algorithms to see if they show human bias, by interchanging lists of names associated with gender, race and political orientation in a synthetic neutral template sentence and then observing how the resulting sentiment values change. As a result, the authors find that names as subjects and objects in English language texts alone do not introduce human bias to the sentences' sentiment values. The findings also suggest that pseudonymization might be a better solution to the anonymization of social media postings for data protection compliance purposes than research so far suggested, owing to the general lack of sentiment distortion of the method introduced in this paper.

[1]  Ellen B. Mandinach,et al.  A Perfect Time for Data Use: Using Data-Driven Decision Making to Inform Practice , 2012 .

[2]  Eli Pariser,et al.  The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think , 2012 .

[3]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[4]  Noore Alam Siddiquee,et al.  E-government and transformation of service delivery in developing countries , 2016 .

[5]  Euripidis N. Loukis,et al.  Citizen-Sourcing for Public Policy Making: Theoretical Foundations, Methods and Evaluation , 2018 .

[6]  Lansdall-Welfare Thomas,et al.  Change-Point Analysis of the Public Mood in UK Twitter during the Brexit Referendum , 2016 .

[7]  A. Greenwald,et al.  On the malleability of automatic attitudes: combating automatic prejudice with images of admired and disliked individuals. , 2001, Journal of personality and social psychology.

[8]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[9]  Colin Lankshear,et al.  Introduction: digital literacies: concepts, policies and practices , 2008 .

[10]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[11]  Thomas J. Lampoltshammer,et al.  Impact of Anonymization on Sentiment Analysis of Twitter Postings , 2019, Data Science – Analytics and Applications.

[12]  Björn W. Schuller,et al.  New Avenues in Opinion Mining and Sentiment Analysis , 2013, IEEE Intelligent Systems.

[13]  Zahir Irani,et al.  Evaluating the use and impact of Web 2.0 technologies in local government , 2015, Gov. Inf. Q..

[14]  Ronen Feldman,et al.  Techniques and applications for sentiment analysis , 2013, CACM.

[15]  Victor Bekkers,et al.  A metatheory of e-government: Creating some order in a fragmented research field , 2015, Gov. Inf. Q..

[16]  Adam Tauman Kalai,et al.  Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings , 2016, NIPS.

[17]  Marlene Amorim,et al.  Digital Transformation: A Literature Review and Guidelines for Future Research , 2018, WorldCIST.

[18]  Serge Abiteboul,et al.  Data Responsibly: Fairness, Neutrality and Transparency in Data Analysis , 2016, EDBT.

[19]  Yannis Charalabidis,et al.  The World of Open Data: Concepts, Methods, Tools and Experiences , 2018 .

[20]  Peter Parycek,et al.  The Role of Smart Technologies to Support Citizen Engagement and Decision Making: The SmartGov Case , 2018, Int. J. Electron. Gov. Res..

[21]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[22]  Gerald C. Kane,et al.  Is your business ready for a digital future , 2015 .

[23]  Kevin C. Desouza,et al.  Big Data in the Public Sector: Lessons for Practitioners and Scholars , 2017 .

[24]  Ines Mergel,et al.  Technology and Public Management Information Systems : Where we have been and where we are going , 2015 .

[25]  Janne J. Korhonen,et al.  IT Leadership in Transition - The Impact of Digitalization on Finnish Organizations , 2015 .

[26]  Mirko Vintar,et al.  E-government and organisational transformation of government: Black box revisited? , 2014, Gov. Inf. Q..

[27]  Sebastian Neumaier,et al.  Search, Filter, Fork, and Link Open Data: The ADEQUATe platform: data- and community-driven quality improvements , 2018, WWW.

[28]  Arvind Narayanan,et al.  Semantics derived automatically from language corpora contain human-like biases , 2016, Science.

[29]  Jieyu Zhao,et al.  Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints , 2017, EMNLP.

[30]  Maximilian Röglinger,et al.  Digital Transformation : Changes and Chances – Insights based on an Empirical Study , 2015 .

[31]  Uwe Matzat,et al.  An empirical test of stage models of e-government development: Evidence from Dutch municipalities , 2017, Inf. Soc..

[32]  Steven D. Levitt,et al.  Freakonomics: A Rogue Economist Explores The Hidden Side Of Everything PDF , 2015 .

[33]  Swati Agarwal,et al.  Topic-Specific YouTube Crawling to Detect Online Radicalization , 2015, DNIS.

[34]  Joseph Berger,et al.  Gender and Interpersonal Task Behaviors: Status Expectation Accounts , 1997 .

[35]  Yannis Charalabidis,et al.  IoT and AI for Smart Government: A Research Agenda , 2019, Gov. Inf. Q..

[36]  Steven D. Levitt,et al.  The Causes and Consequences of Distinctively Black Names , 2003 .

[37]  Liang Ma,et al.  Does e-government performance actually boost citizen use? Evidence from European countries , 2018 .

[38]  Philip C. Treleaven,et al.  Algorithmic Government: Automating Public Services and Supporting Civil Servants in using Data Science Technologies , 2019, Comput. J..

[39]  Saul J. Berman Digital transformation: opportunities to create new business models , 2012 .

[40]  Barbara Hofer,et al.  Demography of Twitter Users in the City of London: An Exploratory Spatial Data Analysis Approach , 2014, CARTOCON.

[41]  Calvin Zhou-Peng Liao,et al.  Proactive e-Governance: Flipping the service delivery model from pull to push in Taiwan , 2015, Government Information Quarterly.

[42]  C. Pérez Technological Revolutions and Techno-Economic Paradigms , 2010 .

[43]  Ines Mergel,et al.  Defining digital transformation: Results from expert interviews , 2019, Gov. Inf. Q..

[44]  Dustin B. Thoman,et al.  Variations of Gender–math Stereotype Content Affect Women’s Vulnerability to Stereotype Threat , 2008 .

[45]  Antonio Cordella,et al.  E-government and organizational change: Reappraising the role of ICT and bureaucracy in public service delivery , 2015, Gov. Inf. Q..

[46]  Antonio Cordella,et al.  ICTs and value creation in public sector: Manufacturing logic vs service logic , 2018, Inf. Polity.