Opening the government’s black boxes: freedom of information and algorithmic accountability

ABSTRACT Freedom of information laws are intended to illuminate how governments operate. However, the operations of governments increasingly involve algorithms, such as those used to recommend criminal sentencing and determine eligibility for social services. Algorithms function as ‘black boxes’ that turn inputs into outputs using processes that are often, by design, not transparent. Freedom of information laws allow one potential means for algorithmic transparency. However, whether such laws can be used to access algorithms is unclear. This research examines, in two ways, the availability of government algorithms to the public. First, this study examines laws, regulations, advisory opinions, and court rulings relevant to the disclosure of algorithms. The second part of this study analyzes actual responses by US government agencies to Freedom of Information Act requests for algorithms. This study concludes that governmental policies and practices related to algorithmic disclosure are inconsistent. Such inconsistencies suggest a need for better mechanisms to hold government algorithms accountable.

[1]  Kyle Eischen,et al.  Opening the ‘Black Box’ of Software The micro-foundations of informational technologies, practices and environments , 2003 .

[2]  Yannis Charalabidis,et al.  Benefits, Adoption Barriers and Myths of Open Data and Open Government , 2012, Inf. Syst. Manag..

[3]  Helmut Krcmar,et al.  An International Survey of the Factors Influencing the Intention to Use Open Government , 2015, 2015 48th Hawaii International Conference on System Sciences.

[4]  M. Strathern The Tyranny of Transparency , 2000 .

[5]  Young Hoon Kwak,et al.  An Open Government Maturity Model for social media-based public engagement , 2012, Gov. Inf. Q..

[6]  Peter P. Swire A Theory of Disclosure for Security and Competitive Reasons: Open Source, Proprietary Software, and Government Agencies , 2006 .

[7]  Thomas C. Reed At the Abyss: An Insider's History of the Cold War , 2004 .

[8]  V. Smith Guide to the Freedom of Information Act , 2011 .

[9]  Helen Nissenbaum,et al.  Bias in computer systems , 1996, TOIS.

[10]  A Theory of Disclosure for Security and Competitive Reasons : Open Source , Proprietary Software , and Government Systems , 2011 .

[11]  Charles N. Davis,et al.  Bringing Back Full Disclosure: A Call for Dismantling FOIA , 2016, The U.S. Freedom of Information Act at 50.

[12]  Michele Willson,et al.  Algorithms (and the) everyday , 2017, The Social Power of Algorithms.

[13]  Tal Z. Zarsky,et al.  The Trouble with Algorithmic Decisions , 2016 .

[14]  R. Stuart Geiger,et al.  Bots, bespoke, code and the materiality of software platforms , 2014 .

[15]  Shamkant B. Navathe,et al.  Large-scale insider trading analysis: patterns and discoveries , 2014, Social Network Analysis and Mining.

[16]  Charles D. Raab Privacy, Democracy, Information , 1997 .

[17]  Frank A. Pasquale The Black Box Society: The Secret Algorithms That Control Money and Information , 2015 .

[18]  Gary E. Weir,et al.  The Department of Energy , 1989 .

[19]  Jean-François Blanchette,et al.  A material history of bits , 2011, J. Assoc. Inf. Sci. Technol..

[20]  Marijn Janssen,et al.  The negative effects of open government data - investigating the dark side of open data , 2014, DG.O.

[21]  Michael Schudson The Rise of the Right to Know: Politics and the Culture of Transparency, 1945-1975 , 2015 .

[22]  Frank A. Pasquale,et al.  [89WashLRev0001] The Scored Society: Due Process for Automated Predictions , 2014 .

[23]  Mike Ananny,et al.  Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability , 2018, New Media Soc..

[24]  Harlan Yu,et al.  The New Ambiguity of 'Open Government' , 2012 .

[25]  Michael Luca,et al.  Crowdsourcing City Government: Using Tournaments to Improve Inspection Accuracy , 2016 .

[26]  Julie E. Cohen Privacy, Visibility, Transparency, and Exposure , 2007 .

[27]  Frank W. McCulloch,et al.  The National Labor Relations Board , 1974 .

[28]  Gregory A. Porumbescu,et al.  Linking Objective-Oriented Transparency to Political Leadership and Strategic Planning , 2016 .

[29]  David Landsbergen,et al.  Screen level bureaucracy: Databases as public records , 2004, Gov. Inf. Q..

[30]  B. Wirtz,et al.  Open Government: Origin, Development, and Conceptual Perspectives , 2015 .

[31]  H. Nissenbaum Accountability in a computerized society , 1997 .

[32]  Frank A. Pasquale Beyond Innovation and Competition: The Need for Qualified Transparency in Internet Intermediaries , 2010 .

[33]  Marijn Janssen,et al.  The challenges and limits of big data algorithms in technocratic governance , 2016, Gov. Inf. Q..

[34]  Maria Cucciniello,et al.  Transparency for Trust in Government: How Effective is Formal Transparency? , 2014 .

[35]  Craig D. Feiser Privatization and the Freedom of Information Act: An Analysis of Public Access to Private Entities Under Federal Law , 1999 .

[36]  Fred H. Cate,et al.  The Right to Privacy and the Public's Right to Know: The "Central Purpose" of the Freedom of Information Act , 1994 .

[37]  David S. Levine Secrecy and Unaccountability: Trade Secrets in Our Public Infrastructure , 2006 .

[38]  N. Diakopoulos Algorithmic Accountability Reporting: On the Investigation of Black Boxes , 2014 .

[39]  Mark Fenster,et al.  The Transparency Fix: Advocating Legal Rights and Their Alternatives in the Pursuit of a Visible State , 2012 .

[40]  J. Stoker,et al.  The Department of Health and Human Services. , 1999, Home healthcare nurse.

[41]  H. F. Stone THE UNIVERSITY OF CHICAGO LAW REVIEW , 2015 .

[42]  Tim Davies,et al.  Researching the emerging impacts of open data - ODDC conceptual framework , 2013 .

[43]  Jennifer Shkabatur Transparency With(out) Accountability: Open Government in the United States , 2012 .

[44]  H. Sullivan Privatization of Public Services: A Growing Threat to Constitutional Rights , 1987 .

[45]  Jeannine E. Relly Freedom of Information Laws and Global Diffusion , 2012 .