AI should embody our values: Investigating journalistic values to inform AI technology design

In the current climate of shrinking newsrooms and revenues, journalists face increasing pressures exerted by the industry’s for-profit focus and the expectation of intensified output. While AI-enabled journalism has great potential to help alleviate journalists’ pressures, it might also disrupt journalistic norms and, at worst, interfere with their duty to inform the public. For AI systems to be as useful as possible, designers should understand journalists’ professional values and incorporate them into their designs. We report findings from interviews with journalists to understand their perceptions of how professional values that are important to them (such as truth, impartiality and originality) might be supported and/or undermined by AI technologies. Based on these findings, we provide design insight and guidelines for incorporating values into the design of AI systems. We argue HCI design can achieve the strongest possible value alignment by moving beyond merely supporting important values, to truly embodying them.

[1]  Jeffrey Holbrook,et al.  Early engagement and new technologies: opening up the laboratory , 2014 .

[2]  Morten Skovsgaard,et al.  A tabloid mind? Professional values and organizational pressures as explanations of tabloid journalism , 2014 .

[3]  John Mcmanus Market-Driven Journalism: Let the Citizen Beware? , 1994 .

[4]  Neil A. M. Maiden,et al.  Making the News: Digital Creativity Support for Journalists , 2018, CHI.

[5]  Deborah E. White,et al.  Thematic Analysis , 2017 .

[6]  Predrag V. Klasnja,et al.  Envisioning systemic effects on persons and society throughout interactive system design , 2008, DIS '08.

[7]  Darren Edge,et al.  News Provenance: Revealing News Text Reuse at Web-Scale in an Augmented News Search Experience , 2020, CHI Extended Abstracts.

[8]  Neil A. M. Maiden,et al.  Evaluating the Use of Digital Creativity Support by Journalists in Newsrooms , 2019, Creativity & Cognition.

[9]  Meredith Broussard,et al.  Artificial Intelligence for Investigative Reporting , 2015 .

[10]  Ivor Shapiro,et al.  Images of Essence : Journalists ’ Discourse on the Professional “ Discipline of Verification ” , 2016 .

[11]  Neil Thurman,et al.  When Reporters Get Hands-on with Robo-Writing , 2017 .

[12]  Tomas Heiskanen,et al.  Predicting the success of news: Using an ML-based language model in predicting the performance of news articles before publishing , 2020, Mindtrek.

[13]  Carrie J. Cai,et al.  The effects of example-based explanations in a machine learning interface , 2019, IUI.

[14]  Henrique Lopes Cardoso,et al.  On document representations for detection of biased news articles , 2020, SAC.

[15]  Randal A. Beam,et al.  The American Journalist in the 21st Century : U.S. News People at the Dawn of a New Millennium , 2009 .

[16]  R. Nielsen The Many Crises of Western Journalism: A Comparative Analysis of Economic Crises, Professional Crises, and Crises of Confidence , 2014 .

[17]  R. McChesney Digital Disconnect: How Capitalism is Turning the Internet Against Democracy , 2013 .

[18]  Benno Stein,et al.  A Stylometric Inquiry into Hyperpartisan and Fake News , 2017, ACL.

[19]  Aljosha Karim Schapals Social media at BBC News: the re-making of crisis reporting , 2016 .

[20]  Peter Worthy,et al.  Exploring journalistic values through design: a student perspective , 2017, OZCHI.

[21]  Konstantin Dörr,et al.  Ethical Challenges of Algorithmic Journalism , 2017 .

[22]  Tamara Witschge,et al.  Journalism : A profession under pressure? , 2009 .

[23]  Mark O. Riedl,et al.  Using Stories to Teach Human Values to Artificial Agents , 2016, AAAI Workshop: AI, Ethics, and Society.

[24]  J Brennen,et al.  An industry-led debate: how UK media cover artificial intelligence , 2018 .

[25]  Iason Gabriel,et al.  Artificial Intelligence, Values, and Alignment , 2020, Minds and Machines.

[26]  Stephen D. Reese,et al.  Mediating the Message: Theories of Influences on Mass Media Content , 1995 .

[27]  F. McMahon Online News: Journalism and the Internet , 2007 .

[28]  Virginia Dignum,et al.  Responsible Artificial Intelligence: Designing Ai for Human Values , 2017 .

[29]  Mike Ananny,et al.  Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability , 2018, New Media Soc..

[30]  N Newman,et al.  Journalism, Media, and Technology Trends and Predictions 2017 , 2017 .

[31]  R. Sambrook Delivering trust: impartiality and objectivity in the digital age , 2012 .

[32]  M. Carlson,et al.  The Robotic Reporter , 2015 .

[33]  J. Singer Strange bedfellows? The diffusion of convergence in four news organizations , 2004 .

[34]  Mohan S. Kankanhalli,et al.  Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda , 2018, CHI.

[35]  Jonathan Stray,et al.  Making Artificial Intelligence Work for Investigative Journalism , 2019, Algorithms, Automation, and News.

[36]  David A. L. Levy THE REUTERS INSTITUTE FOR THE STUDY OF JOURNALISM , 2011 .

[37]  Jessica K. Miller,et al.  Value tensions in design: the value sensitive design, development, and appropriation of a corporation's groupware system , 2007, GROUP.

[38]  Virginia Braun,et al.  Successful Qualitative Research: A practical guide for beginners , 2013, QMiP Bulletin.

[39]  Peter G. Mwesige,et al.  A comparative study of 18 countries , 2011 .

[40]  Oren Etzioni,et al.  Viewpoint designing ai systems that obey our laws and values calling for research on automatic oversight for artificial intelligence systems. , 2016 .

[41]  Susan Wyche,et al.  Values as lived experience: evolving value sensitive design in support of value discovery , 2009, CHI.

[42]  Andreas Hotho,et al.  Media Bias in German Online Newspapers , 2015, HT.

[43]  Tamara Munzner,et al.  Overview: The Design, Adoption, and Analysis of a Visual Document Mining Tool for Investigative Journalists , 2014, IEEE Transactions on Visualization and Computer Graphics.

[44]  George Sylvie The Elements of Journalism: What Newspeople Should Know and the Public Should Expect , 2001 .

[45]  Konstantin Dörr,et al.  Mapping the field of Algorithmic Journalism , 2016 .

[46]  Michael Schudson,et al.  The Business of Media: Corporate Media and the Public Interest , 2002, Inf. Soc..

[47]  Janet Davis,et al.  Envisioning persuasion profiles: challenges for public policy and ethical practice , 2011, INTR.

[48]  Hannu Toivonen,et al.  Finding and expressing news from structured data , 2017, MindTrek.

[49]  P. Mancini,et al.  Comparing Media Systems: Conclusion , 2004 .

[50]  Alan Borning,et al.  Value Sensitive Design and Information Systems , 2020, The Ethics of Information Technologies.

[51]  Neil Thurman,et al.  Journalists in the UK , 2016 .

[52]  Nicholas Diakopoulos,et al.  Automating the News , 2019 .

[53]  Nicholas Diakopoulos,et al.  Algorithmic Transparency in the News Media , 2017 .

[54]  David G. Hendry,et al.  Value Sensitive Design , 2019 .

[55]  Batya Friedman,et al.  The envisioning cards: a toolkit for catalyzing humanistic and technical imaginations , 2012, CHI.

[56]  Bongwon Suh,et al.  Understanding User Perception of Automated News Generation System , 2020, CHI.