Bias in algorithmic filtering and personalization

Online information intermediaries such as Facebook and Google are slowly replacing traditional media channels thereby partly becoming the gatekeepers of our society. To deal with the growing amount of information on the social web and the burden it brings on the average user, these gatekeepers recently started to introduce personalization features, algorithms that filter information per individual. In this paper we show that these online services that filter information are not merely algorithms. Humans not only affect the design of the algorithms, but they also can manually influence the filtering process even when the algorithm is operational. We further analyze filtering processes in detail, show how personalization connects to other filtering techniques, and show that both human and technical biases are present in today’s emergent gatekeepers. We use the existing literature on gatekeeping and search engine bias and provide a model of algorithmic gatekeeping.

[1]  P. Slater,et al.  Role differentiation in small groups. , 1955 .

[2]  P. Lazarsfeld,et al.  Personal Influence: The Part Played by People in the Flow of Mass Communications , 1956 .

[3]  S. Chibnall The Crime Reporter: A Study in the Production of Commercial Knowledge , 1975 .

[4]  H. Gans Deciding What's News: A Study of CBS Evening News, NBC Nightly News, Newsweek and Time , 1979 .

[5]  M. Fishman Manufacturing the news , 1980 .

[6]  Ching-chih Chen,et al.  Information seeking : assessing and anticipating user needs , 1982 .

[7]  Mark S. Granovetter T H E S T R E N G T H O F WEAK TIES: A NETWORK THEORY REVISITED , 1983 .

[8]  J. Durrance Armed for Action Library Response to Citizen Information Needs , 1984 .

[9]  Elfreda A. Chatman,et al.  Opinion Leadership, Poverty, and Information Sharing. , 1987 .

[10]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[11]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[12]  Helen Nissenbaum,et al.  Bias in computer systems , 1996, TOIS.

[13]  Helen Nissenbaum,et al.  Software agents and user autonomy , 1997, AGENTS '97.

[14]  Philip M. Napoli Deconstructing the diversity principle , 1999 .

[15]  Jan van Cuilenburg On Competition, Access and Diversity in Media, Old and New: Some Remarks for Communications Policy in the Information Age , 1999, New Media Soc..

[16]  John Agada,et al.  Inner-City Gatekeepers: An Exploratory Survey of Their Information Use Environment , 1999, J. Am. Soc. Inf. Sci..

[17]  Matthew Priestley Honest News in the Slashdot Decade , 1999, First Monday.

[18]  Helen Nissenbaum,et al.  Shaping the Web: Why the Politics of Search Engines Matters , 2000, Inf. Soc..

[19]  J. D. McCarthy,et al.  From Protest to Agenda Building: Description Bias in Media Coverage of Protest Events in Washington, D.C. , 2001 .

[20]  C. Sunstein Republic.com , 2001 .

[21]  Paul Sturges Gatekeepers and other intermediaries , 2001, Aslib Proc..

[22]  Abbe Mowshowitz,et al.  Bias on the web , 2002, CACM.

[23]  Lawrence Soley Censorship, Inc.: The Corporate Threat to Free Speech in the United States , 2002 .

[24]  SCOTT L. ALTHAUS,et al.  Agenda Setting and the “New” News , 2002, Commun. Res..

[25]  David Tewksbury What Do Americans Really Want to Know? Tracking the Behavior of News Readers on the Internet , 2003 .

[26]  Mike Thelwall,et al.  Search engine coverage bias: evidence and possible causes , 2004, Inf. Process. Manag..

[27]  Owen Williams,et al.  Search Engine Watch , 2005 .

[28]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[29]  Lee Wilkins Deciding What's News: A Study of CBS Evening News, NBC Nightly News, Newsweek, and Time , 2005 .

[30]  Eric Goldman,et al.  Search Engine Bias and the Demise of Search Engine Utopianism , 2006 .

[31]  C. Sunstein Preferences, Paternalism, and Liberty , 2006, Royal Institute of Philosophy Supplement.

[32]  C. Sunstein Infotopia: How Many Minds Produce Knowledge , 2006 .

[33]  P. Kleingeld,et al.  The Stanford Encyclopedia of Philosophy , 2013 .

[34]  Alessandro Micarelli,et al.  User Profiles for Personalized Information Access , 2007, The Adaptive Web.

[35]  Alfred Kobsa,et al.  The Adaptive Web, Methods and Strategies of Web Personalization , 2007, The Adaptive Web.

[36]  Yang Lu,et al.  The human in human information acquisition: Understanding gatekeeping and proposing new directions in scholarship , 2007 .

[37]  Barry Smyth,et al.  A Community-Based Approach to Personalizing Web Search , 2007, Computer.

[38]  Jock Given,et al.  The wealth of networks: How social production transforms markets and freedom , 2007, Inf. Econ. Policy.

[39]  Filip Radlinski,et al.  Search Engines that Learn from Implicit Feedback , 2007, Computer.

[40]  Elizabeth Van Couvering,et al.  Is Relevance Relevant? Market, Science, and War: Discourses of Search Engine Quality , 2007, J. Comput. Mediat. Commun..

[41]  A. Diaz,et al.  Through the Google Goggles: Sociopolitical Bias in Search Engine Design , 2008 .

[42]  Serge Gutwirth,et al.  Profiling the European Citizen, Cross-Disciplinary Perspectives , 2008 .

[43]  M. Boler Digital Media and Democracy: Tactics in Hard Times , 2008 .

[44]  Stephen D. Reese,et al.  Journalists as Gatekeepers , 2008, The Handbook of Journalism Studies.

[45]  Axel Bruns Gatewatching, Gatecrashing: Futures for Tactical News Media , 2008 .

[46]  Jeroen van den Hoven,et al.  Information Technology and Moral Philosophy , 2008 .

[47]  Mi Zhang,et al.  Avoiding monotony: improving the diversity of recommendation lists , 2008, RecSys '08.

[48]  Corien Prins,et al.  Personalisation and its Influence on Identities, Behaviour and Social Values , 2008, Profiling the European Citizen.

[49]  M. Flanagan,et al.  Embodying values in technology: Theory and practice , 2008 .

[50]  Jeroen Van Den Hoven,et al.  Distributive justice and the value of information: A (broadly) Rawlsian approach , 2008 .

[51]  K. Barzilai-Nahon Toward a theory of network gatekeeping , 2008 .

[52]  Karine Nahon,et al.  Toward a theory of network gatekeeping: A framework for exploring information control , 2008, J. Assoc. Inf. Sci. Technol..

[53]  Karin Wahl-Jorgensen,et al.  The Handbook of Journalism Studies , 2008 .

[54]  Mark Levene,et al.  Presentation bias is significant in determining user preference for search results - A user study , 2009, J. Assoc. Inf. Sci. Technol..

[55]  Chris Clifton,et al.  Information Seeking , 2009, Encyclopedia of Database Systems.

[56]  Cong Yu,et al.  It takes variety to make a world: diversification in recommender systems , 2009, EDBT '09.

[57]  J. Christman,et al.  Autonomy in Moral and Political Philosophy , 2009 .

[58]  Karine Nahon,et al.  Gatekeeping: A critical review , 2009, Annu. Rev. Inf. Sci. Technol..

[59]  Laura A. Granka The Politics of Search: A Decade Retrospective , 2010, Inf. Soc..

[60]  Sean A. Munson,et al.  Presenting diverse political opinions: how and how much , 2010, CHI.

[61]  Joachim Meyer,et al.  User attitudes towards news content personalization , 2010, Int. J. Hum. Comput. Stud..

[62]  Fenwick McKelvey,et al.  Digital Media and Democracy: Tactics in Hard Times , 2010 .

[63]  Martin J. Eppler,et al.  The Concept of Information Overload: A Review of Literature from Organization Science, Accounting, Marketing, MIS, and Related Disciplines , 2004, The Information Society.

[64]  Yisong Yue,et al.  Beyond position bias: examining result attractiveness as a source of presentation bias in clickthrough data , 2010, WWW '10.

[65]  Saikat Guha,et al.  Challenges in measuring online advertising systems , 2010, IMC '10.

[66]  Aditya G. Parameswaran,et al.  Information seeking , 2011, Commun. ACM.

[67]  Aleksandra Korolova Privacy Violations Using Microtargeted Ads: A Case Study , 2011, J. Priv. Confidentiality.

[68]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[69]  Joshua D. Wright Defining and Measuring Search Bias: Some Preliminary Evidence , 2011 .

[70]  Eli Pariser,et al.  The Filter Bubble: What the Internet Is Hiding from You , 2011 .

[71]  Axel Bruns,et al.  Gatekeeping, gatewatching, real-time feedback: new challenges for Journalism , 2011 .

[72]  A. Hermida Journalism as a discipline of collaborative verification , 2012 .

[73]  Eli Pariser The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think , 2012 .

[74]  Tarleton Gillespie,et al.  Can an Algorithm be Wrong , 2012 .

[75]  M. Hilbert,et al.  Toward a synthesis of cognitive biases: how noisy information processing can bias human decision making. , 2012, Psychological bulletin.

[76]  Lada A. Adamic,et al.  The role of social networks in information diffusion , 2012, WWW.

[77]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[78]  Marc A Nivet,et al.  Diversity by design. , 2013, Journal of graduate medical education.

[79]  Alan Borning,et al.  Value Sensitive Design and Information Systems , 2020, The Ethics of Information Technologies.

[80]  Boon Chong Lim,et al.  Word-of-mouth: The use of source expertise in the evaluation of familiar and unfamiliar brands , 2014 .