Living with Monsters? Social Implications of Algorithmic Phenomena, Hybrid Agency, and the Performativity of Technology

This text is based on an invited address presented at IFIP 8.2 ‘Living with Monsters’ in San Francisco, CA, 11 December 2018. Taking the 200 anniversary of Mary Wollstonecraft Shelley’s Frankenstein as a starting place, I explore questions of autonomy and control with respect to human/technology relations. I consider the ambivalence of these agencies, and recent initiatives in science and technology studies and related fields to reconceptualize the problem as matters of relation and care. While embracing this turn, I reflect as well upon the ambivalences of relation and care, and the need to address the resilient politics of alterity in our figurations (and celebrations) of the monstrous.

[1]  Matthew Jones,et al.  A Matter of Life and Death: Exploring Conceptualizations of Sociomateriality in the Context of Critical Care , 2014, MIS Q..

[2]  Lucy A. Suchman,et al.  Located Accountabilities in Technology Production , 2002, Scand. J. Inf. Syst..

[3]  Christian Sandvig,et al.  Infrastructure studies meet platform studies in the age of Google and Facebook , 2018, New Media Soc..

[4]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[5]  B. Kaiser,et al.  Diffraction: Onto-Epistemology, Quantum Physics and the Critical Humanities , 2014 .

[6]  R. Silvey.  Power, difference and mobility: feminist advances in migration studies , 2004 .

[7]  Paul D. Pickell,et al.  Cruel optimism , 2013 .

[8]  Göran Goldkuhl,et al.  Pragmatism vs interpretivism in qualitative information systems research , 2012, Eur. J. Inf. Syst..

[9]  Su-lin Yu.  Third-Wave Feminism , 2009 .

[10]  Jenny de Fine Licht.  Do We Really Want to Know? The Potentially Negative Effect of Transparency in Decision Making on Perceived Legitimacy , 2011 .

[11]  Aud Sissel Hoel,et al.  The Ontological Force of Technicity: Reading Cassirer and Simondon Diffractively , 2013 .

[12]  Izak Benbasat,et al.  The Use of Information in Decision Making: An Experimental Investigation of the Impact of Computer-Based Decision Aids , 1992, MIS Q..

[13]  Karen Barad,et al.  Erasers and erasures: Pinch’s unfortunate ‘uncertainty principle’ , 2011 .

[14]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[15]  A. Mol.  The Body Multiple: Ontology in Medical Practice , 2003 .

[16]  Ted Striphas.  Algorithmic culture , 2015 .

[17]  C. Eschle.  Global Democracy, Social Movements, And Feminism , 2001 .

[18]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[19]  Dubravka Cecez-Kecmanovic,et al.  From Substantialist to Process Metaphysics - Exploring Shifts in IS Research , 2016, IS&O.

[20]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[21]  Anna Palmer,et al.  A more ‘livable’ school? A diffractive analysis of the performative enactments of girls' ill-/well-being with(in) school environments , 2013 .

[22]  I. Tuin.  “A Different Starting Point, a Different Metaphysics”: Reading Bergson and Barad Diffractively , 2011 .

[23]  Minna Ruckenstein,et al.  Visualized and Interacted Life: Personal Analytics and Engagements with Data Doubles , 2014 .

[24]  D. Kahneman.  Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[25]  A. Galloway.  The cybernetic hypothesis , 2014 .

[26]  R. Kitchin,et al.  Thinking critically about and researching algorithms , 2014, The Social Power of Algorithms.

[27]  Nirmala Erevelles.  Disability and Difference in Global Contexts: Enabling a Transformative Body Politic , 2011 .

[28]  J. Butler,et al.  Feminists Theorize the Political , 1992 .

[29]  Jenna Burrell,et al.  How the machine ‘thinks’: Understanding opacity in machine learning algorithms , 2016 .

[30]  Berkeley J. Dietvorst,et al.  Algorithm Aversion: People Erroneously Avoid Algorithms after Seeing Them Err , 2014, Journal of experimental psychology. General.

[31]  Elias L. Khalil,et al.  Donald MacKenzie ’ s An engine , not a camera : how financial models shape markets , 2009 .

[32]  L. Umansky.  The Data-Driven Life , 2012 .

[33]  Sinan Aral,et al.  The spread of true and false news online , 2018, Science.

[34]  Nick Seaver,et al.  What Should an Anthropology of Algorithms Do? , 2018, Cultural Anthropology.

[35]  Mike Ananny,et al.  Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability , 2018, New Media Soc..

[36]  Howard E. Aldrich,et al.  Fools Rush in? The Institutional Context of Industry Creation , 1994 .

[37]  Jan Pries-Heje,et al.  Discovering the significance of Scientific Design Practice: New-Science Wrapped in Old-Science? , 2016, ECIS.

[38]  A. Mol,et al.  Regions, Networks and Fluids: Anaemia and Social Topology , 1994, Social studies of science.

[39]  Karen Barad,et al.  Quantum Entanglements and Hauntological Relations of Inheritance: Dis/continuities, SpaceTime Enfoldings, and Justice-to-Come , 2010 .

[40]  Sue Newell,et al.  The Sociomaterialty of Information Systems: Current Status, Future Directions , 2014, MIS Q..

[41]  S. Rijcke,et al.  Quantifying ‘Output’ for Evaluation: Administrative Knowledge Politics and Changing Epistemic Cultures in Dutch Law Faculties , 2016 .

[42]  Tony Doyle,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Inf. Soc..

[43]  Alison Moore,et al.  Making waves. , 2017, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[44]  Leslie Heywood,et al.  Third Wave Agenda: Being Feminist, Doing Feminism , 1997 .

[45]  Robert Chia,et al.  Reflections: In Praise of Silent Transformation – Allowing Change Through ‘Letting Happen’ , 2014 .

[46]  M. Guggenheim,et al.  Practising Comparison: Logics, Relations, Collaborations , 2016 .

[47]  B. Davies,et al.  The Ambivalent Practices of Reflexivity , 2004 .

[48]  Anna Palmer.  "How many sums can I do"? Performative strategies and diffractive thinking as methodological tools for rethinking mathematical subjectivity , 2011 .

[49]  S. Elwood.  Volunteered geographic information: future research directions motivated by critical, participatory, and feminist GIS , 2008 .

[50]  Robert Chia,et al.  The Problem of Reflexivity in Organizational Research: Towards a Postmodern Science of Organization , 1996 .

[51]  Wanda J. Orlikowski,et al.  Entanglements in Practice: Performing Anonymity Through Social Media , 2014, MIS Q..

[52]  S. Davies,et al.  Crafting the group: Care in research management , 2015, Social studies of science.

[53]  Timothy J. Dowd,et al.  Legitimacy as a Social Process , 2006 .

[54]  B. Truffer,et al.  The thorny road to technology legitimation — Institutional work for potable water reuse in California , 2016 .

[55]  Mikkel Flyverbom,et al.  Organizational Transparency: Conceptualizations, Conditions, and Consequences , 2019 .

[56]  Lars Thøger Christensen,et al.  Peering into Transparency: Challenging Ideals, Proxies, and Organizational Practices , 2015 .

[57]  Lucy Suchman,et al.  Wearable augmentations:Imaginaries of the informed body , 2010 .

[58]  Karen Barad.  Transmaterialities: Trans*/Matter/Realities and Queer Political Imaginings , 2015 .

[59]  Seth Flaxman,et al.  European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation" , 2016, AI Mag..

[60]  Rudy Hirschheim,et al.  Crisis in the IS Field? A Critical Reflection on the State of the Discipline , 2003, J. Assoc. Inf. Syst..

[61]  Geoff Walsham,et al.  Toward Ethical Information Systems: The Contribution of Discourse Ethics , 2010, MIS Q..

[62]  Beatrice Allegranti.  The politics of becoming bodies: Sex, gender and intersubjectivity in motion , 2013 .

[63]  Stephen A. Stumpf.  Applying new science theories in leadership development activities , 1995 .

[64]  Frank A. Pasquale.  The Black Box Society: The Secret Algorithms That Control Money and Information , 2015 .

[65]  Joep Cornelissen,et al.  Organizational transparency as myth and metaphor , 2015 .

[66]  Donna Haraway,et al.  THE PROMISES OF MONSTERS: , 2020 .

[67]  B. Davies.  Listening to Children: Being and becoming , 2014 .

[68]  Blake Hallinan,et al.  Recommended for you: The Netflix Prize and the production of algorithmic culture , 2016, New Media Soc..

[69]  Ann E. Cudd,et al.  Beyond economic man: Feminist theory and economics , 1995 .

[70]  Zahirul Hoque,et al.  Methodological issues in accounting research : theories, methods and issues , 2006 .

[71]  Jacob Edmond.  Diffracted Waves and World Literature , 2014, Diffracted Worlds – Diffractive Readings.

[72]  B. Davies.  Reading Anger in Early Childhood Intra-Actions , 2014 .

[73]  M. F. Pinto.  Tensions in agnotology: Normativity in the studies of commercially driven ignorance , 2015, Social studies of science.

[74]  Mark C. Suchman.  Managing Legitimacy: Strategic and Institutional Approaches , 1995 .

[75]  C. Stolker.  Legal Journals: In Pursuit of a More Scientific Approach , 2005 .

[76]  Lucy Suchman,et al.  Feminist STS and the Sciences of the Artificial. , 2007 .

[77]  Melanie Sehgal.  Diffractive Propositions: Reading Alfred North Whitehead with Donna Haraway and Karen Barad , 2014, Diffracted Worlds – Diffractive Readings.

[78]  Andrew D. Selbst,et al.  Big Data's Disparate Impact , 2016 .

[79]  G. Pollock.  Generations and Geographies in the Visual Arts: Feminist Readings , 2005 .

[80]  Nicholas Diakopoulos,et al.  Accountability in algorithmic decision making , 2016, Commun. ACM.

[81]  I. V. D. Tuin,et al.  Diffraction as a Methodology for Feminist Onto-Epistemology: On Encountering Chantal Chawaf and Posthuman Interpellation , 2014 .

[82]  Sue Newell,et al.  Strategic opportunities (and challenges) of algorithmic decision-making: A call for action on the long-term societal effects of 'datification' , 2015, J. Strateg. Inf. Syst..

[83]  Michalinos Zembylas,et al.  Diffraction or reflection? Sketching the contours of two methodologies in educational research , 2017 .

[84]  L. Suchman.  Agencies in Technology Design: Feminist Reconfigurations* , 2020, Machine Ethics and Robot Ethics.