Between a logic of disruption and a logic of continuation: Negotiating the legitimacy of algorithms used in automated clinical decision-making

In both popular and academic discussions of the use of algorithms in clinical practice, narratives often draw on the decisive potentialities of algorithms and come with the belief that algorithms will substantially transform healthcare. We suggest that this approach is associated with a logic of disruption. However, we argue that in clinical practice alongside this logic, another and less recognised logic exists, namely that of continuation: here the use of algorithms constitutes part of an established practice. Applying these logics as our analytical framing, we set out to explore how algorithms for clinical decision-making are enacted by political stakeholders, healthcare professionals, and patients, and in doing so, study how the legitimacy of delegating to an algorithm is negotiated and obtained. Empirically we draw on ethnographic fieldwork carried out in relation to attempts in Denmark to develop and implement Patient Reported Outcomes (PRO) tools – involving algorithmic sorting – in clinical practice. We follow the work within two disease areas: heart rehabilitation and breast cancer follow-up care. We show how at the political level, algorithms constitute tools for disrupting inefficient work and unsystematic patient involvement, whereas closer to the clinical practice, algorithms constitute a continuation of standardised and evidence-based diagnostic procedures and a continuation of the physicians’ expertise and authority. We argue that the co-existence of the two logics have implications as both provide a push towards the use of algorithms and how a logic of continuation may divert attention away from new issues introduced with automated digital decision-support systems.

[1]  H. Langstrup,et al.  Patient data work: filtering and sensing patient‐reported outcomes , 2020, Sociology of Health & Illness.

[2]  Ezio Di Nucci,et al.  Concordance as evidence in the Watson for Oncology decision-support system , 2020, AI & SOCIETY.

[3]  Stine Lomborg,et al.  Interpretation as luxury: Heart patients living with data doubt, hope, and anxiety , 2020, Big Data & Society.

[4]  J. Brodersen,et al.  Haematologists’ experiences implementing patient reported outcome measures (PROMs) in an outpatient clinic: a qualitative study for applied practice , 2019, Journal of Patient-Reported Outcomes.

[5]  Brian W. Powers,et al.  Dissecting racial bias in an algorithm used to manage the health of populations , 2019, Science.

[6]  N. Schwennesen Algorithmic assemblages of care: imaginaries, epistemologies and repair work. , 2019, Sociology of health & illness.

[7]  K. Hoeyer Data as promise: Reconfiguring Danish public health through personalized medicine , 2019, Social studies of science.

[8]  Francis Lee,et al.  How should we theorize algorithms? Five ideal types in analyzing algorithmic normativities , 2019, Big Data & Society.

[9]  Alan Petersen,et al.  Citizens’ use of digital media to connect with health care: Socio-ethical and regulatory implications , 2019, Health.

[10]  Robert D. Atkinson,et al.  Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again , 2019 .

[11]  C. Johansen,et al.  MyHealth: specialist nurse-led follow-up in breast cancer. A randomized controlled trial – development and feasibility , 2019, Acta oncologica.

[12]  Henriette Langstrup,et al.  Patient-reported data and the politics of meaningful data work , 2018, Health Informatics J..

[13]  D. Neyland The Everyday Life of an Algorithm , 2018 .

[14]  Deborah Lupton,et al.  How do data come to matter? Living and becoming with personal data , 2018, Big Data & Society.

[15]  N. Hjollund,et al.  Tele‐Health Followup Strategy for Tight Control of Disease Activity in Rheumatoid Arthritis: Results of a Randomized Controlled Trial , 2018, Arthritis care & research.

[16]  Nick Seaver Algorithms as culture: Some tactics for the ethnography of algorithmic systems , 2017, Big Data Soc..

[17]  Natasha D. Schüll,et al.  The Datafication of Health , 2017 .

[18]  Paul Dourish,et al.  Algorithms and their others: Algorithmic culture in context , 2016, Big Data Soc..

[19]  Sarah A. Delgado,et al.  The Digital Doctor: Hope, Hype, and Harm at the Dawn of Medicine’s Computer Age , 2016 .

[20]  Sally Engle Merry,et al.  The Seductions of Quantification: Measuring Human Rights, Gender Violence, and Sex Trafficking , 2016 .

[21]  Per Sidenius,et al.  AmbuFlex: tele-patient-reported outcomes (telePRO) as the basis for follow-up in chronic and malignant diseases , 2016, Quality of Life Research.

[22]  Deborah Lupton,et al.  Towards critical digital health studies: Reflections on two decades of research in health and the way forward , 2016, Health.

[23]  Deborah Lupton,et al.  'It's like having a physician in your pocket!' A critical analysis of self-diagnosis smartphone apps. , 2015, Social science & medicine.

[24]  D. Allen Lost in translation? 'Evidence' and the articulation of institutional logics in integrated care pathways: from positive to negative boundary object? , 2014, Sociology of health & illness.

[25]  Frank A. Pasquale,et al.  [89WashLRev0001] The Scored Society: Due Process for Automated Predictions , 2014 .

[26]  Henriette Langstrup,et al.  Chronic care infrastructures and the home. , 2013, Sociology of health & illness.

[27]  Nick Black,et al.  Patient reported outcome measures could help transform healthcare , 2013, BMJ.

[28]  S. Timmermans,et al.  Theory Construction in Qualitative Research , 2012 .

[29]  Davina Allen,et al.  From boundary concept to boundary object: the practice and politics of care pathway development. , 2009, Social science & medicine.

[30]  N. Aaronson,et al.  Use of patient-reported outcomes in clinical practice , 2009, The Lancet.

[31]  M. Traynor Indeterminacy and technicality revisited: how medicine and nursing have responded to the evidence based movement. , 2009, Sociology of health & illness.

[32]  Jean Gayton Carroll,et al.  The Gold Standard: The Challenge of Evidence-Based Medicine and Standardization in Health Care , 2004 .

[33]  M. Good The Biotechnical Embrace , 2001, Culture, medicine and psychiatry.

[34]  Geoffrey C. Bowker,et al.  Building Information Infrastructures for Social Worlds - The Role of Classifications and Standards , 1998, Community Computing and Support Systems.

[35]  K. Patrick Rationalizing Medical Work: Decision-Support Techniques and Medical Practices , 1997 .

[36]  M Berg,et al.  Problems and promises of the protocol. , 1997, Social science & medicine.

[37]  Hubert L. Dreyfus,et al.  What computers still can't do - a critique of artificial reason , 1992 .

[38]  Herbert A. Simon,et al.  The Structure of Ill Structured Problems , 1973, Artif. Intell..

[39]  Kirstine Zinck Pedersen Organisatorisk trumfkort eller reduceret dømmekraft?: Et pragmatisk perspektiv på kræftpakker , 2017 .

[40]  Klaus Hoeyer,et al.  Denmark at a Crossroad? Intensified Data Sourcing in a Research Radical Country , 2016 .

[41]  S. Jasanoff,et al.  Dreamscapes of Modernity: Sociotechnical Imaginaries and the Fabrication of Power , 2015 .