Tackling COVID-19 through Responsible AI Innovation: Five Steps in the Right Direction

Innovations in data science and AI/ML have a central role to play in supporting global efforts to combat COVID-19. The versatility of AI/ML technologies enables scientists and technologists to address an impressively broad range of biomedical, epidemiological, and socioeconomic challenges. This wide-reaching scientific capacity, however, also raises a diverse array of ethical challenges. The need for researchers to act quickly and globally in tackling SARS-CoV-2 demands unprecedented practices of open research and responsible data sharing at a time when innovation ecosystems are hobbled by proprietary protectionism, inequality, and a lack of public trust. Moreover, societally impactful interventions like digital contact tracing are raising fears of surveillance creep and are challenging widely held commitments to privacy, autonomy, and civil liberties. Prepandemic concerns that data-driven innovations may function to reinforce entrenched dynamics of societal inequity have likewise intensified given the disparate impact of the virus on vulnerable social groups and the life-and-death consequences of biased and discriminatory public health outcomes. To address these concerns, I offer five steps that need to be taken to encourage responsible research and innovation. These provide a practice-based path to responsible AI/ML design and discovery centered on open, accountable, equitable, and democratically governed processes and products. When taken from the start, these steps will not only enhance the capacity of innovators to tackle COVID-19 responsibly, they will, more broadly, help to better equip the data science and AI/ML community to cope with future pandemics and to support a more humane, rational, and just society.

[1]  E. Uslaner The Moral Foundations of Trust , 2002 .

[2]  Bolei Zhou,et al.  Network Dissection: Quantifying Interpretability of Deep Visual Representations , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Kristina Lerman,et al.  A Survey on Bias and Fairness in Machine Learning , 2019, ACM Comput. Surv..

[4]  John Stuart Mill,et al.  On liberty and the subjection of women , 1917 .

[5]  S. Jasanoff Science and Public Reason , 2012 .

[6]  G. Collins,et al.  Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement , 2015, BMC Medicine.

[7]  L. Floridi,et al.  The Debate on the Ethics of AI in Health Care: a Reconstruction and Critical Review , 2019, SSRN Electronic Journal.

[8]  Giel Nijpels,et al.  Race/Ethnic Differences in the Associations of the Framingham Risk Factors with Carotid IMT and Cardiovascular Events , 2015, PloS one.

[9]  Evgeniy Gabrilovich,et al.  Machine-learned epidemiology: real-time detection of foodborne illness at scale , 2018, npj Digital Medicine.

[10]  Richard D Riley,et al.  Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal , 2020 .

[11]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[12]  G. Collins,et al.  External validation of multivariable prediction models: a systematic review of methodological conduct and reporting , 2014, BMC Medical Research Methodology.

[13]  Anshul Kundaje,et al.  Denoising genome-wide histone ChIP-seq with convolutional neural networks , 2016, bioRxiv.

[14]  Zhicheng Wang,et al.  Combating COVID-19: health equity matters , 2020, Nature Medicine.

[15]  E. Erikson Identity and the life cycle: Selected papers. , 1959 .

[16]  Jeremy Walker THE EXPLANATION OF BEHAVIOUR , 1965 .

[17]  Neel S Madhukar,et al.  The Missing Pieces of Artificial Intelligence in Medicine. , 2019, Trends in pharmacological sciences.

[18]  Predrag V. Klasnja,et al.  Exploring Privacy Concerns about Personal Sensing , 2009, Pervasive.

[19]  Ben J. Marafino,et al.  Creating Fair Models of Atherosclerotic Cardiovascular Disease Risk , 2018, AIES.

[20]  Tony Doyle,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Inf. Soc..

[21]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[22]  Krishna P. Gummadi,et al.  Beyond Distributive Fairness in Algorithmic Decision Making: Feature Selection for Procedurally Fair Learning , 2018, AAAI.

[23]  Sendhil Mullainathan,et al.  Does Machine Learning Automate Moral Hazard and Error? , 2017, The American economic review.

[24]  Lucie Abeler-Dörner,et al.  Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing , 2020, Science.

[25]  Tommi S. Jaakkola,et al.  Towards Robust Interpretability with Self-Explaining Neural Networks , 2018, NeurIPS.

[26]  Anne Liu,et al.  Introduction of Mobile Health Tools to Support Ebola Surveillance and Contact Tracing in Guinea , 2015, Global Health: Science and Practice.

[27]  Kristina Lerman,et al.  COVID-19: The First Public Coronavirus Twitter Dataset , 2020, ArXiv.

[28]  David J. Stump,et al.  The Disunity of Science: Boundaries, Contexts, and Power , 1998 .

[29]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[30]  Wesley Shrum,et al.  Reagency of the Internet, or, How I Became a Guest for Science , 2005 .

[31]  Veda C. Storey,et al.  A Framework for Analysis of Data Quality Research , 1995, IEEE Trans. Knowl. Data Eng..

[32]  M. Chamberland,et al.  Challenges of global surveillance during an influenza pandemic , 2011, Public Health.

[33]  Bhaskar Krishnamachari,et al.  CONTAIN: Privacy-oriented Contact Tracing Protocols for Epidemics , 2020, 2021 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[34]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[35]  Tanvi Desai,et al.  Five Safes: designing data access for research , 2016 .

[36]  F. Hu,et al.  Prediction of potential commercially inhibitors against SARS-CoV-2 by multi-task deep model , 2020, 2003.00728.

[37]  Rogier Creemers,et al.  China's Social Credit System: An Evolving Practice of Control , 2018 .

[38]  J. Amon,et al.  Failing Siracusa: governments' obligations to find the least restrictive options for tuberculosis control. , 2013, Public health action.

[39]  Kieran Healy,et al.  Classification situations: Life-chances in the neoliberal era , 2013 .

[40]  Jürgen Habermas,et al.  The Inclusion of the Other: Studies in Political Theory , 1999 .

[41]  Division on Earth,et al.  Reproducibility and Replicability in Science , 2019 .

[42]  Jon Darius,et al.  Asimov's New Guide to Science , 1986 .

[43]  Jukka-Pekka Onnela,et al.  Passive data collection and use in healthcare: A systematic review of ethical issues , 2019, Int. J. Medical Informatics.

[44]  Mariarosaria Taddeo,et al.  The Chinese Approach to Artificial Intelligence: An Analysis of Policy and Regulation , 2019, SSRN Electronic Journal.

[45]  X. Qi,et al.  Machine learning-based CT radiomics model for predicting hospital stay in patients with pneumonia associated with SARS-CoV-2 infection: A multicenter study , 2020, medRxiv.

[46]  Edward,et al.  Measuring Trust , 2000 .

[47]  Christine L. Borgman,et al.  Big Data, Little Data, No Data: Scholarship in the Networked World , 2014 .

[48]  T. Hellström,et al.  Systemic innovation and risk: technology assessment and the challenge of responsible innovation , 2003 .

[49]  C. Schmitt Scientific Revolution , 1968, Nature.

[50]  Patrick Royston,et al.  Reporting methods in studies developing prognostic models in cancer: a review , 2010, BMC medicine.

[51]  Erik Schultes,et al.  The FAIR Guiding Principles for scientific data management and stewardship , 2016, Scientific Data.

[52]  M. Ravenel,et al.  Science and the Modern World , 1926 .

[53]  Trevor Darrell,et al.  Attentive Explanations: Justifying Decisions and Pointing to the Evidence , 2016, ArXiv.

[54]  E. Steyerberg,et al.  Reporting and Methods in Clinical Prediction Research: A Systematic Review , 2012, PLoS medicine.

[55]  E. Shortliffe,et al.  Clinical Decision Support in the Era of Artificial Intelligence. , 2018, JAMA.

[56]  I. Rumfitt,et al.  Making it Explicit: Reasoning, Representing, and Discursive Commitment. , 1997 .

[57]  A. Honneth Disrespect: The Normative Foundations of Critical Theory , 2007 .

[58]  C. Tenopir,et al.  Data Sharing by Scientists: Practices and Perceptions , 2011, PloS one.

[59]  Sabina Leonelli,et al.  Data — from objects to assets , 2019, Nature.

[60]  Paulo J. G. Lisboa,et al.  Making machine learning models interpretable , 2012, ESANN.

[61]  C. Peirce,et al.  The Fixation of Belief , 2011, Philosophy after Darwin.

[62]  Rohitash Chandra,et al.  Mobile Application for Dengue Fever Monitoring and Tracking via GPS: Case Study for Fiji , 2015, ArXiv.

[63]  Kyriaki Kalimeri,et al.  Advertisers Jump on Coronavirus Bandwagon: Politics, News, and Business , 2020, ArXiv.

[64]  Jie Xu,et al.  The practical implementation of artificial intelligence technologies in medicine , 2019, Nature Medicine.

[65]  H. R. Quillian In semantic information processing , 1968 .

[66]  I. Young Justice and the Politics of Difference , 1990, The New Social Theory Reader.

[67]  Paul Ohm Broken Promises of Privacy: Responding to the Surprising Failure of Anonymization , 2009 .

[68]  Yanjie Wei,et al.  Deep Learning Based Drug Screening for Novel Coronavirus 2019-nCov , 2020, Interdisciplinary Sciences: Computational Life Sciences.

[69]  William A. Mattingly,et al.  Socioeconomic Position and the Incidence, Severity, and Clinical Outcomes of Hospitalized Patients With Community-Acquired Pneumonia , 2020, Public health reports.

[70]  David Butler,et al.  TraceSecure: Towards Privacy Preserving Contact Tracing , 2020, ArXiv.

[71]  J. Rotter A new scale for the measurement of interpersonal trust. , 1967, Journal of personality.

[72]  Martha A. Tesfalul,et al.  Evaluation of a Mobile Health Approach to Tuberculosis Contact Tracing in Botswana , 2016, Journal of health communication.

[73]  Johannes Gehrke,et al.  Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission , 2015, KDD.

[74]  Nizar Bouguila,et al.  Classification of caesarean section and normal vaginal deliveries using foetal heart rate signals and advanced machine learning algorithms , 2017, Biomedical engineering online.

[75]  Luciano Floridi,et al.  Translating Principles into Practices of Digital Ethics: Five Risks of Being Unethical , 2019, Philosophy & Technology.

[76]  Yves-Alexandre de Montjoye,et al.  Computational privacy : towards privacy-conscientious uses of metadata , 2015 .

[77]  George Hripcsak,et al.  Caveats for the use of operational electronic health record data in comparative effectiveness research. , 2013, Medical care.

[78]  Alfredo Vellido,et al.  The importance of interpretability and visualization in machine learning for applications in medicine and health care , 2019, Neural Computing and Applications.

[79]  Bo Xu,et al.  A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19) , 2020, European Radiology.

[80]  Nigam H. Shah,et al.  Counterfactual Reasoning for Fair Clinical Risk Prediction , 2019, MLHC.

[81]  R. Tibshirani,et al.  Prototype selection for interpretable classification , 2011, 1202.5933.

[82]  A. Honneth,et al.  The Critique of Power: Reflective Stages in a Critical Social Theory , 1991 .

[83]  M. Raviglione,et al.  Limitations on human rights: are they justifiable to reduce the burden of TB in the era of MDR- and XDR-TB? , 2008, Health and human rights.

[84]  T. Kristal,et al.  Benefit Inequality among American Workers by Gender, Race, and Ethnicity, 1982–2015 , 2018 .

[85]  R. Brook,et al.  Response to COVID-19 in Taiwan: Big Data Analytics, New Technology, and Proactive Testing. , 2020, JAMA.

[86]  K. Tomic Heat Wave: A Social Autopsy of Disaster in Chicago , 2003 .

[87]  Heather A. Piwowar,et al.  Data archiving is a good investment , 2011, Nature.

[88]  R. V. Schomberg Why responsible innovation? , 2019, International Handbook on Responsible Innovation.

[89]  Lea Ypi,et al.  Structural Injustice, Epistemic Opacity, and the Responsibilities of the Oppressed , 2019, Journal of Social Philosophy.

[90]  A. Honneth,et al.  Pathologies of Reason: On the Legacy of Critical Theory , 2009 .

[91]  Charles S. Peirce,et al.  Some Consequences of Four Incapacities , 2016 .

[92]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[93]  Cynthia Rudin,et al.  This Looks Like That: Deep Learning for Interpretable Image Recognition , 2018 .

[94]  R. V. Schomberg A Vision of Responsible Research and Innovation , 2013 .

[95]  G. Collins,et al.  Prediction models for cardiovascular disease risk in the general population: systematic review , 2016, British Medical Journal.

[96]  Richard Hawkins,et al.  A Pattern for Arguing the Assurance of Machine Learning in Medical Diagnosis Systems , 2019, SAFECOMP.

[97]  T. Beauchamp,et al.  Principles of biomedical ethics , 1991 .

[98]  J. Crane Scrambling for Africa? Universities and global health , 2011, The Lancet.

[99]  M. Rogers,et al.  The undiscovered Dewey : religion, morality, and the ethos of democracy , 2008 .

[100]  L. A. Hausman How we Think , 1921 .

[101]  M. Woodward,et al.  Risk prediction models: II. External validation, model updating, and impact assessment , 2012, Heart.

[102]  Sabina Leonelli,et al.  Beyond the digital divide: Towards a situated approach to open data , 2017 .

[103]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[104]  C Raina MacIntyre,et al.  Heightened Vulnerability, Reduced Oversight, and Ethical Breaches on the Internet in the West African Ebola Epidemic , 2015, The American journal of bioethics : AJOB.

[105]  A. O. Bicen,et al.  Novel Wearable Seismocardiography and Machine Learning Algorithms Can Assess Clinical Status of Heart Failure Patients , 2018, Circulation. Heart failure.

[106]  Prasant Mohapatra,et al.  Using Deep Learning for Energy Expenditure Estimation with wearable sensors , 2015, 2015 17th International Conference on E-health Networking, Application & Services (HealthCom).

[107]  David G. Rand,et al.  Using social and behavioural science to support COVID-19 pandemic response , 2020, Nature Human Behaviour.

[108]  J. Stilgoe,et al.  Responsible research and innovation: From science in society to science for society, with society , 2012, Emerging Technologies: Ethics, Law and Governance.

[109]  Mark Zastrow,et al.  South Korea is reporting intimate details of COVID-19 cases: has it helped? , 2020, Nature.

[110]  E. Vayena,et al.  Machine learning in medicine: Addressing ethical challenges , 2018, PLoS medicine.

[111]  Ibrahim Eksin,et al.  A new optimization method: Big Bang-Big Crunch , 2006, Adv. Eng. Softw..

[112]  Ron Dare,et al.  The disorder of things: Metaphysical foundations of the disunity of science , 1997 .

[113]  Peter Medawar,et al.  The art of the soluble , 2021, Nature.

[114]  B. Ehsani-Moghaddam,et al.  Data quality in healthcare: A report of practical experience with the Canadian Primary Care Sentinel Surveillance Network data , 2019, Health information management : journal of the Health Information Management Association of Australia.

[115]  Toon Calders,et al.  Data preprocessing techniques for classification without discrimination , 2011, Knowledge and Information Systems.

[116]  William O’Grady Processing Determinism: Processing Determinism , 2015 .

[117]  Bernd Carsten Stahl,et al.  Responsible research and innovation in the digital age , 2017, Commun. ACM.

[118]  Hong Fan,et al.  Optimization Method for Forecasting Confirmed Cases of COVID-19 in China , 2020, Journal of clinical medicine.

[119]  Tom Rodden,et al.  Principles of robotics: regulating robots in the real world , 2017, Connect. Sci..

[120]  Jürgen Habermas,et al.  Postmetaphysical Thinking: Philosophical Essays , 1992 .

[121]  Robert Brandom,et al.  Making it explicit : reasoning, representing, and discursive commitment , 1996 .

[122]  Xiaohui Liang,et al.  EPIC: Efficient Privacy-Preserving Contact Tracing for Infection Detection , 2018, 2018 IEEE International Conference on Communications (ICC).

[123]  Jianyang Zeng,et al.  A data-driven drug repositioning framework discovered a potential therapeutic agent targeting COVID-19 , 2020, bioRxiv.

[124]  Tom LaGatta,et al.  Conscientious Classification: A Data Scientist's Guide to Discrimination-Aware Classification , 2017, Big Data.

[125]  Steven Shapin,et al.  Never Pure: Historical Studies of Science as if It Was Produced by People with Bodies, Situated in Time, Space, Culture, and Society, and Struggling for Credibility and Authority , 2010 .

[126]  Ce Zhang,et al.  Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features , 2016, Nature Communications.

[127]  Tim Miller,et al.  Explanation in Artificial Intelligence: Insights from the Social Sciences , 2017, Artif. Intell..

[128]  B. Frey,et al.  Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning , 2015, Nature Biotechnology.

[129]  Sanjeeb Dash,et al.  Boolean Decision Rules via Column Generation , 2018, NeurIPS.

[130]  John M. Artz,et al.  Artificial Intelligence for Society , 1987, IEEE Expert.

[131]  Shoshana Zuboff,et al.  Big other: surveillance capitalism and the prospects of an information civilization , 2015, J. Inf. Technol..

[132]  Vence L Bonham,et al.  The Clinical Imperative for Inclusivity: Race, Ethnicity, and Ancestry (REA) in Genomics , 2018, bioRxiv.

[133]  Brian W. Powers,et al.  Dissecting racial bias in an algorithm used to manage the health of populations , 2019, Science.

[134]  Louise Amoore,et al.  Algorithmic War: Everyday Geographies of the War on Terror , 2009 .

[135]  Bernd Carsten Stahl,et al.  Ethics of healthcare robotics: Towards responsible research and innovation , 2016, Robotics Auton. Syst..

[136]  Kevin Scharp,et al.  In the Space of Reasons: Selected Essays of Wilfrid Sellars , 2007 .

[137]  Richard Owen,et al.  The UK Engineering and Physical Sciences Research Council's commitment to a framework for responsible innovation , 2014 .

[138]  Bob Bolin,et al.  Race, Class, Ethnicity, and Disaster Vulnerability , 2007 .

[139]  J. Ioannidis,et al.  External validation of new risk prediction models is infrequent and reveals worse prognostic discrimination. , 2015, Journal of clinical epidemiology.

[140]  S. Diamond Science-Mart: Privatizing American Science , 2012 .

[141]  A. Honneth The I in We: Studies in the Theory of Recognition , 2012 .

[142]  Björn Scheuermann,et al.  Privacy-Preserving Contact Tracing of COVID-19 Patients , 2020, IACR Cryptol. ePrint Arch..

[143]  L. Peek,et al.  Poverty and Disasters in the United States: A Review of Recent Sociological Findings , 2004 .

[144]  Benedikt Fecher,et al.  Open Science: One Term, Five Schools of Thought , 2013 .

[145]  S. Tamang,et al.  Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data , 2018, JAMA internal medicine.

[146]  L. J. Regan PRACTICAL ETHICS. , 1943, California and western medicine.

[147]  F. Keil,et al.  Explanation and understanding , 2015 .

[148]  Daniel Spichtinger,et al.  'Science 2.0': Science in Transition , 2014 .

[149]  Anna Jobin,et al.  The global landscape of AI ethics guidelines , 2019, Nature Machine Intelligence.

[150]  Björn Scheuermann,et al.  CAUDHT: Decentralized Contact Tracing Using a DHT and Blind Signatures , 2020, 2020 IEEE 45th Conference on Local Computer Networks (LCN).

[151]  J. Dewey,et al.  The Public and Its Problems: An Essay in Political Inquiry , 2016 .

[152]  Jure Leskovec,et al.  Interpretable Decision Sets: A Joint Framework for Description and Prediction , 2016, KDD.

[153]  S. Denny,et al.  Best Practices for Ethical Sharing of Individual-Level Health Research Data From Low- and Middle-Income Settings , 2015, Journal of empirical research on human research ethics : JERHRE.

[154]  S. Scholle,et al.  Data On Race, Ethnicity, And Language Largely Incomplete For Managed Care Plan Members. , 2017, Health affairs.

[155]  A. Honneth,et al.  The Fragmented World of the Social: Essays in Social and Political Philosophy , 1995 .

[156]  R. Bernstein Towards a Transformation of Philosophy , 1981 .

[157]  Vasa Curcin,et al.  Possible Sources of Bias in Primary Care Electronic Health Record Data Use and Reuse , 2018, Journal of medical Internet research.

[158]  Boris Delibasic,et al.  Building interpretable predictive models for pediatric hospital readmission using Tree-Lasso logistic regression , 2016, Artif. Intell. Medicine.

[159]  Solon Barocas,et al.  Problem Formulation and Fairness , 2019, FAT.

[160]  Alexandra Luccioni,et al.  Mapping the Landscape of Artificial Intelligence Applications against COVID-19 , 2020, J. Artif. Intell. Res..

[161]  Indre Zliobaite,et al.  Measuring discrimination in algorithmic decision making , 2017, Data Mining and Knowledge Discovery.

[162]  Gary S Collins,et al.  A systematic review finds prediction models for chronic kidney disease were poorly reported and often developed using inappropriate methods. , 2013, Journal of clinical epidemiology.

[163]  Fritz Allhoff,et al.  What Are Applied Ethics? , 2011, Sci. Eng. Ethics.

[164]  Gary S Collins,et al.  Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness , 2020, BMJ.

[165]  B. Beck,et al.  Predicting commercially available antiviral drugs that may act on the novel coronavirus (2019-nCoV), Wuhan, China through a drug-target interaction deep learning model , 2020, bioRxiv.

[166]  Cynthia Rudin,et al.  Falling Rule Lists , 2014, AISTATS.

[167]  Wei Shi,et al.  Federated learning of predictive models from federated Electronic Health Records , 2018, Int. J. Medical Informatics.

[168]  Les E. Atlas,et al.  Interpretable Recurrent Neural Networks Using Sequential Sparse Recovery , 2016, ArXiv.

[169]  Michael Wainberg,et al.  Deep learning in biomedicine , 2018, Nature Biotechnology.

[170]  Shoshana Zuboff The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power , 2019 .

[171]  Cynthia Rudin,et al.  Supersparse linear integer models for optimized medical scoring systems , 2015, Machine Learning.

[172]  Maria Lee,et al.  The Ethics of Invention: Technology and the Human Future , 2017 .

[173]  Rudolf Kruse,et al.  Obtaining interpretable fuzzy classification rules from medical data , 1999, Artif. Intell. Medicine.

[174]  G. Lăzăroiu The Cambridge Handbook of Information and Computer Ethics , 2012 .

[175]  Dmitrii Bychkov,et al.  Deep learning based tissue analysis predicts outcome in colorectal cancer , 2018, Scientific Reports.

[176]  Christian Fuchs,et al.  Labor in Informational Capitalism and on the Internet , 2010, Inf. Soc..

[177]  J. L. Heilbron,et al.  Leviathan and the air-pump. Hobbes, Boyle, and the experimental life , 1989, Medical History.

[178]  Guido Bologna,et al.  Characterization of Symbolic Rules Embedded in Deep DIMLP Networks: A Challenge to Transparency of Deep Learning , 2017, J. Artif. Intell. Soft Comput. Res..

[179]  S. Bailly,et al.  What’s new in ICU in 2050: big data and machine learning , 2018, Intensive Care Medicine.

[180]  René von Schomberg,et al.  Open Science, Open Data, and Open Scholarship: European Policies to Make Science Fit for the Twenty-First Century , 2019, Front. Big Data.

[181]  Robert Koprowski,et al.  Machine learning, medical diagnosis, and biomedical engineering research - commentary , 2014, BioMedical Engineering OnLine.

[182]  Yaozong Gao,et al.  Lung Infection Quantification of COVID-19 in CT Images with Deep Learning , 2020, ArXiv.

[183]  Douglas G. Altman,et al.  Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) , 2015, Circulation.

[184]  Georg Langs,et al.  Causability and explainability of artificial intelligence in medicine , 2019, WIREs Data Mining Knowl. Discov..

[185]  R. Ryan,et al.  Health surveillance during covid-19 pandemic , 2020, BMJ.

[186]  R. M. Wallace,et al.  The legitimacy of the modern age , 1983 .

[187]  Renzhi Cao,et al.  Survey of Machine Learning Techniques in Drug Discovery. , 2019, Current drug metabolism.

[188]  Jathan Sadowski When data is capital: Datafication, accumulation, and extraction , 2019, Big Data Soc..

[189]  Sherri Rose,et al.  Fair regression for health care spending , 2019, Biometrics.

[190]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[191]  Anjan Chakravartty,et al.  The Dappled World: A Study of the Boundaries of Science , 2000 .

[192]  Sidong Liu,et al.  Early diagnosis of Alzheimer's disease with deep learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[193]  Peter Szolovits,et al.  Artificial intelligence, machine learning and health systems , 2018, Journal of global health.

[194]  Martin Bichler,et al.  Responsible Data Science , 2017, Bus. Inf. Syst. Eng..

[195]  Andrew D. Selbst,et al.  Big Data's Disparate Impact , 2016 .

[196]  Nancy Fraser Scales of Justice: Reimagining Political Space in a Globalizing World , 2008 .

[197]  C. Kruse,et al.  Challenges and Opportunities of Big Data in Health Care: A Systematic Review , 2016, JMIR medical informatics.

[198]  Ming Li,et al.  Privacy-preserving inference of social relationships from location data: a vision paper , 2015, SIGSPATIAL/GIS.

[199]  Sheila Jasanoff,et al.  Transparency in Public Science: Purposes, Reasons, Limits , 2006 .

[200]  Phoebe Sengers,et al.  Reflective design , 2005, Critical Computing.

[201]  Quanshi Zhang,et al.  Interpretable Convolutional Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[202]  Suresh Venkatasubramanian,et al.  A comparative study of fairness-enhancing interventions in machine learning , 2018, FAT.

[203]  Helen Nissenbaum,et al.  Big data's end run around procedural privacy protections , 2014, Commun. ACM.

[204]  Z. Bankowski,et al.  Council for International Organizations of Medical Sciences , 1991 .

[205]  Solon Barocas,et al.  The Intuitive Appeal of Explainable Machines , 2018 .

[206]  Helen A. Weiss,et al.  Use of a mobile application for Ebola contact tracing and monitoring in northern Sierra Leone: a proof-of-concept study , 2019, BMC Infectious Diseases.

[207]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[208]  S. L. Star,et al.  The Ethnography of Infrastructure , 1999 .

[209]  Robert Brandom,et al.  Reason in Philosophy: Animating Ideas , 2009 .

[210]  M. Whitlock Data archiving in ecology and evolution: best practices. , 2011, Trends in ecology & evolution.

[211]  Mason Marks,et al.  Emergent Medical Data: Health Information Inferred by Artificial Intelligence , 2020 .

[212]  Elizabeth Ford,et al.  “Giving something back”: A systematic review and ethical enquiry into public views on the use of patient data for research in the United Kingdom and the Republic of Ireland , 2018, Wellcome open research.

[213]  Matteo Cinelli,et al.  The COVID-19 social media infodemic , 2020, Scientific reports.

[214]  Hayden C. Metsky,et al.  CRISPR-based surveillance for COVID-19 using genomically-comprehensive machine learning design , 2020, bioRxiv.

[215]  Ankur Teredesai,et al.  Interpretable Machine Learning in Healthcare , 2018, 2018 IEEE International Conference on Healthcare Informatics (ICHI).

[216]  Julia Rubin,et al.  Fairness Definitions Explained , 2018, 2018 IEEE/ACM International Workshop on Software Fairness (FairWare).

[217]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: validating a prognostic model , 2009, BMJ : British Medical Journal.

[218]  Svenja Boberg,et al.  Pandemic Populism: Facebook Pages of Alternative News Media and the Corona Crisis - A Computational Content Analysis , 2020, ArXiv.

[219]  Steinar Krokstad,et al.  Innovative technologies and social inequalities in health: A scoping review of the literature , 2018, PloS one.

[220]  Cynthia Rudin,et al.  Optimized Scoring Systems: Toward Trust in Machine Learning for Healthcare and Criminal Justice , 2018, Interfaces.

[221]  The philosophy of loyalty , 1908 .

[222]  Oktay Yildiz,et al.  Diagnosis of Acute Coronary Syndrome with a Support Vector Machine , 2016, Journal of Medical Systems.

[223]  Jimeng Sun,et al.  RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism , 2016, NIPS.

[224]  Philippe Golle,et al.  Revisiting the uniqueness of simple demographics in the US population , 2006, WPES '06.

[225]  F. Berman,et al.  The Research Data Alliance: Benefits and Challenges of Building a Community Organization , 2020, 2.1.

[226]  Anna Goldenberg,et al.  What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use , 2019, MLHC.

[227]  Ran Canetti,et al.  Anonymous Collocation Discovery: Harnessing Privacy to Tame the Coronavirus , 2020, 2003.13670.

[228]  Marcello Ienca,et al.  On the responsible use of digital data to tackle the COVID-19 pandemic , 2020, Nature Medicine.

[229]  J. Dewey Logic, the theory of inquiry , 1938 .

[230]  S Holm,et al.  Principles of Biomedical Ethics, 5th edn. , 2002 .

[231]  Richard D Riley,et al.  Calculating the sample size required for developing a clinical prediction model , 2020, BMJ.

[232]  Ramesh Raskar,et al.  Apps Gone Rogue: Maintaining Personal Privacy in an Epidemic , 2020, ArXiv.

[233]  Hyunghoon Cho,et al.  Contact Tracing Mobile Apps for COVID-19: Privacy Considerations and Related Trade-offs , 2020, ArXiv.

[234]  M. Foucault,et al.  The Order of Things , 2017 .

[235]  Alex Alves Freitas,et al.  Comprehensible classification models: a position paper , 2014, SKDD.

[236]  Alex 'Sandy' Pentland,et al.  Assessing Disease Exposure Risk with Location Data: A Proposal for Cryptographic Preservation of Privacy , 2020, 2003.14412.

[237]  Ibrahim Habli,et al.  Artificial intelligence in health care: accountability and safety , 2020, Bulletin of the World Health Organization.

[238]  David Kotz,et al.  ENACT: Encounter-based Architecture for Contact Tracing , 2017, WPA@MobiSys.

[239]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[240]  G. Warnke,et al.  Understanding and Explanation: A Transcendental-Pragmatic Perspective , 1984 .

[241]  Piers Millett,et al.  Developing Global Norms for Sharing Data and Results during Public Health Emergencies , 2016, PLoS medicine.

[242]  Masatake Yamamichi,et al.  Mobile applications for the health sector , 2012 .

[243]  Yanzhong Huang THE SARS EPIDEMIC AND ITS AFTERMATH IN CHINA: A POLITICAL PERSPECTIVE , 2004 .

[244]  Cho Jungah,et al.  Justice and the Politics of Difference , 1997 .

[245]  Dirk Helbing,et al.  Give more data, awareness and control to individual citizens, and they will help COVID-19 containment , 2020, Ethics and Information Technology.

[246]  Carmela Troncoso,et al.  Decentralized Privacy-Preserving Proximity Tracing , 2020, IEEE Data Eng. Bull..

[247]  Gary S Collins,et al.  Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration , 2015, Annals of Internal Medicine.

[248]  I. Young Structural injustice and the politics of difference , 2008, Social Justice and Public Policy.

[249]  Mohammad Pourhomayoun,et al.  Predicting Mortality Risk in Patients with COVID-19 Using Artificial Intelligence to Help Medical Decision-Making , 2020, medRxiv.

[250]  Christian Biemann,et al.  What do we need to build explainable AI systems for the medical domain? , 2017, ArXiv.

[251]  Kieran Healy,et al.  Seeing like a market , 2016 .

[252]  Kadija Ferryman,et al.  Fairness in precision medicine , 2018 .

[253]  David S. Leslie,et al.  Machine Intelligence and the Ethical Grammar of Computability , 2013, PT-AI.

[254]  M. Gorman,et al.  A framework for responsible innovation , 2013 .

[255]  Indrăź źLiobaităź,et al.  Measuring discrimination in algorithmic decision making , 2017 .

[256]  Edward S. Dove,et al.  Reflections on the Concept of Open Data , 2015 .

[257]  Kuldip K. Paliwal,et al.  Predicting backbone Cα angles and dihedrals from protein sequences by stacked sparse auto‐encoder deep neural network , 2014, J. Comput. Chem..

[258]  Eric Horvitz,et al.  PACT: Privacy-Sensitive Protocols And Mechanisms for Mobile Contact Tracing , 2020, IEEE Data Eng. Bull..

[259]  A. Honneth,et al.  Redistribution or Recognition?: A Political-Philosophical Exchange , 2003 .

[260]  Joseph Savirimuthu,et al.  The GDPR, AI and the NHS Code of Conduct for Data-Driven Health and Care Technology , 2020 .

[261]  Wilfrid S. Sellars Empiricism and the philosophy of mind , 1997 .

[262]  G. Daker-White,et al.  The care.data consensus? A qualitative analysis of opinions expressed on Twitter , 2015, BMC Public Health.

[263]  Oluwasanmi Koyejo,et al.  Examples are not enough, learn to criticize! Criticism for Interpretability , 2016, NIPS.

[264]  M. Rosenbaum,et al.  How Socioeconomic Status Affects Patient Perceptions of Health Care: A Qualitative Study , 2017, Journal of primary care & community health.

[265]  Jared Lee Katzman,et al.  jaredleekatzman/DeepSurv: Second Release of DeepSurv , 2017 .

[266]  M. Kearns,et al.  Fairness in Criminal Justice Risk Assessments: The State of the Art , 2017, Sociological Methods & Research.

[267]  David Leslie Understanding artificial intelligence ethics and safety , 2019, SSRN Electronic Journal.

[268]  Calvin J Chiew,et al.  Interrupting transmission of COVID-19: lessons from containment efforts in Singapore , 2020, Journal of travel medicine.

[269]  Marina Jirotka,et al.  Towards a closer dialogue between policy and practice: responsible design in HCI , 2014, CHI.

[270]  Toon Calders,et al.  Why Unbiased Computational Processes Can Lead to Discriminative Decision Procedures , 2013, Discrimination and Privacy in the Information Society.

[271]  Charles Taylor Sources of the Self: The Making of the Modern Identity , 1990 .

[272]  Louise Amoore,et al.  Securing with algorithms: Knowledge, decision, sovereignty , 2017 .

[273]  Demis Hassabis,et al.  Improved protein structure prediction using potentials from deep learning , 2020, Nature.

[274]  Philip Mirowski Machine Dreams Economics Becomes a Cyborg Science , 2001 .

[275]  Raina M. Merchant,et al.  Transforming Scientific Inquiry: Tapping Into Digital Data by Building a Culture of Transparency and Consent , 2016, Academic medicine : journal of the Association of American Medical Colleges.

[276]  Salvatore Ruggieri,et al.  A multidisciplinary survey on discrimination analysis , 2013, The Knowledge Engineering Review.

[277]  Raja Chatila,et al.  The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems , 2019, Robotics and Well-Being.

[278]  Edgar A. Whitley,et al.  Patient Perspectives on Sharing Anonymized Personal Health Data Using a Digital System for Dynamic Consent and Research Feedback: A Qualitative Study , 2016, Journal of medical Internet research.

[279]  C. Ells A Companion to Bioethics , 2003 .

[280]  B. Latour We Have Never Been Modern , 1991 .

[281]  Isabelle Bichindaritz,et al.  Case-based reasoning in the health sciences: What's next? , 2006, Artif. Intell. Medicine.

[282]  Johannes Gehrke,et al.  Intelligible models for classification and regression , 2012, KDD.

[283]  R. V. Schomberg Towards Responsible Research and Innovation in the Information and Communication Technologies and Security Technologies Fields , 2011 .

[284]  Margo I. Seltzer,et al.  Learning Certifiably Optimal Rule Lists , 2017, KDD.

[285]  Marcus Kaiser,et al.  Metrics for Measuring Data Quality - Foundations for an Economic Data Quality Management , 2016, ICSOFT.

[286]  Sabina Leonelli,et al.  Why the Current Insistence on Open Access to Scientific Data? Big Data, Knowledge Production, and the Political Economy of Contemporary Biology , 2013 .

[287]  Peter Szolovits,et al.  Genetic Misdiagnoses and the Potential for Health Disparities. , 2016, The New England journal of medicine.

[288]  Kristina Lerman,et al.  Tracking Social Media Discourse About the COVID-19 Pandemic: Development of a Public Coronavirus Twitter Data Set , 2020, JMIR public health and surveillance.

[289]  Cynthia Rudin,et al.  Deep Learning for Case-based Reasoning through Prototypes: A Neural Network that Explains its Predictions , 2017, AAAI.

[290]  Ankur Teredesai,et al.  Interpretable Machine Learning in Healthcare , 2018, BCB.

[291]  T. Monahan,et al.  Dis-ease Surveillance: How Might Surveillance Studies Address COVID-19? , 2020, Surveillance & Society.

[292]  Jimeng Sun,et al.  RAIM: Recurrent Attentive and Intensive Model of Multimodal Patient Monitoring Data , 2018, KDD.

[293]  J. Habermas,et al.  Between Naturalism and Religion: Philosophical Essays , 2008 .

[294]  G. S. Rousseau,et al.  Madness and civilization : a history of insanity in the age of reason , 1966 .

[295]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001, Statistical Science.

[296]  L. Sweeney Simple Demographics Often Identify People Uniquely , 2000 .

[297]  Xun Jia,et al.  Clinical implementation of AI technologies will require interpretable AI models. , 2019, Medical physics.

[298]  Chris Russell,et al.  Explaining Explanations in AI , 2018, FAT.

[299]  Tom Rainforth,et al.  A note on blind contact tracing at scale with applications to the COVID-19 pandemic , 2020, ARES.

[300]  Bernd Carsten Stahl,et al.  Responsible research and innovation: Critical reflection into the potential social consequences of ICT , 2013, IEEE 7th International Conference on Research Challenges in Information Science (RCIS).

[301]  Marzyeh Ghassemi,et al.  A Review of Challenges and Opportunities in Machine Learning for Health. , 2020, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[302]  Farah Magrabi,et al.  Developing a framework for evidence-based grading and assessment of predictive tools for clinical decision support , 2019, BMC Medical Informatics and Decision Making.

[303]  Hayit Greenspan,et al.  Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis , 2020, ArXiv.

[304]  Jennifer C Molloy,et al.  The Open Knowledge Foundation: Open Data Means Better Science , 2011, PLoS biology.

[305]  Helen Nissenbaum,et al.  Privacy in Context - Technology, Policy, and the Integrity of Social Life , 2009 .