Engineering-Based Design Methodology for Embedding Ethics in Autonomous Robots

This paper explores the design process of robotics and autonomous systems using a co-design approach, applied ethics, and values-driven methods. Specifically, the approach seeks to move beyond traditional risk assessment toward a greater consideration of end-user exposure. The goal of the ethics-based co-design approach is to identify end-user and stakeholder values that guide the minimization of end-user vulnerability associated with the employment of autonomous systems. This design process is also used to identify positive consequences that probably increase human wellbeing as opposed to simply avoiding harm. We argue that biomedical autonomous systems design, during the preclinical phase, should bring together diverse stakeholders that would not traditionally be involved in design. We also argue that embedding ethical considerations in the engineering design process should bring together a diverse range of stakeholders to more accurately appreciate possible end-user implications of a design. With complex systems design, such as biotechnologies, greater awareness is necessary of the ethical implications of designed autonomy to end-user exposure.

[1]  Sanyat S Mapara,et al.  Medical capsule robots: A renaissance for diagnostics, drug delivery and surgical treatment , 2017, Journal of controlled release : official journal of the Controlled Release Society.

[2]  Hyun-Sik Ahn,et al.  Approach to functional safety-compliant ECU design for electro-mechanical brake systems , 2014 .

[3]  Randy Haupt,et al.  Golden Versus Platinum Rules [Ethically Speaking] , 2017, IEEE Antennas and Propagation Magazine.

[4]  E. Trist,et al.  The Causal Texture of Organizational Environments , 1965 .

[5]  B. Bederson,et al.  Children as our technology design partners , 1998 .

[6]  James D. Hollan,et al.  KidPad: a design collaboration between children, technologists, and educators , 1997, CHI.

[7]  Enid Mumford,et al.  The story of socio‐technical design: reflections on its successes, failures and potential , 2006, Inf. Syst. J..

[8]  Allison Druin,et al.  How Young Can Our Technology Design Partners Be , 2002 .

[9]  Lars Skyttner,et al.  General Systems Theory: Perspectives, Problems, Practice , 2006 .

[10]  James H. Moor,et al.  The Nature, Importance, and Difficulty of Machine Ethics , 2006, IEEE Intelligent Systems.

[11]  Allison Druin,et al.  Mixing ideas: a new technique for working with young children as design partners , 2004, IDC '04.

[12]  Alan Borning,et al.  Value Sensitive Design: Theory and Methods , 2002 .

[13]  Janet Davis,et al.  Value Sensitive Design: Applications, Adaptations, and Critiques , 2013 .

[14]  Christian Blum,et al.  Towards an Ethical Robot: Internal Models, Consequences and Ethical Action Selection , 2014, TAROS.

[15]  Allison Druin,et al.  Cooperative Inquiry revisited: Reflections of the past and guidelines for the future of intergenerational co-design , 2013, Int. J. Child Comput. Interact..

[16]  Johannes Gärtner,et al.  Mapping Actors and Agendas: Political Frameworks of Systems Design and Participation , 1996, Hum. Comput. Interact..

[17]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[18]  Russell Freedman Confucius: The Golden Rule , 2002 .

[19]  Andrew D Maynard,et al.  Exposure Assessment Approaches for Engineered Nanomaterials , 2010, Risk analysis : an official publication of the Society for Risk Analysis.

[20]  A. J. Grimes Normal Accidents: Living with High Risk Technologies , 1985 .

[21]  Allison Druin,et al.  The Role of Children in the Design Technology , 1999 .

[22]  L. Bertalanffy The theory of open systems in physics and biology. , 1950 .

[23]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[24]  Mark van den Brand,et al.  On functional safety methods: A system of systems approach , 2018, 2018 Annual IEEE International Systems Conference (SysCon).

[25]  Albert Cherns,et al.  Principles of Sociotechnical Design Revisted , 1987 .

[26]  E. Trist The Evolution of Socio-Technical Systems: A Conceptual Framework and an Action Research Program , 1981 .

[27]  Yngve Sundblad,et al.  Co-operative Design — perspectives on 20 years with 'the Scandinavian IT Design Model' , 2000 .

[28]  Yacov Y. Haimes,et al.  Risk modeling, assessment, and management , 1998 .

[29]  J. Chan,et al.  Design ethics: Reflecting on the ethical dimensions of technology, sustainability, and responsibility in the Anthropocene , 2018 .

[30]  Tone Bratteteig,et al.  Disentangling Participation: Power and Decision-making in Participatory Design , 2014 .

[31]  Batya Friedman,et al.  Value-sensitive design , 1996, INTR.

[32]  Steven P. Nichols Professional responsibility: The role of the engineer in society , 1997 .

[33]  John P. Sullins When Is a Robot a Moral Agent , 2006 .

[34]  Weihua Li,et al.  A review of drug delivery systems for capsule endoscopy. , 2014, Advanced drug delivery reviews.

[35]  Marion Hersh,et al.  Ethical Engineering: Definitions, Theories and Techniques , 2015 .

[36]  G. Stalk Time-The Next Source of Competitive Advantage , 1988 .

[37]  Lindsay J Robertson,et al.  Identifying and reducing technological contributions to end-user vulnerability , 2017 .

[38]  Fred Emery Designing Socio-Technical Systems for Greenfield Sites , 1993 .

[39]  Michael J. Muller,et al.  Participatory design: the third space in HCI , 2002 .

[40]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[41]  Yi Yu,et al.  Fuzzy risk mode and effect analyasis based on raw driving data for pay-how-you-drive vehicle insurance , 2016, 2016 IEEE International Conference on Big Data Analysis (ICBDA).

[42]  J. Stilgoe,et al.  Developing a framework for responsible innovation* , 2013, The Ethics of Nanotechnology, Geoengineering and Clean Energy.

[43]  W. W. Royce,et al.  Managing the development of large software systems , 1970 .

[44]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[45]  Albert B. Cherns,et al.  The Principles of Sociotechnical Design , 1976 .

[46]  Pieter Jan Stappers,et al.  Co-creation and the new landscapes of design , 2008 .

[47]  I. Kant,et al.  Grounding for the metaphysics of morals ; with, On a supposed right to lie because of philanthropic concerns , 1993 .

[48]  Katina Michael,et al.  Implantable Medical Device Tells All: Uberveillance Gets to the Heart of the Matter , 2017, IEEE Consumer Electronics Magazine.

[49]  Enid Mumford,et al.  A Socio-Technical Approach to Systems Design , 2000, Requirements Engineering.

[50]  Michael Fisher,et al.  Towards Verifiably Ethical Robot Behaviour , 2015, AAAI Workshop: AI and Ethics.

[51]  Hui-Min Huang,et al.  Autonomy Levels for Unmanned Systems (ALFUS) Framework Volume I: Terminology Version 2.0 , 2004 .

[52]  A. Chakrabarti,et al.  Innovation Speed: A Conceptual Model of Context, Antecedents, and Outcomes , 1996 .

[53]  Noëmi Manders-Huits,et al.  What Values in Design? The Challenge of Incorporating Moral Values into Design , 2010, Sci. Eng. Ethics.

[54]  Katina Michael,et al.  RFID: Helpful New Technology or Threat to Privacy and Civil Liberties? , 2015, IEEE Potentials.

[55]  Pieter Jan Stappers,et al.  Contextmapping: experiences from practice , 2005 .

[56]  Kajsa Lindberg,et al.  Participatory Design with Preschool Children: A Smartphone Application Concept , 2014 .

[57]  Allison Druin,et al.  Working with young children as technology design partners , 2005, CACM.

[58]  Finn Kensing,et al.  Participatory Design: Issues and Concerns , 2004, Computer Supported Cooperative Work (CSCW).

[59]  W. Pasmore,et al.  Sociotechnical Systems: A North American Reflection on Empirical Studies of the Seventies , 1982 .

[60]  Robert R. Hoffman,et al.  Bridging the Ethical Gap: From Human Principles to Robot Instructions , 2016, IEEE Intelligent Systems.

[61]  Sarah Spiekermann IEEE P7000? The First Global Standard Process for Addressing Ethical Concerns in System Design , 2017 .

[62]  Per-Anders Hillgren,et al.  Participatory design and "democratizing innovation" , 2010, PDC '10.

[63]  Keith W. Miller,et al.  This “Ethical Trap” Is for Roboticists, Not Robots: On the Issue of Artificial Agent Ethical Decision-Making , 2017, Sci. Eng. Ethics.

[64]  Eigil Samset,et al.  Collaborative co-design of emerging multi-technologies for surgery , 2011, J. Biomed. Informatics.

[65]  Katina Michael Can Good Standards Propel Unethical Technologies? [Editorial] , 2016, IEEE Technol. Soc. Mag..

[66]  Lindsay Robertson,et al.  A theory of exposure: Measuring technology system end user vulnerabilities , 2017, 2017 IEEE International Symposium on Technology and Society (ISTAS).

[67]  K. Chayama,et al.  Computer-aided diagnosis of colorectal polyp histology by using a real-time image recognition system and narrow-band imaging magnifying colonoscopy. , 2016, Gastrointestinal endoscopy.

[68]  Katina Michael,et al.  Assessing technology system contributions to urban dweller vulnerabilities , 2017 .

[69]  Marialena Vagia,et al.  A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed? , 2016, Applied ergonomics.

[70]  Louis Anthony Cox,et al.  What's Wrong with Risk Matrices? , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[71]  Julie Beugin,et al.  Toward an Application Guide for Safety Integrity Level Allocation in Railway Systems , 2018, Risk analysis : an official publication of the Society for Risk Analysis.