RE-centric Recommendations for the Development of Trustworthy(er) Autonomous Systems

Complying with the EU AI Act (AIA) guidelines while developing and implementing AI systems will soon be mandatory within the EU. However, practitioners lack actionable instructions to operationalise ethics during AI systems development. A literature review of different ethical guidelines revealed inconsistencies in the principles addressed and the terminology used to describe them. Furthermore, requirements engineering (RE), which is identified to foster trustworthiness in the AI development process from the early stages was observed to be absent in a lot of frameworks that support the development of ethical and trustworthy AI. This incongruous phrasing combined with a lack of concrete development practices makes trustworthy AI development harder. To address this concern, we formulated a comparison table for the terminology used and the coverage of the ethical AI principles in major ethical AI guidelines. We then examined the applicability of ethical AI development frameworks for performing effective RE during the development of trustworthy AI systems. A tertiary review and meta-analysis of literature discussing ethical AI frameworks revealed their limitations when developing trustworthy AI. Based on our findings, we propose recommendations to address such limitations during the development of trustworthy AI.

[1]  E. Prem From ethical AI frameworks to tools: a review of approaches , 2023, AI and Ethics.

[2]  E. Knauss,et al.  An investigation of challenges encountered when specifying training data and runtime monitors for safety critical ML applications , 2023, REFSQ.

[3]  E. Knauss,et al.  A Compositional Approach to Creating Architecture Frameworks with an Application to Distributed AI Systems , 2022, J. Syst. Softw..

[4]  Kaley J. Rittichier,et al.  Trustworthy Artificial Intelligence: A Review , 2022, ACM Comput. Surv..

[5]  B. Ramesh,et al.  Establishing Data Provenance for Responsible Artificial Intelligence Systems , 2022, ACM Trans. Manag. Inf. Syst..

[6]  Tin Chi Nguyen,et al.  Provenance documentation to enable explainable and trustworthy AI: A literature review , 2022, Data Intelligence.

[7]  J. Sifakis,et al.  Trustworthy Autonomous System Development , 2022 .

[8]  M. Holweg,et al.  capAI - A Procedure for Conducting Conformity Assessment of AI Systems in Line with the EU Artificial Intelligence Act , 2022, SSRN Electronic Journal.

[9]  Lakshmi Shankar Iyer,et al.  AI enabled applications towards intelligent transportation , 2021 .

[10]  Josef Baker-Brunnbauer TAII Framework for Trustworthy AI Systems , 2021 .

[11]  Yogesh Kumar Dwivedi,et al.  Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy , 2019, International Journal of Information Management.

[12]  Giancarlo Guizzardi,et al.  Trustworthiness Requirements: The Pix Case Study , 2021, ER.

[13]  Fang Chen,et al.  A Survey on Ethical Principles of AI and Implementations , 2020, 2020 IEEE Symposium Series on Computational Intelligence (SSCI).

[14]  Cansu Canca,et al.  Operationalizing AI ethics principles , 2020, Commun. ACM.

[15]  Francien Dechesne,et al.  Requirements engineering for moral considerations in algorithmic systems : RE’20 Conference Keynote , 2020, 2020 IEEE 28th International Requirements Engineering Conference (RE).

[16]  Ville Vakkuri,et al.  ECCOLA - a Method for Implementing Ethically Aligned AI Systems , 2020, 2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA).

[17]  Michael Herrmann,et al.  From Principles to Practice : An interdisciplinary framework to operationalise AI ethics , 2020 .

[18]  Alain Wegmann,et al.  On the Interplay between Requirements, Engineering, and Artificial Intelligence , 2020, REFSQ Workshops.

[19]  S. Chesterman Artificial Intelligence and the Problem of Autonomy , 2020, SSRN Electronic Journal.

[20]  Anna Jobin,et al.  The global landscape of AI ethics guidelines , 2019, Nature Machine Intelligence.

[21]  Ville Vakkuri,et al.  Implementing Ethics in AI: Initial Results of an Industrial Multiple Case Study , 2019, PROFES.

[22]  Brent Mittelstadt,et al.  Principles alone cannot guarantee ethical AI , 2019, Nature Machine Intelligence.

[23]  Luciano Floridi,et al.  From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices , 2019, Science and Engineering Ethics.

[24]  J. Shawe-Taylor,et al.  Toward AI Systems that Augment and Empower Humans by Understanding Us , our Society and the World Around Us , 2019 .

[25]  Seok-Won Lee,et al.  Non-functional Requirements Trade-Off in Self-Adaptive Systems , 2018, 2018 4th International Workshop on Requirements Engineering for Self-Adaptive, Collaborative, and Cyber Physical Systems (RESACS).

[26]  Fabiano Dalpiaz,et al.  A Roadmap for Ethics-Aware Software Engineering , 2018, 2018 IEEE/ACM International Workshop on Software Fairness (FairWare).

[27]  Christoph Kelp,et al.  Trustworthy artificial intelligence , 2023, Asian Journal of Philosophy.

[28]  Mark Woodman,et al.  Prioritization of Stakeholder Value Using Metrics , 2010, ENASE.

[29]  Brian Berenbach,et al.  Software & Systems Requirements Engineering: In Practice , 2009 .

[30]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[31]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[32]  Mark T True,et al.  Software Requirements , 2005 .

[33]  K. Glass,et al.  The legal status of clinical and ethics policies, codes, and guidelines in medical practice and research. , 2009, McGill law journal. Revue de droit de McGill.

[34]  John M. Artz,et al.  Artificial Intelligence for Society , 1987, IEEE Expert.

[35]  C. Smith,et al.  Hard Choices and Soft Law: Ethical Codes, Policy Guidelines and the Role of the Courts in Regulating Government , 1969 .