Trustworthy, responsible, ethical AI in manufacturing and supply chains: synthesis and emerging research questions

While the increased use of AI in the manufacturing sector has been widely noted, there is little understanding on the risks that it may raise in a manufacturing organisation. Although various high level frameworks and definitions have been proposed to consolidate potential risks, practitioners struggle with understanding and implementing them. This lack of understanding exposes manufacturing to a multitude of risks, including the organisation, its workers, as well as suppliers and clients. In this paper, we explore and interpret the applicability of responsible, ethical, and trustworthy AI within the context of manufacturing. We then use a broadened adaptation of a machine learning lifecycle to discuss, through the use of illustrative examples, how each step may result in a given AI trustworthiness concern. We additionally propose a number of research questions to the manufacturing research community, in order to help guide future research so that the economic and societal benefits envisaged by AI in manufacturing are delivered safely and responsibly.

[1]  Michael Veale,et al.  Understanding accountability in algorithmic supply chains , 2023, FAccT.

[2]  Imtiaz A. Khan,et al.  Monetisation of digital health data through a GDPR-compliant and blockchain enabled digital health data marketplace: A proposal to enhance patient's engagement with health data repositories , 2023, Int. J. Inf. Manag. Data Insights.

[3]  Xinning Gui,et al.  AutoML in The Wild: Obstacles, Workarounds, and Expectations , 2023, CHI.

[4]  Jennifer Cobbe,et al.  Out of Context: Investigating the Bias and Fairness Concerns of “Artificial Intelligence as a Service” , 2023, CHI.

[5]  A. Brintrup,et al.  Federated machine learning for privacy preserving, collective supply chain risk prediction , 2023, Int. J. Prod. Res..

[6]  Amin Karimi Monsefi,et al.  Smart and collaborative industrial IoT: A federated learning and data space approach , 2023, Digit. Commun. Networks.

[7]  Zhiwei Steven Wu,et al.  Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits , 2022, FAccT.

[8]  D. Herhausen,et al.  Overcoming the pitfalls and perils of algorithms: A classification of machine learning biases and mitigation methods , 2022, Journal of Business Research.

[9]  A. Gunasekaran,et al.  Reviewing the applications of artificial intelligence in sustainable supply chains: Exploring research propositions for future directions , 2022, Business Strategy and the Environment.

[10]  C. Cottrill,et al.  From transparency to accountability of intelligent systems: Moving beyond aspirations , 2022, Data & Policy.

[11]  Kaley J. Rittichier,et al.  Trustworthy Artificial Intelligence: A Review , 2022, ACM Comput. Surv..

[12]  G. Antoniou,et al.  Mental Health Diagnosis: A Case for Explainable Artificial Intelligence , 2022, Int. J. Artif. Intell. Tools.

[13]  Moti Yung,et al.  What Did You Add to My Additive Manufacturing Data?: Steganographic Attacks on 3D Printing Files , 2021, RAID.

[14]  Alexandra Brintrup,et al.  Reinforcement Learning Provides a Flexible Approach for Realistic Supply Chain Safety Stock Optimisation , 2021, IFAC-PapersOnLine.

[15]  Patrick Mikalef,et al.  Responsible AI for Digital Health: a Synthesis and a Research Agenda , 2021, Information Systems Frontiers.

[16]  Nir Levine,et al.  Challenges of real-world reinforcement learning: definitions, benchmarks and analysis , 2021, Machine Learning.

[17]  Jatinder Singh,et al.  Artificial intelligence as a service: Legal responsibilities, liabilities, and policy challenges , 2021, Comput. Law Secur. Rev..

[18]  Jatinder Singh,et al.  Reviewable Automated Decision-Making: A Framework for Accountable Algorithmic Systems , 2021, FAccT.

[19]  Luis C. Lamb,et al.  Neurosymbolic AI: the 3rd wave , 2020, Artificial Intelligence Review.

[20]  Sophie Stalla-Bourdillon,et al.  Addressing Regulatory Requirements on Explanations for Automated Decisions with Provenance—A Case Study , 2020, Digit. Gov. Res. Pract..

[21]  Neil D. Lawrence,et al.  Challenges in Deploying Machine Learning: A Survey of Case Studies , 2020, ACM Comput. Surv..

[22]  Michelle Seng Ah Lee,et al.  The Landscape and Gaps in Open Source Fairness Toolkits , 2020, CHI.

[23]  Amit Jain,et al.  Secure and communications‐efficient collaborative prognosis , 2020, IET Collaborative Intelligent Manufacturing.

[24]  L. Floridi,et al.  The ethics of AI in health care: A mapping review. , 2020, Social science & medicine.

[25]  Ying Liu,et al.  Reinforcement learning for facilitating human-robot-interaction in manufacturing , 2020, Journal of Manufacturing Systems.

[26]  Zhe Wang,et al.  Reinforcement learning for building controls: The opportunities and challenges , 2020, Applied Energy.

[27]  Dmitry Ivanov,et al.  Bayesian networks for supply chain risk, resilience and ripple effect analysis: A literature review , 2020, Expert Systems with Applications.

[28]  Hanna M. Wallach,et al.  Fairlearn: A toolkit for assessing and improving fairness in AI , 2020 .

[29]  Peter Henderson,et al.  Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims , 2020, ArXiv.

[30]  Andrew McCallum,et al.  Energy and Policy Considerations for Modern Deep Learning Research , 2020, AAAI.

[31]  Ben Shneiderman,et al.  Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy , 2020, Int. J. Hum. Comput. Interact..

[32]  Magnus Nyström,et al.  Adversarial Machine Learning-Industry Perspectives , 2020, 2020 IEEE Security and Privacy Workshops (SPW).

[33]  Yichuan Wang,et al.  Toward an Understanding of Responsible Artificial Intelligence Practices , 2020, HICSS.

[34]  Inioluwa Deborah Raji,et al.  Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing , 2020, FAT*.

[35]  Grigoris Antoniou,et al.  Predicting supply chain risks using machine learning: The trade-off between performance and interpretability , 2019, Future Gener. Comput. Syst..

[36]  Alejandro Barredo Arrieta,et al.  Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI , 2019, Inf. Fusion.

[37]  Anna Jobin,et al.  The global landscape of AI ethics guidelines , 2019, Nature Machine Intelligence.

[38]  Alexandra Brintrup,et al.  Multi Agent System for Machine Learning Under Uncertainty in Cyber Physical Manufacturing System , 2019, SOHOMA.

[39]  Nathalie A. Smuha The EU Approach to Ethics Guidelines for Trustworthy Artificial Intelligence , 2019, Computer Law Review International.

[40]  Martin Wattenberg,et al.  The What-If Tool: Interactive Probing of Machine Learning Models , 2019, IEEE Transactions on Visualization and Computer Graphics.

[41]  Yunfeng Zhang,et al.  AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias , 2019, IBM Journal of Research and Development.

[42]  Radu Calinescu,et al.  Assuring the Machine Learning Lifecycle , 2019, ACM Comput. Surv..

[43]  Luciano Floridi,et al.  Establishing the rules for building trustworthy AI , 2019, Nature Machine Intelligence.

[44]  Thilo Hagendorff,et al.  The Ethics of AI Ethics: An Evaluation of Guidelines , 2019, Minds and Machines.

[45]  J. Guttag,et al.  A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle , 2019, EAAMO.

[46]  Nithya Sambasivan,et al.  Toward responsible AI for the next billion users , 2018, Interactions.

[47]  Markus Borg,et al.  Safely Entering the Deep: A Review of Verification and Validation for Machine Learning and a Challenge Elicitation in the Automotive Industry , 2018, Journal of Automotive Software Engineering.

[48]  G. Antoniou,et al.  Supply chain risk management and artificial intelligence: state of the art and future research directions , 2018, Int. J. Prod. Res..

[49]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[50]  David M. Eyers,et al.  Data provenance to audit compliance with privacy policy in the Internet of Things , 2017, Personal and Ubiquitous Computing.

[51]  Mike Ananny,et al.  Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability , 2018, New Media Soc..

[52]  Paul B. de Laat,et al.  Algorithmic Decision-Making Based on Machine Learning from Big Data: Can Transparency Restore Accountability? , 2017, Philosophy & Technology.

[53]  Niels Bantilan,et al.  Themis-ml: A Fairness-Aware Machine Learning Interface for End-To-End Discrimination Discovery and Mitigation , 2017, ArXiv.

[54]  Rick Salay,et al.  An Analysis of ISO 26262: Using Machine Learning Safely in Automotive Software , 2017, ArXiv.

[55]  Brendan Dolan-Gavitt,et al.  BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain , 2017, ArXiv.

[56]  Ivan Laptev,et al.  Weakly-Supervised Learning of Visual Relations , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[57]  Dimitris Plexousakis,et al.  A specification-based QoS-aware design framework for service-based applications , 2017, Service Oriented Computing and Applications.

[58]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[59]  Jochen L. Leidner,et al.  Ethical by Design: Ethics Best Practices for Natural Language Processing , 2017, EthNLP@EACL.

[60]  Mariarosaria Taddeo,et al.  The ethics of algorithms: Mapping the debate , 2016, Big Data Soc..

[61]  Sanjit A. Seshia,et al.  Towards Verified Artificial Intelligence , 2016, ArXiv.

[62]  Roxana Geambasu,et al.  FairTest: Discovering Unwarranted Associations in Data-Driven Applications , 2015, 2017 IEEE European Symposium on Security and Privacy (EuroS&P).

[63]  Cheryl Reed,et al.  Air Force Research Laboratory Test and Evaluation, Verification and Validation of Autonomous Systems Challenge Exploration , 2014 .

[64]  Rajeev Agrawal,et al.  Challenges of data integration and interoperability in big data , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[65]  Boris Motik,et al.  HermiT: An OWL 2 Reasoner , 2014, Journal of Automated Reasoning.

[66]  Dimitris Plexousakis,et al.  Fluent Calculus-Based Semantic Web Service Composition and Verification Using WSSL , 2013, ICSOC Workshops.

[67]  Dimitris Plexousakis,et al.  WSSL: A Fluent Calculus-Based Language for Web Service Specifications , 2013, CAiSE.

[68]  J. Stilgoe,et al.  Responsible research and innovation: From science in society to science for society, with society , 2012, Emerging Technologies: Ethics, Law and Governance.

[69]  Jun Du,et al.  Active Learning with Human-Like Noisy Oracle , 2010, 2010 IEEE International Conference on Data Mining.

[70]  Craig Gentry,et al.  Fully homomorphic encryption using ideal lattices , 2009, STOC '09.

[71]  Shane Legg,et al.  Universal Intelligence: A Definition of Machine Intelligence , 2007, Minds and Machines.

[72]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[73]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[74]  Cynthia Dwork,et al.  Differential Privacy , 2006, ICALP.

[75]  Brian J. Taylor,et al.  Methods and Procedures for the Verification and Validation of Artificial Neural Networks , 2005 .

[76]  J. S. St Pierre Towards Resilient Manufacturing Ecosystems Through Artificial Intelligence – Symposium Report , 2022 .

[77]  Alexandra Brintrup,et al.  Learning With Imbalanced Data in Smart Manufacturing: A Comparative Analysis , 2021, IEEE Access.

[78]  Robert Schmitt,et al.  Automated machine learning for predictive quality in production , 2020 .

[79]  Mihaela van der Schaar,et al.  Demystifying Black-box Models with Symbolic Metamodels , 2019, NeurIPS.

[80]  V. Terziyan,et al.  Industry 4.0 Intelligence under Attack : From Cognitive Hack to Data Poisoning , 2018 .

[81]  Christoph Kelp,et al.  Trustworthy artificial intelligence , 2023, Asian Journal of Philosophy.

[82]  Pieter Pauwels,et al.  Semantic web technologies in AEC industry: A literature overview , 2017 .

[83]  Siril Yella,et al.  Machine Learning Algorithms in Heavy Process Manufacturing , 2016 .

[84]  J. Reidenberg,et al.  Accountable Algorithms , 2016 .

[85]  Stephan Merz,et al.  Model Checking , 2000 .

[86]  Lawrence J. Henschen,et al.  What Is Automated Theorem Proving? , 1985, J. Autom. Reason..