An alliance of humans and machines for machine learning: Hybrid intelligent systems and their design principles

Abstract With the growing number of applications of artificial intelligence such as autonomous cars or smart industrial equipment, the inaccuracy of utilized machine learning algorithms could lead to catastrophic outcomes. Human-in-the-loop computing combines human and machine intelligence resulting in a hybrid intelligence of complementary strengths. Whereas machines are unbeatable in logic and computation speed, humans are contributing with their creative and dynamic minds. Hybrid intelligent systems are necessary to achieve high accuracy and reliability of machine learning algorithms. In a design science research project with a Swedish manufacturing company, this paper presents an application of human-in-the-loop computing to make operational processes more efficient. While conceptualizing a Smart Power Distribution for electric industrial equipment, this research presents a set of principles to design machine-learning algorithms for hybrid intelligence. From being AI-ready as an organization to clearly focusing on the customer benefits of a hybrid intelligent system, designers need to build and strengthen the trust in the human-AI relationship to make future applications successful and reliable. With the growing trends of technological advancements and incorporation of artificial intelligence in more and more applications, the alliance of humans and machines have become even more crucial.

[1]  Freddy Lécué,et al.  Human-in-the-Loop Feature Selection , 2019, AAAI.

[2]  Donna Champion,et al.  PEArL: a systems approach to demonstrating authenticity in information systems design , 2001, J. Inf. Technol..

[3]  刘 子熠,et al.  Hybrid-augmented intelligence: collaboration and cognition , 2017, Frontiers of Information Technology & Electronic Engineering.

[4]  R. Agarwal.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[5]  Wynne W. Chin,et al.  Managing Client Dialogues During Information Systems Design to Facilitate Client Learning , 2005, MIS Q..

[6]  Richard Baskerville,et al.  What design science is not , 2008, Eur. J. Inf. Syst..

[7]  O. A. Sawy,et al.  Digital business strategy: toward a next generation of insights , 2013 .

[8]  William R. King,et al.  Alternative Designs in Informatoin System Development , 1982, MIS Q..

[9]  Ece Kamar,et al.  Directions in Hybrid Intelligence: Complementing AI Systems with Human Intelligence , 2016, IJCAI.

[10]  Paulo B. Góes,et al.  Editor's comments: design science research in top information systems journals , 2014 .

[11]  Veda C. Storey,et al.  Design science in the information systems discipline: an introduction to the special issue on design science research , 2008 .

[12]  Andreas Holzinger,et al.  Interactive machine learning: experimental evidence for the human in the algorithmic loop , 2018, Applied Intelligence.

[13]  Tao Jiang,et al.  Marine Wireless Big Data: Efficient Transmission, Related Applications, and Challenges , 2017, IEEE Wireless Communications.

[14]  Marcia S. Hagen,et al.  Do It All Wrong! Using Reverse-Brainstorming to Generate Ideas, Improve Discussions, and Move Students to Action , 2016 .

[15]  Kai Yang,et al.  Active Learning for Wireless IoT Intrusion Detection , 2018, IEEE Wireless Communications.

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Javier Del Ser,et al.  What Lies Beneath: A Note on the Explainability of Black-box Machine Learning Models for Road Traffic Forecasting , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[18]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[19]  Jennifer Wortman Vaughan.  Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research , 2017, J. Mach. Learn. Res..

[20]  Li Li,et al.  Steps toward Parallel Intelligence , 2016 .

[21]  Chihiro Watanabe,et al.  Co-evolution between streaming and live music leads a way to the sustainable growth of music industry – Lessons from the US experiences , 2017 .

[22]  Peter Mertens,et al.  Memorandum on design-oriented information systems research , 2011, Eur. J. Inf. Syst..

[23]  Simrat Ahluwalia,et al.  Fake News Detection: A Deep Learning Approach , 2018 .

[24]  Shi Feng,et al.  What can AI do for me?: evaluating machine learning interpretations in cooperative play , 2019, IUI.

[25]  Nanning Zheng,et al.  Hybrid-augmented intelligence: collaboration and cognition , 2017, Frontiers of Information Technology & Electronic Engineering.

[26]  Kamran Mahroof,et al.  A human-centric perspective exploring the readiness towards smart warehousing: The case of a large retail distribution warehouse , 2019, Int. J. Inf. Manag..

[27]  Fabio Massimo Zanzotto.  Human-in-the-loop Artificial Intelligence , 2017, ArXiv.

[28]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[29]  Erik Stolterman,et al.  The design of information systems: parti, formats and sketching , 1999, Inf. Syst. J..

[30]  Omar El Sawy,et al.  Toward the Design of Robust Information Systems , 1989, J. Manag. Inf. Syst..

[31]  S. Abdallah,et al.  Mining government tweets to identify and predict citizens engagement , 2020 .

[32]  Andreas Holzinger,et al.  Interactive machine learning for health informatics: when do we need the human-in-the-loop? , 2016, Brain Informatics.

[33]  F. A. Stowell,et al.  ‘Soft’ systems thinking and information systems: a framework for client‐led design , 1994, Inf. Syst. J..

[34]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[35]  Jure Leskovec,et al.  Human Decisions and Machine Predictions , 2017, The quarterly journal of economics.

[36]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[37]  Monty Newborn.  Deep Blue's contribution to AI , 2004, Annals of Mathematics and Artificial Intelligence.

[38]  Andrew B. Whinston,et al.  Research Commentary: Introducing a Third Dimension in Information Systems Design - The Case for Incentive Alignment , 2001, Inf. Syst. Res..

[39]  Fabio Massimo Zanzotto.  Human-in-the-loop Artificial Intelligence , 2017, ArXiv.

[40]  Vitaliy Mezhuyev,et al.  Towards a conceptual model for examining the impact of knowledge management factors on mobile learning acceptance , 2020 .

[41]  Christian Biemann,et al.  An adaptive annotation approach for biomedical entity and relation recognition , 2016, Brain Informatics.

[42]  Dominik Dellermann,et al.  The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence Systems , 2019, HICSS.

[43]  Mario Coccia,et al.  Deep Learning Technology for Improving Cancer Care in Society: New Directions in Cancer Imaging Driven by Artificial Intelligence , 2019 .

[44]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[45]  Iyad Rahwan,et al.  Society-in-the-loop: programming the algorithmic social contract , 2017, Ethics and Information Technology.