Expectation: Personalized Explainable Artificial Intelligence for Decentralized Agents with Heterogeneous Knowledge

Explainable AI (XAI) has emerged in recent years as a set of techniques and methodologies to interpret and explain machine learning (ML) predictors. To date, many initiatives have been proposed. Nevertheless, current research efforts mainly focus on methods tailored to specific ML tasks and algorithms, such as image classification and sentiment analysis. However, explanation techniques are still embryotic, and they mainly target ML experts rather than heterogeneous end-users. Furthermore, existing solutions assume data to be centralised, homogeneous, and fully/continuously accessible—circumstances seldom found altogether in practice. Arguably, a system-wide perspective is currently missing. The project named “Personalized Explainable Artificial Intelligence for Decentralized Agents with Heterogeneous Knowledge” (Expectation) aims at overcoming such limitations. This manuscript presents the overall objectives and approach of the Expectation project, focusing on the theoretical and practical advance of the state of the art of XAI towards the construction of personalised explanations in spite of decentralisation and heterogeneity of knowledge, agents, and explainees (both humans or

[1]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[2]  Katia P. Sycara,et al.  Bayesian learning in negotiation , 1998, Int. J. Hum. Comput. Stud..

[3]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[4]  Paul Smolensky,et al.  Connectionist AI, symbolic AI, and the brain , 1987, Artificial Intelligence Review.

[5]  Boris A. Galitsky,et al.  Analyzing Conflicts with Concept-Based Learning , 2005, ICCS.

[6]  James H. Moor,et al.  The Nature, Importance, and Difficulty of Machine Ethics , 2006, IEEE Intelligent Systems.

[7]  Frank Dignum,et al.  An empirical study of interest-based negotiation , 2007, Autonomous Agents and Multi-Agent Systems.

[8]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[9]  Koen V. Hindriks,et al.  Opponent modelling in automated multi-issue negotiation using Bayesian learning , 2008, AAMAS.

[10]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[11]  Pinar Yolum,et al.  Ontology-Based Learning for Negotiation , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[12]  Frank Dignum,et al.  An empirical study of interest-based negotiation , 2010, Autonomous Agents and Multi-Agent Systems.

[13]  Sascha Ossowski Agreement Technologies , 2013, Law, Governance and Technology Series.

[14]  Minjie Zhang,et al.  An adaptive bilateral negotiation , 2013 .

[15]  Minjie Zhang,et al.  An Adaptive Bilateral Negotiation Model Based on Bayesian Learning , 2013, Complex Automated Negotiations.

[16]  Koen V. Hindriks,et al.  Heuristics for using CP-nets in utility-based negotiation without knowing utilities , 2014, Knowledge and Information Systems.

[17]  Catholijn M. Jonker,et al.  From problems to protocols: Towards a negotiation handbook , 2013, Decis. Support Syst..

[18]  Societal, Economic, Ethical and Legal Challenges of the Digital Revolution: From Big Data to Deep Learning, Artificial Intelligence, and Manipulative Technologies , 2015, ArXiv.

[19]  Ya'akov Gal,et al.  Algorithm selection in bilateral negotiation , 2016, Autonomous Agents and Multi-Agent Systems.

[20]  Koen V. Hindriks,et al.  Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques , 2016, Autonomous Agents and Multi-Agent Systems.

[21]  Koen V. Hindriks,et al.  An Introduction to the Pocket Negotiator: A General Purpose Negotiation Support System , 2016, EUMAS/AT.

[22]  Catholijn M. Jonker,et al.  Computers That Negotiate on Our Behalf: Major Challenges for Self-sufficient, Self-directed, and Interdependent Negotiating Agents , 2017, AAMAS Workshops.

[23]  Nei Kato,et al.  State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control Systems , 2017, IEEE Communications Surveys & Tutorials.

[24]  Koen V. Hindriks,et al.  Personalised self-explanation by robots: The role of goals versus beliefs in robot-action explanation for children and adults , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[25]  Thomas Hellström,et al.  Understandable robots - What, Why, and How , 2018, Paladyn J. Behav. Robotics.

[26]  Amina Adadi,et al.  Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI) , 2018, IEEE Access.

[27]  Mark Klein,et al.  A Machine Learning Approach for Mechanism Selection in Complex Negotiations , 2018, Journal of Systems Science and Systems Engineering.

[28]  Societal, Economic, Ethical and Legal Challenges of the Digital Revolution: From Big Data to Deep Learning, Artificial Intelligence, and Manipulative Technologies , 2018, Towards Digital Enlightenment.

[29]  Filip Karlo Dosilovic,et al.  Explainable artificial intelligence: A survey , 2018, 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[30]  Andrea Omicini,et al.  Interpretable Narrative Explanation for ML Predictors with LP: A Case Study for XAI , 2019, WOA.

[31]  Andrea Omicini,et al.  Towards XMAS: eXplainability through Multi-Agent Systems , 2019, AI&IoT@AI*IA.

[32]  Davide Calvaresi,et al.  Explainable Agents and Robots: Results from a Systematic Literature Review , 2019, AAMAS.

[33]  Franco Turini,et al.  A Survey of Methods for Explaining Black Box Models , 2018, ACM Comput. Surv..

[34]  Andrea Omicini,et al.  Neuro-symbolic Computation for XAI: Towards a Unified Model , 2020, WOA.

[35]  Andrea Omicini,et al.  On the integration of symbolic and sub-symbolic techniques for XAI: A survey , 2020, Intelligenza Artificiale.

[36]  Andrea Omicini,et al.  An Abstract Framework for Agent-Based Explanations in AI , 2020, AAMAS.

[37]  Andrea Omicini,et al.  Agent-Based Explanations in AI: Towards an Abstract Framework , 2020, EXTRAAMAS@AAMAS.

[38]  Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI , 2019, Inf. Fusion.

[39]  Davide Calvaresi,et al.  Personal Data Privacy Semantics in Multi-Agent Systems Interactions , 2020, PAAMS.

[40]  Artur d'Avila Garcez,et al.  Neural-Symbolic Integration for Fairness in AI , 2021, AAAI Spring Symposium: Combining Machine Learning with Knowledge Engineering.

[41]  Viviana Mascardi,et al.  Logic-based technologies for multi-agent systems: a systematic literature review , 2020, Autonomous Agents and Multi-Agent Systems.

[42]  Reyhan Aydoğan,et al.  Effect of Awareness of Other Side’s Gain on Negotiation Outcome, Emotion, Argument, and Bidding Behavior , 2021 .