Intelligent Agent-Based Stimulation for Testing Robotic Software in Human-Robot Interactions

The challenges of robotic software testing extend beyond conventional software testing. Valid, realistic and interesting tests need to be generated for multiple programs and hardware running concurrently, deployed into dynamic environments with people. We investigate the use of Belief-Desire-Intention (BDI) agents as models for test generation, in the domain of human-robot interaction (HRI) in simulations. These models provide rational agency, causality, and a reasoning mechanism for planning, which emulate both intelligent and adaptive robots, as well as smart testing environments directed by humans. We introduce reinforcement learning (RL) to automate the exploration of the BDI models using a reward function based on coverage feedback. Our approach is evaluated using a collaborative manufacture example, where the robotic software under test is stimulated indirectly via a simulated human co-worker. We conclude that BDI agents provide intuitive models for test generation in the HRI domain. Our results demonstrate that RL can fully automate BDI model exploration, leading to very effective coverage-directed test generation.

[1]  Carlos Urias Munoz,et al.  Automatic Generation of Random Self-Checking Test Cases , 1983, IBM Syst. J..

[2]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[3]  Andrew Piziali,et al.  Functional verification coverage measurement and analysis , 2004 .

[4]  Insup Lee,et al.  Model-based testing and monitoring for hybrid embedded systems , 2004, Proceedings of the 2004 IEEE International Conference on Information Reuse and Integration, 2004. IRI 2004..

[5]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[6]  George J. Pappas,et al.  Hybrid Controllers for Path Planning: A Temporal Logic Approach , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[7]  Margus Veanes,et al.  Online Testing with Reinforcement Learning , 2006, FATES/RV.

[8]  Vijay Kumar,et al.  Sampling-based Algorithm for Testing and Validating Robot Controllers , 2006, Int. J. Robotics Res..

[9]  Michael Wooldridge,et al.  Programming Multi-Agent Systems in AgentSpeak using Jason (Wiley Series in Agent Technology) , 2007 .

[10]  Gary A. Bundell,et al.  Model-Based Software Component Testing: A UML-Based Approach , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[11]  Margus Veanes,et al.  Model-Based Testing of Robots with NModel , 2008 .

[12]  Lin Padgham,et al.  Automated Testing for Intelligent Agent Systems , 2009, AOSE.

[13]  Duy Cu Nguyen.  Testing Techniques for Software Agents , 2009 .

[14]  Lin Padgham,et al.  Model based testing for agent systems , 2009, AAMAS.

[15]  Mark Yim,et al.  Model-Based Programming of Modular Robots , 2010, 2010 13th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing.

[16]  Anthony G. Pipe,et al.  The BERT2 infrastructure: An integrated system for the study of human-robot interaction , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[17]  Anthony G. Pipe,et al.  The BERT 2 infrastructure : An integrated system for the study of human-robot interaction , 2010 .

[18]  Jonathan Bohren,et al.  The SMACH High-Level Executive [ROS News] , 2010 .

[19]  Steve Cousins,et al.  The SMACH High-Level Executive , 2010 .

[20]  Marie-Claude Gaudel.  Counting for Random Testing , 2011, ICTSS.

[21]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[22]  Kerstin Eder,et al.  Coverage-Directed Test Generation Automated by Machine Learning -- A Review , 2012, ACM Trans. Design Autom. Electr. Syst..

[23]  M. L. Valarmathi,et al.  Multi Agent Based Framework for Structural and Model Based Test Case Generation , 2012 .

[24]  Francesca Saglietti,et al.  Model-based Testing of Cooperating Robotic Systems using Coloured Petri Nets , 2013, DECS@SAFECOMP.

[25]  Lin Padgham,et al.  Model-Based Test Oracle Generation for Automated Unit Testing of Agent Systems , 2013, IEEE Transactions on Software Engineering.

[26]  Kerstin Eder,et al.  Towards the safety of human-in-the-loop robotics: Challenges and opportunities for safety assurance of robotic co-workers' , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[27]  Clare Dixon,et al.  Formal Verification of an Autonomous Personal Robotic Assistant , 2014, AAAI Spring Symposia.

[28]  Kerstin Eder,et al.  Verification and testing of mobile robot navigation algorithms: A case study in SPARK , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Michael Fisher,et al.  Practical verification of decision-making in agent-based autonomous systems , 2013, Automated Software Engineering.

[30]  Xinwei Gao,et al.  An empirical study of requirements-based test generation on an automobile control system , 2014, SAC.

[31]  Michael Fisher,et al.  Towards Verifiably Ethical Robot Behaviour , 2015, AAAI Workshop: AI and Ethics.

[32]  Morten Mossige,et al.  Testing robot controllers using constraint programming and continuous integration , 2015, Inf. Softw. Technol..

[33]  Anthony G. Pipe,et al.  Coverage-Driven Verification - An approach to verify code for robots that directly interact with humans , 2015, Haifa Verification Conference.

[34]  Angelo Gargantini,et al.  Using decision trees to aid algorithm selection in combinatorial interaction tests generation , 2015, 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[35]  James H. Andrews,et al.  Dynamically Testing GUIs Using Ant Colony Optimization (T) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[36]  Myra B. Cohen,et al.  Learning Combinatorial Interaction Test Generation Strategies Using Hyperheuristic Search , 2015, 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering.

[37]  Calin Belta,et al.  Optimal motion planning with temporal logic and switching constraints , 2015, 2015 European Control Conference (ECC).

[38]  Aamer Nadeem,et al.  An Approach to Model Based Testing of Multiagent Systems , 2015, TheScientificWorldJournal.

[39]  Andrew Rae,et al.  Situation coverage – a coverage criterion for testing autonomous robots , 2015 .

[40]  Anthony G. Pipe,et al.  Systematic and Realistic Testing in Simulation of Control Code for Robots in Collaborative Human-Robot Interactions , 2015, TAROS.

[41]  Nidhi Pare.  Performance Evaluation of Improving Model Based Testing Using Event Consideration for Various Designs Concepts , 2018 .