A Supervised Machine Learning Approach to Operator Intent Recognition for Teleoperated Mobile Robot Navigation

In applications that involve human-robot interaction (HRI), human-robot teaming (HRT), and cooperative human-machine systems, the inference of the human partner's intent is of critical importance. This paper presents a method for the inference of the human operator's navigational intent, in the context of mobile robots that provide full or partial (e.g., shared control) teleoperation. We propose the Machine Learning Operator Intent Inference (MLOII) method, which a) processes spatial data collected by the robot's sensors; b) utilizes a supervised machine learning algorithm to estimate the operator's most probable navigational goal online. The proposed method's ability to reliably and efficiently infer the intent of the human operator is experimentally evaluated in realistically simulated exploration and remote inspection scenarios. The results in terms of accuracy and uncertainty indicate that the proposed method is comparable to another state-of-the-art method found in the literature.

[1]  R. Stolkin,et al.  A Hierarchical Variable Autonomy Mixed-Initiative Framework for Human-Robot Teaming in Mobile Robotics , 2022, 2022 IEEE 3rd International Conference on Human-Machine Systems (ICHMS).

[2]  R. Stolkin,et al.  A Negotiation-Theoretic Framework for Control Authority Transfer in Mixed-Initiative Robotic Systems , 2022, 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  G. Varoquaux,et al.  Why do tree-based models still outperform deep learning on tabular data? , 2022, ArXiv.

[4]  Rustam Stolkin,et al.  A Bayesian-Based Approach to Human Operator Intent Recognition in Remote Mobile Robot Navigation , 2021, 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  Sangsun Lee,et al.  Comparison of Machine Learning Algorithms for Predicting Lane Changing Intent , 2021 .

[6]  Y. Demiris,et al.  Disentangled Sequence Clustering for Human Intention Inference , 2021, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  M. Lagoudakis,et al.  Aerial and Ground Robot Collaboration for Autonomous Mapping in Search and Rescue Missions , 2020, Drones.

[8]  Rustam Stolkin,et al.  VFH+ based shared control for remotely operated mobile robots , 2020, 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[9]  Rustam Stolkin,et al.  Human operator cognitive availability aware Mixed-Initiative control , 2020, 2020 IEEE International Conference on Human-Machine Systems (ICHMS).

[10]  Brenna Argall,et al.  Probabilistic Human Intent Recognition for Shared Autonomy in Assistive Robotics , 2019, ACM transactions on human-robot interaction.

[11]  Rustam Stolkin,et al.  Mixed-initiative Variable Autonomy for Remotely Operated Mobile Robots , 2019, ACM Transactions on Human-Robot Interaction.

[12]  Liang Yan,et al.  Human-Robot Collaboration by Intention Recognition using Deep LSTM Neural Network , 2019, 2019 IEEE 8th International Conference on Fluid Power and Mechatronics (FPM).

[13]  Ivan Markovic,et al.  Human Intention Estimation based on Hidden Markov Model Motion Validation for Safe Flexible Robotized Warehouses , 2018, Robotics and Computer-Integrated Manufacturing.

[14]  Dario Floreano,et al.  FlyJacket: An Upper Body Soft Exoskeleton for Immersive Drone Control , 2018, IEEE Robotics and Automation Letters.

[15]  Anca D. Dragan,et al.  Goal Inference Improves Objective and Perceived Performance in Human-Robot Collaboration , 2016, AAMAS.

[16]  Ronald C. Arkin,et al.  Mixed-Initiative Human-Robot Interaction: Definition, Taxonomy, and Survey , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[17]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..

[18]  Hendrik Van Brussel,et al.  Probabilistic approach to recognize local navigation plans by fusing past driving information with a personalized user model , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Robin R. Murphy,et al.  Survey of metrics for human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  Yiannis Demiris,et al.  Human-wheelchair collaboration through prediction of intention and adaptive assistance , 2008, 2008 IEEE International Conference on Robotics and Automation.

[21]  Yiannis Demiris,et al.  Prediction of intent in robotics and multi-agent systems , 2007, Cognitive Processing.

[22]  L. Breiman Random Forests , 2001, Encyclopedia of Machine Learning and Data Mining.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..