Local contextual trajectory estimation with demonstration for assisting mobile robot teleoperation

We focus on assisting mobile robot teleoperation in a task-appropriate way, where we model the user intention as an action primitive to perform a contextual task, e.g. doorway crossing and object inspection, and provide motion assistance according to the task recognition. This paper contributes to formulating motion assistance in a data-driven manner. With the motion clusters obtained in our previous report [1], we apply a fast online Gaussian Mixture Regression (GMR) approach to the most probable motion cluster classified during operation, to estimate the local trajectory the human user intends to follow in the short term for the corresponding task execution with the recognized contextual information. To regulate the estimation accuracy, we compute the Mahalanobis distance of each estimated trajectory way point. By thresholding the distance, we can achieve the trajectory estimation within a pre-defined tolerance bound regarding the regression outliers. The experimental results from both the qualitative and quantitative tests using the real data confirmed the effectiveness and real-time performance of the proposed approach.

[1]  Hendrik Van Brussel,et al.  User-adapted plan recognition and user-adapted shared control: A Bayesian approach to semi-autonomous wheelchair driving , 2008, Auton. Robots.

[2]  Ralf Kohlhaas,et al.  Contextual learning and sharing autonomy to assist mobile robot by trajectory prediction , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[3]  Kris K. Hauser,et al.  Recognition, prediction, and planning for assisted teleoperation of freeform tasks , 2012, Autonomous Robots.

[4]  Torsten Bertram,et al.  Integrated online trajectory planning and optimization in distinctive topologies , 2017, Robotics Auton. Syst..

[5]  Matt Duckham,et al.  Trajectory similarity measures , 2015, SIGSPACIAL.

[6]  Kui Wang,et al.  A haptic shared control algorithm for flexible human assistance to semi-autonomous robots , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Yiannis Demiris,et al.  Learning assistance by demonstration , 2015, J. Hum. Robot Interact..

[8]  D. Massart,et al.  The Mahalanobis distance , 2000 .

[9]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[10]  Ralf Kohlhaas,et al.  Unsupervised Contextual Task Learning and Recognition for Sharing Autonomy to Assist Mobile Robot Teleoperation , 2016, ICINCO.

[11]  Dejan Pangercic,et al.  Context aware shared autonomy for robotic manipulation tasks , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Stefan Schaal,et al.  A Library for Locally Weighted Projection Regression , 2008, J. Mach. Learn. Res..

[13]  Thomas Schamm,et al.  Online and incremental contextual task learning and recognition for sharing autonomy to assist mobile robot teleoperation , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[14]  Scott Kuindersma,et al.  Director: A User Interface Designed for Robot Operation with Shared Autonomy , 2017, J. Field Robotics.

[15]  Kazuya Yoshida,et al.  Shared autonomy system for tracked vehicles on rough terrain based on continuous three‐dimensional terrain scanning , 2011, J. Field Robotics.

[16]  Peter I. Corke,et al.  Inspection of Pole-Like Structures Using a Visual-Inertial Aided VTOL Platform with Shared Autonomy , 2015, Sensors.

[17]  Wenzhe Li,et al.  Room segmentation: Survey, implementation, and analysis , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).