Unsupervised Contextual Task Learning and Recognition for Sharing Autonomy to Assist Mobile Robot Teleoperation

We focus on the problem of learning and recognizing contextual tasks from human demonstrations, aiming to efficiently assist mobile robot teleoperation through sharing autonomy. We present in this study a novel unsupervised contextual task learning and recognition approach, consisting of two phases. Firstly, we use Dirichlet Process Gaussian Mixture Model (DPGMM) to cluster the human motion patterns of task executions from unannotated demonstrations, where the number of possible motion components is inferred from the data itself instead of being manually specified a priori or determined through model selection. Post clustering, we employ Sparse Online Gaussian Process (SOGP) to classify the query point with the learned motion patterns, due to its superior introspective capability and scalability to large datasets. The effectiveness of the proposed approach is confirmed with the extensive evaluations on real data.

[1]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Thomas Schamm,et al.  Contextual task-aware shared autonomy for assistive mobile robot teleoperation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Terrence Fong,et al.  Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools , 2001, Auton. Robots.

[5]  Kazuya Yoshida,et al.  Shared autonomy system for tracked vehicles on rough terrain based on continuous three‐dimensional terrain scanning , 2011, J. Field Robotics.

[6]  Peter I. Corke,et al.  Inspection of Pole-Like Structures Using a Visual-Inertial Aided VTOL Platform with Shared Autonomy , 2015, Sensors.

[7]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[8]  Kris K. Hauser,et al.  Recognition, prediction, and planning for assisted teleoperation of freeform tasks , 2012, Autonomous Robots.

[9]  Gao Ming,et al.  Contextual Task Recognition to Assist Mobile Robot Teleoperation with Introspective Estimation Using Gaussian Process , 2016 .

[10]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[11]  Martin Buss,et al.  Online Intention Recognition in Computer-Assisted Teleoperation Systems , 2010, EuroHaptics.

[12]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[13]  Erik B. Sudderth,et al.  Memoized Online Variational Inference for Dirichlet Process Mixture Models , 2013, NIPS.

[14]  Rudolph Triebel,et al.  Knowing when we don't know: Introspective classification for mission-critical decision making , 2013, 2013 IEEE International Conference on Robotics and Automation.