Adaptive Shared Autonomy between Human and Robot to Assist Mobile Robot Teleoperation

Mobile robot teleoperation has been widely employed when it is impractical or infeasible for humans to be present, yet still requires human judgment and decision-making skills. However, it is frustrating and stressful for human beings to merely simply teleoperate a robot without assistance due to time delay and absence of Situational Awareness (SA). On the other hand, fully autonomous robots, despite recent achievements, cannot yet execute tasks alone based on the current perception and control models. Consequently, both the human and the robot have to remain in the control loop, simultaneously contributing intelligence to the task executions, i.e. the human has to share autonomy with the robot during operation. But the challenge is how to best coordinate the two sources of intelligence from the human and the robot, to guarantee a safe and efficient task execution in remote. Therefore, a novel strategy is proposed in this thesis. It models the user intention as a contextual task to complete an action primitive, and provides appropriate motion assistance to the human operator upon the task recognition. In this way, the robot copes intelligently with the on-going tasks based on the contextual information, relieves the workload of the human operator and improves the task performance. To implement this strategy and account for the uncertainties in acquiring and processing environment information and user input, i.e. the contextual information, a probabilistic shared autonomy framework is presented to infer the contextual task the human operator performs with uncertainty measurements, and appropriately assist the human operator with the task execution according to these measurements. Since the way the human operator performs a task is implicit, it is non-trivial to model the motion pattern of the task process manually, thus a set of data-driven approaches are adopted to derive the policies of various task executions from human demonstrations, to adapt to the needs of the human operator in an intuitive way over long time. The feasibility and scalability of the proposed framework and techniques have been extensively evaluated in a variety of experiments both in simulation and on real mobile robot. With the proposed approaches, the teleoperator can be actively and appropriately assisted by increasing the cognition capability and the autonomy flexibility of the robot.

[1]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[2]  Cristina Urdiales,et al.  Efficiency based reactive shared control for collaborative human/robot navigation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Daniel Leidner,et al.  A knowledge-driven shared autonomy human-robot interface for tablet computers , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[4]  Long Cheng,et al.  Shared control for teleoperation enhanced by autonomous obstacle avoidance of robot manipulator , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[6]  Oskar von Stryk,et al.  Comprehensive Simulation of Quadrotor UAVs Using ROS and Gazebo , 2012, SIMPAR.

[7]  Dongjun Lee,et al.  Bilateral teleoperation of a wheeled mobile robot over delayed communication network , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Benjamin Pitzer,et al.  Towards perceptual shared autonomy for robotic mobile manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Robert Platt,et al.  Extracting User Intent in Mixed Initiative Teleoperator Control , 2004 .

[10]  Ming Liu,et al.  Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why not , 2016, ArXiv.

[11]  Sterling J. Anderson,et al.  The intelligent copilot: A constraint-based approach to shared-adaptive control of ground vehicles , 2013, IEEE Intelligent Transportation Systems Magazine.

[12]  Pierre-Yves Oudeyer,et al.  Incremental local online Gaussian Mixture Regression for imitation learning of multiple tasks , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[14]  Gregory D. Hager,et al.  Transition State Clustering: Unsupervised Surgical Trajectory Segmentation for Robot Learning , 2017, ISRR.

[15]  Michael A. Goodrich,et al.  Ecological Interfaces for Improving Mobile Robot Teleoperation , 2007, IEEE Transactions on Robotics.

[16]  Daniel Cremers,et al.  Active Online Learning for Interactive Segmentation Using Sparse Gaussian Processes , 2014, GCPR.

[17]  Roland Siegwart,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Brain-coupled Interaction for Semi-autonomous Navigation of an Assistive Robot , 2022 .

[18]  Robert D. Howe,et al.  Cooperative Human and Machine Perception in Teleoperated Assembly , 2000, ISER.

[19]  Brenan J. McCarragher,et al.  Human integration into robot control utilising potential fields , 1997, Proceedings of International Conference on Robotics and Automation.

[20]  Sterling J. Anderson,et al.  Experimental Performance Analysis of a Homotopy-Based Shared Autonomy Framework , 2014, IEEE Transactions on Human-Machine Systems.

[21]  Zhao Wang,et al.  How Autonomy Impacts Performance and Satisfaction: Results From a Study With Spinal Cord Injured Subjects Using an Assistive Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Oussama Khatib,et al.  Elastic bands: connecting path planning and control , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[23]  Kris K. Hauser,et al.  Recognition, prediction, and planning for assisted teleoperation of freeform tasks , 2012, Autonomous Robots.

[24]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[25]  Robert R. Burridge,et al.  Using prediction to enhance remote robot supervision across time delay , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Hung T. Nguyen,et al.  Shared control strategies for obstacle avoidance tasks in an intelligent wheelchair , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Daniel H. Grollman,et al.  Incremental learning of subtasks from unsegmented demonstration , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Dawn M. Tilbury,et al.  Blending of human and obstacle avoidance control for a high speed mobile robot , 2014, 2014 American Control Conference.

[29]  Danica Kragic,et al.  Layered HMM for Motion Intention Recognition , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  S P Levine,et al.  The NavChair Assistive Wheelchair Navigation System. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[31]  Hendrik Van Brussel,et al.  User-adapted plan recognition and user-adapted shared control: A Bayesian approach to semi-autonomous wheelchair driving , 2008, Auton. Robots.

[32]  Ufuk Topcu,et al.  Pareto efficiency in synthesizing shared autonomy policies with temporal logic constraints , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Curry Guinn,et al.  Mixed-initiative interaction , 1999 .

[34]  Rudolph Triebel,et al.  Knowing when we don't know: Introspective classification for mission-critical decision making , 2013, 2013 IEEE International Conference on Robotics and Automation.

[35]  Rudolph Triebel,et al.  Driven Learning for Driving: How Introspection Improves Semantic Mapping , 2016, ISRR.

[36]  Christiaan J. J. Paredis,et al.  Interactive Multimodal Robot Programming , 2005, Int. J. Robotics Res..

[37]  Daniel H. Grollman,et al.  Dogged Learning for Robots , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[38]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[39]  Gregory D. Hager,et al.  Spatial motion constraints: theory and demonstrations for robot guidance using virtual fixtures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[40]  Steven Eric Vozar,et al.  A Framework for Improving the Speed and Performance of Teleoperated Mobile Manipulators. , 2013 .

[41]  Cristina Urdiales,et al.  Efficiency based modulation for wheelchair driving collaborative control , 2010, 2010 IEEE International Conference on Robotics and Automation.

[42]  Hendrik Van Brussel,et al.  Bayesian plan recognition and shared control under uncertainty: assisting wheelchair drivers by tracking fine motion paths , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  S. Hellbach,et al.  Tell Me Where I Am : A Fundament for a Semantic Labeling Approach , 2012 .

[44]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[45]  Terrence Fong,et al.  Vehicle Teleoperation Interfaces , 2001, Auton. Robots.

[46]  Eric Rohmer,et al.  A novel platform supporting multiple control strategies for assistive robots , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[47]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[48]  Wenzhe Li,et al.  Room segmentation: Survey, implementation, and analysis , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[49]  François Michaud,et al.  Telepresence Robot for Home Care Assistance , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[50]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[51]  Scott Niekum,et al.  Learning and generalization of complex tasks from unstructured demonstrations , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Antonio Franchi,et al.  Interactive planning of persistent trajectories for human-assisted navigation of mobile robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[54]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[55]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[56]  Antonio Franchi,et al.  Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVs , 2012, IEEE Robotics & Automation Magazine.

[57]  Dawn M. Tilbury,et al.  Predicting Human Performance During Teleoperation , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[58]  Cristina Urdiales,et al.  A New Efficiency-Weighted Strategy for Continuous Human/Robot Cooperation in Navigation , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[59]  Danica Kragic,et al.  Adaptive Virtual Fixtures for Machine-Assisted Teleoperation Tasks , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[60]  Kazuya Yoshida,et al.  Shared autonomy system for tracked vehicles to traverse rough terrain based on continuous three-dimensional terrain scanning , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Tim D. Barfoot,et al.  Learning to assess terrain from human demonstration using an introspective Gaussian-process classifier , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[62]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[63]  Yiannis Demiris,et al.  Human-wheelchair collaboration through prediction of intention and adaptive assistance , 2008, 2008 IEEE International Conference on Robotics and Automation.

[64]  M. Nuttin,et al.  Global Dynamic Window Approach for Arbitrarily Shaped Holonomic and Non-holonomic Mobile Robots , 2008 .

[65]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[66]  Matt Duckham,et al.  Trajectory similarity measures , 2015, SIGSPACIAL.

[67]  Ming Gao,et al.  Local contextual trajectory estimation with demonstration for assisting mobile robot teleoperation , 2017, 2017 European Conference on Mobile Robots (ECMR).

[68]  Kui Wang,et al.  A haptic shared control algorithm for flexible human assistance to semi-autonomous robots , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[69]  Philippe Chevrel,et al.  Shared Steering Control Between a Driver and an Automation: Stability in the Presence of Driver Behavior Uncertainty , 2013, IEEE Transactions on Intelligent Transportation Systems.

[70]  Hendrik Van Brussel,et al.  Bayesian Estimation of Wheelchair Driver Intents: Modeling Intents as Geometric Paths Tracked by the Driver , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[71]  Keng Peng Tee,et al.  Role adaptation of human and robot in collaborative tasks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[72]  Michael A. Goodrich,et al.  Characterizing efficiency of human robot interaction: a case study of shared-control teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[74]  Yiannis Demiris,et al.  Increasing robotic wheelchair safety with collaborative control: Evidence from secondary task experiments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[75]  Gao Ming,et al.  Contextual Task Recognition to Assist Mobile Robot Teleoperation with Introspective Estimation Using Gaussian Process , 2016 .

[76]  Pradip Sheth,et al.  User intent in a shared control framework for pedestrian mobility aids , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[77]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[78]  Kai-Tai Song,et al.  Design and experimental study of a shared-controlled omnidirectional mobile platform , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[79]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[80]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[81]  Alexei Makarenko,et al.  Shared environment representation for a human‐robot team performing information fusion , 2007, J. Field Robotics.

[82]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[83]  S. P. Levine,et al.  Voice control of a powered wheelchair , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[84]  Christian Mandel,et al.  Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[85]  Alessandro Saffiotti,et al.  A virtual sensor for room detection , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[86]  Thomas Schamm,et al.  Multiple Contextual Task Recognition for Sharing Autonomy to Assist Mobile Robot Teleoperation , 2015, ICIRA.

[87]  Hendrik Van Brussel,et al.  Probabilistic approach to recognize local navigation plans by fusing past driving information with a personalized user model , 2013, 2013 IEEE International Conference on Robotics and Automation.

[88]  Brian A. Weiss,et al.  Test arenas and performance metrics for urban search and rescue robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[89]  Ralf Kohlhaas,et al.  Contextual learning and sharing autonomy to assist mobile robot by trajectory prediction , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[90]  Markus Lienkamp,et al.  Human-machine interaction as key technology for driverless driving - A trajectory-based shared autonomy control approach , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[91]  Vijay Kumar,et al.  Usability Study of a Control Framework for an Intelligent Wheelchair , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[92]  Torsten Bertram,et al.  Integrated online trajectory planning and optimization in distinctive topologies , 2017, Robotics Auton. Syst..

[93]  Thomas Schamm,et al.  Shared autonomy for assisted mobile robot teleoperation by recognizing operator intention as contextual task , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[94]  Steven Dubowsky,et al.  An Adaptive Shared Control System for an Intelligent Mobility Aid for the Elderly , 2003, Auton. Robots.

[95]  Bharath Sankaran,et al.  Failure recovery with shared autonomy , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[96]  Vijay Kumar,et al.  Incorporating user inputs in motion planning for a smart wheelchair , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[97]  Robin R. Murphy,et al.  Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[98]  Yiannis Demiris,et al.  Learning assistance by demonstration , 2015, J. Hum. Robot Interact..

[99]  Hema Swetha Koppula,et al.  Car that Knows Before You Do: Anticipating Maneuvers via Learning Temporal Driving Models , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[100]  Erik B. Sudderth,et al.  Memoized Online Variational Inference for Dirichlet Process Mixture Models , 2013, NIPS.

[101]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[102]  Redwan Alqasemi,et al.  Telemanipulation Assistance Based on Motion Intention Recognition , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[103]  Torsten Bertram,et al.  Scenario and context specific visual robot behavior learning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[104]  Rüdiger Dillmann,et al.  Sharing of control between an interactive shopping robot and it's user in collaborative tasks , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[105]  Abhishek Gupta,et al.  Shared Control in Haptic Systems for Performance Enhancement and Training , 2006 .

[106]  Meel Velliste,et al.  Generalized virtual fixtures for shared-control grasping in brain-machine interfaces , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[107]  Scott Kuindersma,et al.  Director: A User Interface Designed for Robot Operation with Shared Autonomy , 2017, J. Field Robotics.

[108]  Ricardo Chavarriaga,et al.  The birth of the brain-controlled wheelchair , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[109]  Pradeep K. Khosla,et al.  Learning by observation with mobile robots: a computational approach , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[110]  Allison M. Okamura,et al.  Recognition of operator motions for real-time assistance using virtual fixtures , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[111]  Yiannis Demiris,et al.  Collaborative Control for a Robotic Wheelchair: Evaluation of Performance, Attention, and Workload , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[112]  Kazuya Yoshida,et al.  Lunar Micro Rover Design for Exploration through Virtual Reality Tele-operation , 2013, FSR.

[113]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[114]  Bernhard Weber,et al.  Assistance for telepresence using online grasp planning , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[115]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[116]  Gerard Lacey,et al.  Context-Aware Shared Control of a Robot Mobility Aid for the Elderly Blind , 2000, Int. J. Robotics Res..

[117]  Klaus Landzettel,et al.  Multisensory shared autonomy and tele-sensor-programming-Key issues in the space robot technology experiment ROTEX , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[118]  Thomas Schamm,et al.  Contextual task-aware shared autonomy for assistive mobile robot teleoperation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[119]  Terrence Fong,et al.  Advanced Interfaces for Vehicle Teleoperation: Collaborative Control, Sensor Fusion Displays, and Remote Driving Tools , 2001, Auton. Robots.

[120]  Alexei Makarenko,et al.  Human-robot communication for collaborative decision making - A probabilistic approach , 2010, Robotics Auton. Syst..

[121]  Gregory Dudek,et al.  Trust-driven interactive visual navigation for autonomous robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[122]  Daniel H. Grollman,et al.  Teaching Old Dogs New Tricks: Incremental Multimap Regression for Interactive Robot Learning from Demonstration , 2010 .

[123]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[124]  C. Caltagirone,et al.  Adaptive collaborative assistance for wheelchair driving via CBR learning , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[125]  Siddhartha S. Srinivasa,et al.  Shared Autonomy via Hindsight Optimization , 2015, Robotics: Science and Systems.

[126]  Jingchuan Wang,et al.  Dynamic shared control for human-wheelchair cooperation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[127]  Scott Niekum,et al.  Incremental Semantically Grounded Learning from Demonstration , 2013, Robotics: Science and Systems.

[128]  Jaime Valls Miró,et al.  POMDP-based long-term user intention prediction for wheelchair navigation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[129]  José del R. Millán,et al.  Evaluation of proportional and discrete shared control paradigms for low resolution user inputs , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[130]  Trevor Darrell,et al.  Gaussian Processes for Object Categorization , 2010, International Journal of Computer Vision.

[131]  Alexei Makarenko,et al.  Measuring human-robot team effectiveness to determine an appropriate autonomy level , 2008, 2008 IEEE International Conference on Robotics and Automation.

[132]  Matthew Derry,et al.  Using machine learning to blend human and robot controls for assisted wheelchair navigation , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[133]  Cristina Urdiales,et al.  Navigation skills based profiling for collaborative wheelchair control , 2011, 2011 IEEE International Conference on Robotics and Automation.

[134]  Rustam Stolkin,et al.  Experimental analysis of a variable autonomy framework for controlling a remotely operating mobile robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[135]  Alessandro Saffiotti,et al.  Extracting topology-based maps from gridmaps , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[136]  D. Massart,et al.  The Mahalanobis distance , 2000 .

[137]  Yen-Chen Liu,et al.  Experiments on Human-in-the-Loop Coordination for Multirobot System With Task Abstraction , 2015, IEEE Transactions on Automation Science and Engineering.

[138]  Javier Minguez,et al.  A Telepresence Mobile Robot Controlled With a Noninvasive Brain–Computer Interface , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[139]  Paul Newman,et al.  Semantic categorization of outdoor scenes with uncertainty estimates using multi-class gaussian process classification , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[140]  Zhikun Wang,et al.  Intention Inference and Decision Making with Hierarchical Gaussian Process Dynamics Models , 2013 .

[141]  R. Brent Gillespie,et al.  Sharing Control Between Humans and Automation Using Haptic Interface: Primary and Secondary Task Performance Benefits , 2005, Hum. Factors.

[142]  Jian Peng,et al.  Extraction of salient features for mobile robot navigation via teleoperation , 2005, Proceedings of the 2005, American Control Conference, 2005..

[143]  Martin Buss,et al.  Design and Evaluation of a Haptic Computer-Assistant for Telemanipulation Tasks , 2013, IEEE Transactions on Human-Machine Systems.

[144]  Dejan Pangercic,et al.  Context aware shared autonomy for robotic manipulation tasks , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[145]  Huanran Wang,et al.  Adaptive Shared Control for a Novel Mobile Assistive Robot , 2014, IEEE/ASME Transactions on Mechatronics.

[146]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[147]  Eung-Hyuk Lee,et al.  Implementation of an intelligent walking assistant robot for the elderly in outdoor environment , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[148]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[149]  Ingemar J. Cox,et al.  Autonomous Robot Vehicles , 1990, Springer New York.

[150]  Narendra Ahuja,et al.  A potential field approach to path planning , 1992, IEEE Trans. Robotics Autom..

[151]  Stefan Schaal,et al.  A Library for Locally Weighted Projection Regression , 2008, J. Mach. Learn. Res..

[152]  Mike McDonald,et al.  Advanced Driver Assistance Systems from Autonomous to Cooperative Approach , 2008 .

[153]  Gregory Dudek,et al.  Adaptive Parameter EXploration (APEX): Adaptation of robot autonomy from human participation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[154]  Allison M. Okamura,et al.  A paced shared-control teleoperated architecture for supervised automation of multilateral surgical tasks , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[155]  Ziyuan Liu,et al.  Extracting semantic indoor maps from occupancy grids , 2014, Robotics Auton. Syst..

[156]  Jingchuan Wang,et al.  A control system of driver assistance and human following for smart wheelchair , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[157]  Thomas Schamm,et al.  Online and incremental contextual task learning and recognition for sharing autonomy to assist mobile robot teleoperation , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[158]  Danica Kragic,et al.  Motion intention recognition in robot assisted applications , 2008, Robotics Auton. Syst..

[159]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[160]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[161]  José del R. Millán,et al.  The role of shared-control in BCI-based telepresence , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[162]  Klaus Landzettel,et al.  Multisensory Shared Autonomy - A Key Issue In The Space Robot Technology Experiment ROTEX , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[163]  Hendrik Van Brussel,et al.  A model-based, probabilistic framework for plan recognition in shared wheelchair control: experiments and evaluation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[164]  Robin R. Murphy,et al.  Mobile robots in mine rescue and recovery , 2009, IEEE Robotics & Automation Magazine.

[165]  Antonio Franchi,et al.  Semi-autonomous trajectory generation for mobile robots with integral haptic shared control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[166]  H. Sung Gaussian Mixture Regression and Classification , 2004 .

[167]  Monica N. Nicolescu,et al.  Understanding human intentions via Hidden Markov Models in autonomous mobile robots , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[168]  Ralf Kohlhaas,et al.  Unsupervised Contextual Task Learning and Recognition for Sharing Autonomy to Assist Mobile Robot Teleoperation , 2016, ICINCO.

[169]  C. Urdiales,et al.  Efficiency based collaborative control modulated by biometrics for wheelchair assisted navigation , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[170]  Kazuya Yoshida,et al.  Shared autonomy system for tracked vehicles on rough terrain based on continuous three‐dimensional terrain scanning , 2011, J. Field Robotics.

[171]  Yiannis Demiris,et al.  When and how to help: An iterative probabilistic model for learning assistance by demonstration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[172]  Luis Vaz,et al.  Wheelchair navigation assisted by Human-Machine shared-control and a P300-based Brain Computer Interface , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[173]  Peter I. Corke,et al.  Inspection of Pole-Like Structures Using a Visual-Inertial Aided VTOL Platform with Shared Autonomy , 2015, Sensors.

[174]  Gamini Dissanayake,et al.  Models of motion patterns for mobile robotic systems , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[175]  David V. Pynadath,et al.  Adjustable Autonomy for the Real World , 2003 .

[176]  Takayuki Kanda,et al.  How do people walk side-by-side? — Using a computational model of human behavior for a social robot , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[177]  Alberto Elfes,et al.  Multi-Level Autonomy Robot Telesupervision , 2008 .

[178]  Eric Fritzinger,et al.  Learning behavior fusion from demonstration , 2008 .

[179]  Magdalena D. Bugajska,et al.  Building a Multimodal Human-Robot Interface , 2001, IEEE Intell. Syst..

[180]  Terrence Fong,et al.  Robot, asker of questions , 2003, Robotics Auton. Syst..

[181]  Hung T. Nguyen,et al.  Adaptive shared control strategies based in the Bayesian recursive technique in an intelligent wheelchair , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[182]  Trevor Darrell,et al.  TSC-DL: Unsupervised trajectory segmentation of multi-modal surgical demonstrations with Deep Learning , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[183]  Petros Maragos,et al.  Hidden Markov modeling of human normal gait using laser range finder for a mobility assistance robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[184]  Hendrik Van Brussel,et al.  Online user modeling with Gaussian Processes for Bayesian plan recognition during power-wheelchair steering , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[185]  O.C. Jenkins,et al.  Fusing robot behaviors for human-level tasks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[186]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..

[187]  Ahmad Lotfi,et al.  Teleoperation through eye gaze (TeleGaze): A multimodal approach , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[188]  Antonio Franchi,et al.  Bilateral control of the degree of connectivity in multiple mobile-robot teleoperation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[189]  Daniel H. Grollman,et al.  Sparse incremental learning for interactive robot control policy estimation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[190]  Aude Billard,et al.  Incremental learning of gestures by imitation in a humanoid robot , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[191]  Peter I. Corke,et al.  Vertical Infrastructure Inspection Using a Quadcopter and Shared Autonomy Control , 2012, FSR.

[192]  Ming Gao,et al.  Sparse Contextual Task Learning and Classification to Assist Mobile Robot Teleoperation with Introspective Estimation , 2019, J. Intell. Robotic Syst..