Preliminary study of virtual nonholonomic constraints for time-delayed teleoperation

Direct teleoperation with multisecond time-delayed telemetry between master and slave is challenging for humans to perform. When controlling a holonomic robot with many degrees of freedom, operators may incidentally provide commands in an intended direction without realizing their mistake until receiving feedback several seconds later. For some applications, imposing a virtual nonholonomic constraint (VNHC) on the motion of the end effector can help prevent operators from moving in an unintended direction by reducing the number of controllable degrees of freedom. This paper presents the development of a VNHC for a planar time-delayed telerobotic task, motivated by an on-orbit telerobotic satellite servicing operation. We also describe a nonholonomic virtual fixture (NHVF) that adheres to the VNHC to further reduce the potential for operators to input mistaken commands. We report the results of a pilot study in which teleoperation with a VNHC was found to have comparable task performance to holonomic planar teleoperation, while decreasing operator workload. The NHVF was found to decrease performance slightly, though user feedback indicated that a differently implemented virtual fixture and controller may improve performance.

[1]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[2]  Dana R. Yoerger,et al.  Teleprogramming for subsea teleoperation using acoustic communication , 1998 .

[3]  Robin Wolff,et al.  Comparing three interaction methods for manipulating thin deformable virtual objects , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[4]  Mark W. Spong,et al.  Bilateral teleoperation of a formation of nonholonomic mobile robots under constant time delay , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .

[6]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[7]  Herman Bruyninckx,et al.  Open robot control software: the OROCOS project , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[8]  Peter Kazanzides,et al.  Model-based telerobotic control with virtual fixtures for satellite servicing tasks , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  J. Edward Colgate,et al.  Cobot implementation of virtual paths and 3D virtual surfaces , 2003, IEEE Trans. Robotics Autom..

[10]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[11]  Peter Kazanzides,et al.  Experimental evaluation of force control for virtual-fixture-assisted teleoperation for on-orbit manipulation of satellite thermal blanket insulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[13]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  William R. Ferrell,et al.  Remote manipulation with transmission delay. , 1965 .

[15]  Kazuo Tanie,et al.  Human-Robot Cooperative Manipulation Using a Virtual Nonholonomic Constraint , 2002, Int. J. Robotics Res..

[16]  W. A. Watson,et al.  NASA's advanced tracking and data relay satellite system for the years 2000 and beyond , 1990 .

[17]  J. Edward Colgate,et al.  Nonholonomic haptic display , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[18]  Allison M. Okamura,et al.  Cartesian and joint space teleoperation for nonholonomic steerable needles , 2013, 2013 World Haptics Conference (WHC).

[19]  Russell H. Taylor,et al.  The Surgical Assistant Workstation Release , 2008 .

[20]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[21]  Won S. Kim,et al.  Demonstration of a high-fidelity predictive/preview display technique for telerobotic servicing in space , 1993, IEEE Trans. Robotics Autom..

[22]  Peter Kazanzides,et al.  Augmented reality environment with virtual fixtures for robotic telemanipulation in space , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[24]  Shahin Sirouspour,et al.  Maneuverability and grasping experiments in teleoperation of nonholonomic/twin-armed robots , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[25]  Gerd Hirzinger.  ROTEX - The First Space Robot Technology Experiment , 1993, ISER.

[26]  Michael A. Peshkin,et al.  A general framework for cobot control , 2001, IEEE Trans. Robotics Autom..

[27]  Gregory D. Hager,et al.  Spatial motion constraints: theory and demonstrations for robot guidance using virtual fixtures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).