Methods for collision-free arm teleoperation in clutter using constraints from 3D sensor data

We introduce CAT, a constraint-aware teleoperation method that can track continuously updating 6-DOF end-effector goals while avoiding environment collisions, self-collisions, and joint limits. Our method uses sequential quadratic programming to generate motion trajectories that obey kinematic constraints while attempting to reduce the distance to the goal with each step. Environment models are created and updated at run-time using a commodity depth camera. We compare our method to three additional teleoperation strategies, based on global motion planning, inverse kinematics, and Jacobian-transpose control. Our analysis, using a real robot in a variety of scenes, highlights the strengths of each method, and shows that the CAT method we introduce performs well over a wide range of scenarios.

[1]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[2]  Dinesh Manocha,et al.  FCL: A general purpose library for collision and proximity queries , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[4]  Alin Albu-Schaffer,et al.  Dynamic Motion Planning for Robots in Partially Unknown Environments , 2011 .

[5]  Sachin Chitta,et al.  A generic infrastructure for benchmarking motion planners , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Siddhartha S. Srinivasa,et al.  Hierarchical planning architectures for mobile manipulation tasks in indoor environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Kris K. Hauser.  On responsiveness, safety, and completeness in real-time motion planning , 2012, Auton. Robots.

[8]  Alexander Werner,et al.  Optimization-based generation and experimental validation of optimal walking trajectories for biped robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[10]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[11]  Probal Mitra,et al.  Model-mediated Telemanipulation , 2008, Int. J. Robotics Res..

[12]  Probal Mitra,et al.  Haptic Simulation of Manipulator Collisions Using Dynamic Proxies , 2007, PRESENCE: Teleoperators and Virtual Environments.

[13]  Advait Jain,et al.  Reaching in clutter with whole-arm tactile sensing , 2013, Int. J. Robotics Res..

[14]  Gerd Hirzinger,et al.  Trajectory planning for optimal robot catching in real-time , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[16]  Nicholas Roy,et al.  Assisted Teleoperation Strategies for Aggressively Controlling a Robot Arm with 2D Input , 2012 .

[17]  Stefano Chiaverini,et al.  Singularity-robust task-priority redundancy resolution for real-time kinematic control of robot manipulators , 1997, IEEE Trans. Robotics Autom..

[18]  Allison M. Okamura,et al.  Haptic Virtual Fixtures for Robot-Assisted Manipulation , 2005, ISRR.

[19]  Jean-Claude Latombe,et al.  A Single-Query Bi-Directional Probabilistic Roadmap Planner with Lazy Collision Checking , 2001, ISRR.

[20]  Martin Buss,et al.  A Survey of Environment-, Operator-, and Task-adapted Controllers for Teleoperation Systems , 2010 .

[21]  Stephen P. Boyd,et al.  CVXGEN: a code generator for embedded convex optimization , 2011, Optimization and Engineering.

[22]  Kris K. Hauser,et al.  Recognition, prediction, and planning for assisted teleoperation of freeform tasks , 2012, Autonomous Robots.

[23]  Russ Tedrake,et al.  Direct Trajectory Optimization of Rigid Body Dynamical Systems through Contact , 2012, WAFR.

[24]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[25]  J. Edward Colgate,et al.  Issues in the haptic display of tool use , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[26]  Oussama Khatib,et al.  Synthesis of Whole-Body Behaviors through Hierarchical Control of Behavioral Primitives , 2005, Int. J. Humanoid Robotics.

[27]  Yoshihiko Nakamura,et al.  Affine trajectory deformation for redundant manipulators , 2012, Robotics: Science and Systems.

[28]  John Kenneth Salisbury,et al.  Point clouds can be represented as implicit surfaces for constraint-based haptic rendering , 2012, 2012 IEEE International Conference on Robotics and Automation.

[29]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[30]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.