Learning reactive robot behavior for autonomous valve turning

A learning approach is proposed for the challenging task of autonomous robotic valve turning in the presence of active disturbances and uncertainties. The valve turning task comprises two phases: reaching and turning. For the reaching phase the manipulator learns how to generate trajectories to reach or retract from the target. The learning is based on a set of trajectories demonstrated in advance by the operator. The turning phase is accomplished using a hybrid force/motion control strategy. Furthermore, a reactive decision making system is devised to react to the disturbances and uncertainties arising during the valve turning process. The reactive controller monitors the changes in force, movement of the arm with respect to the valve, and changes in the distance to the target. Observing the uncertainties, the reactive system modulates the valve turning task by changing the direction and rate of the movement. A real-world experiment with a robot manipulator mounted on a movable base is conducted to show the efficiency and validity of the proposed approach.

[1]  Stjepan Bogdan,et al.  Valve turning using a dual-arm aerial manipulator , 2014 .

[2]  Konstantinos Kyriakopoulos,et al.  Persistent Autonomy: the Challenges of the PANDORA Project , 2012 .

[3]  David A. Anisi,et al.  A step-wise approach to oil and gas robotics , 2012 .

[4]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[5]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[6]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[7]  Stefan Schaal,et al.  Computational approaches to motor learning by imitation. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  Mongi A. Abidi,et al.  Autonomous robotic inspection and manipulation using multisensor feedback , 1991, Computer.

[9]  Natàlia Hurtós,et al.  ROSPlan: Planning in the Robot Operating System , 2015, ICAPS.

[10]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[11]  Antonio Bicchi,et al.  Dual Arm Impedance Control with a Compliant Humanoid : Application to a Valve Turning Task , 2014 .

[12]  Gianni Di Pillo,et al.  A New Version of the Price's Algorithm for Global Optimization , 1997, J. Glob. Optim..

[13]  Samir Kumar Das,et al.  Determination of coupled sway, roll, and yaw motions of a floating body in regular waves , 2004, Int. J. Math. Math. Sci..

[14]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[15]  Tsuneo Yoshikawa,et al.  Coordinated Dynamic Hybrid Position/Force Control for Multiple Robot Manipulators Handling One Constrained Object , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[16]  Darwin G. Caldwell,et al.  Autonomous robotic valve turning: A hierarchical learning approach , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Dmitry Berenson,et al.  Toward a user-guided manipulation framework for high-DOF robots with limited communication , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[18]  David A. Anisi,et al.  Real-world demonstration of sensor-based robotic automation in oil & gas facilities , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Oussama Khatib,et al.  Compliant motion using a mobile manipulator: an operational space formulation approach to aircraft canopy polishing , 2005, Adv. Robotics.

[20]  Darwin G. Caldwell,et al.  Towards Autonomous Robotic Valve Turning , 2015 .

[21]  Dirk P. Kroese,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation and Machine Learning , 2004 .

[22]  Lih-Yuan Deng,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning , 2006, Technometrics.