Visually Guided Extrinsic Manipulation for Assembly Tasks

Robotic assembly requires a system that can handle a wide range of the object poses for the complexity of real-world tasks. One problem during the handling is the uncertain pose of grasped objects. Objects might be grasped differently from simulation and change significantly due to unexpected contact and collisions. In this paper, we propose a visually guided extrinsic manipulation system to tackle these problems. Extrinsic manipulation enhances simple grippers dexterity to precisely reorient objects into target poses required for the assembly tasks through the interaction with a designed extrinsic manipulation platform. Closed loop manipulation is realized through the visual feedback which is provided to the system through AR markers fixed on the object. Experiments show that the proposed system can successfully handle arbitrary initial and final poses of the grasped object, and can correct and restore the uncertain object poses.

[1]  Kensuke Harada,et al.  Teaching Robots to Do Object Assembly using Multi-modal 3D Vision , 2016, Neurocomputing.

[2]  Kyoung Mu Lee,et al.  Visual SLAM with Line and Corner Features , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Aaron M. Dollar,et al.  An underactuated hand for efficient finger-gaiting-based dexterous manipulation , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[4]  Siddhartha S. Srinivasa,et al.  Regrasping objects using extrinsic dexterity , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Philip David,et al.  SoftPOSIT: Simultaneous Pose and Correspondence Determination , 2002, ECCV.

[6]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[7]  Ernesto Damiani,et al.  Augmented reality technologies, systems and applications , 2010, Multimedia Tools and Applications.

[8]  Ian D. Reid,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems a Comparison of Loop Closing Techniques in Monocular Slam , 2022 .

[9]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[10]  Aaron M. Dollar,et al.  On dexterity and dexterous manipulation , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[11]  Kevin M. Lynch,et al.  Stable Pushing: Mechanics, Controllability, and Planning , 1995, Int. J. Robotics Res..

[12]  J. K. Salisbury,et al.  Kinematic and Force Analysis of Articulated Mechanical Hands , 1983 .

[13]  Antonio Bicchi,et al.  Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity , 2000, IEEE Trans. Robotics Autom..

[14]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[15]  Aaron M. Dollar,et al.  Precision grasping and manipulation of small objects from flat surfaces using underactuated fingers , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  Kensuke Harada,et al.  Reorientating objects with a gripping hand and a table surface , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[17]  Danica Kragic,et al.  In-hand manipulation using gravity and controlled slip , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Siddhartha S. Srinivasa,et al.  Extrinsic dexterity: In-hand manipulation with external forces , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Philip David,et al.  Simultaneous pose and correspondence determination using line features , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..