Interactive singulation of objects from a pile

Interaction with unstructured groups of objects allows a robot to discover and manipulate novel items in cluttered environments. We present a framework for interactive singulation of individual items from a pile. The proposed framework provides an overall approach for tasks involving operation on multiple objects, such as counting, arranging, or sorting items in a pile. A perception module combined with pushing actions accumulates evidence of singulated items over multiple pile interactions. A decision module scores the likelihood of a single-item pile to a multiple-item pile based on the magnitude of motion and matching determined from the perception module. Three variations of the singulation framework were evaluated on a physical robot for an arrangement task. The proposed interactive singulation method with adaptive pushing reduces the grasp errors on non-singulated piles compared to alternative methods without the perception and decision modules. This work contributes the general pile interaction framework, a specific method for integrating perception and action plans with grasp decisions, and an experimental evaluation of the cost trade-offs for different singulation methods.

[1]  Connor Schenck,et al.  Interactive object recognition using proprioceptive and auditory feedback , 2011, Int. J. Robotics Res..

[2]  R.B. Kelley,et al.  Three vision algorithms for acquiring workpieces from bins , 1983, Proceedings of the IEEE.

[3]  Rustam Stolkin,et al.  Learning to predict how rigid objects behave under simple manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Tamim Asfour,et al.  Templates for pre-grasp sliding interactions , 2012, Robotics Auton. Syst..

[5]  H. S. Yang,et al.  Determination of the identity, position and orientation of the topmost object in a pile: Some further experiments , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[6]  Oliver Brock,et al.  Interactive segmentation for manipulation in unstructured environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Gerd Hirzinger,et al.  A surface-based Next-Best-View approach for automated 3D model completion of unknown objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Avinash C. Kak,et al.  Determination of the identity, position and orientation of the topmost object in a pile , 1986, Comput. Vis. Graph. Image Process..

[9]  Paul M. Fitzpatrick,et al.  First contact: an active vision approach to segmentation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Chi Lin,et al.  Matched Filters for Bin Picking , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Oussama Khatib,et al.  Grasping with application to an autonomous checkout robot , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  Oliver Brock,et al.  Manipulating articulated objects with interactive perception , 2008, 2008 IEEE International Conference on Robotics and Automation.

[13]  Siddhartha S. Srinivasa,et al.  A Framework for Push-Grasping in Clutter , 2011, Robotics: Science and Systems.

[14]  Dieter Fox,et al.  Manipulator and object tracking for in-hand 3D object modeling , 2011, Int. J. Robotics Res..

[15]  Wai Ho Li,et al.  Segmentation and modeling of visually symmetric objects by robot actions , 2011, Int. J. Robotics Res..

[16]  H. Wechsler,et al.  Invariant image representation: A path toward solving the bin-picking problem , 1984, ICRA.

[17]  Berthold K. P. Horn,et al.  The Mechanical Manipulation of Randomly Oriented Parts , 1984 .