Singulation of Objects in Cluttered Environment Using Dynamic Estimation of Physical Properties

Abstract: This paper presents a scattering-based technique for object singulation in a cluttered environment. An analytical model-based control scattering approach is necessary for controlled object singulation. Controlled scattering implies achieving the desired distances between objects after collision. However, current analytical approaches are limited due to insufficient information of the physical environment properties, such as the coefficient of restitution, coefficient of friction, and masses of objects. In this paper, this limitation is overcome by introducing a technique to learn these parameters from unlabeled videos. For the analytical model, an impulse-based approach is used. A virtual world simulator is designed based on a dynamic model and the estimated physical properties of all objects in the environment. Experiments are performed in a virtual world until the targeted scattering pattern is achieved. The targeted scattering pattern implies that all objects are singulated. Finally, the desired input from the virtual world is fed to the robot manipulator to perform real-world scattering.

[1]  Ian D. Walker,et al.  Impact configurations and measures for kinematically redundant and multiple armed robot systems , 1994, IEEE Trans. Robotics Autom..

[2]  S. Srinivasa,et al.  Push-grasping with dexterous hands: Mechanics and a method , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Byung-Ju Yi,et al.  Dynamics and Impact Control of a Flying Soccer Ball , 2009 .

[4]  Byung-Ju Yi,et al.  Motion optimization of human body for impulse-based applications , 2018, Intell. Serv. Robotics.

[5]  Jiajun Wu,et al.  Physics 101: Learning Physical Object Properties from Unlabeled Videos , 2016, BMVC.

[6]  Kuan-Ting Yu,et al.  More than a million ways to be pushed. A high-fidelity experimental dataset of planar pushing , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  J. Andrew Bagnell,et al.  A convex polynomial force-motion model for planar sliding: Identification and application , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Kevin M. Lynch.  Locally controllable polygons by stable pushing , 1997, Proceedings of International Conference on Robotics and Automation.

[9]  Byung-Ju Yi,et al.  A Closed-Form Analytical Modeling of Internal Impulses With Application to Dynamic Machining Task: Biologically Inspired Dual-Arm Robotic Approach , 2018, IEEE Robotics and Automation Letters.

[10]  Jiajun Wu,et al.  Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning , 2015, NIPS.

[11]  Byung-Ju Yi,et al.  Impulse Modeling and New Impulse Measure for Human-Like Closed-Chain Manipulator , 2016, IEEE Robotics and Automation Letters.

[12]  Dieter Fox,et al.  Interactive singulation of objects from a pile , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  J. Wittenburg,et al.  Dynamics of systems of rigid bodies , 1977 .

[14]  Anca D. Dragan,et al.  Robot grasping in clutter: Using a hierarchy of supervisors for learning from demonstrations , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[15]  Siddhartha S. Srinivasa,et al.  Physics-Based Grasp Planning Through Clutter , 2012, Robotics: Science and Systems.

[16]  Adel Akbarimajd,et al.  Quasi-static object manipulation by mobile robot: Optimal motion planning using GA , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[17]  J. Andrew Bagnell,et al.  Efficient Reductions for Imitation Learning , 2010, AISTATS.

[18]  Wan Kyun Chung,et al.  Normalized impact geometry and performance index for redundant manipulators , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  A. Ruina,et al.  Planar sliding with dry friction Part 1. Limit surface and moment function , 1991 .

[20]  Stefan Schaal,et al.  Combining learned and analytical models for predicting action effects from sensory data , 2017, Int. J. Robotics Res..

[21]  James M. Rehg,et al.  Guided pushing for object singulation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Zoe Doulgeri,et al.  Human-inspired robotic grasping of flat objects , 2018, Robotics Auton. Syst..

[23]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[24]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[25]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Wolfram Burgard,et al.  Learning to Singulate Objects using a Push Proposal Network , 2017, ISRR.

[27]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[28]  Douglas Chai,et al.  Review of Deep Learning Methods in Robotic Grasp Detection , 2018, Multimodal Technol. Interact..

[29]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.