Probabilistic active filtering with gaussian processes for occluded object search in clutter

This paper proposes a Gaussian process model-based probabilistic active learning approach for occluded object search in clutter. Due to heavy occlusions, an agent must be able to gradually reduce uncertainty during the observations of objects in its workspace by systematically rearranging them. In this work, we apply a Gaussian process to capture the uncertainties of both system dynamics and observation function. Robot manipulation is optimized by mutual information that naturally indicates the potential of moving one object to search for new objects based on the predicted uncertainties of two models. An active learning framework updates the state belief based on sensor observations. We validated our proposed method in a simulation robot task. The results demonstrate that with samples generated by random actions, the proposed method can learn intelligent object search behaviors while iteratively converging its predicted state to the ground truth.

[1]  Li-Chen Fu,et al.  Planning on searching occluded target object with a mobile robot manipulator , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Gamini Dissanayake,et al.  Active recognition and pose estimation of household objects in clutter , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Tamim Asfour,et al.  Manipulation Planning Among Movable Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  David Hsu,et al.  Act to See and See to Act: POMDP planning for objects search in clutter , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[6]  Atsuo Takanishi,et al.  Placing and scheduling many depth sensors for wide coverage and efficient mapping in versatile legged robots , 2020, Int. J. Robotics Res..

[7]  Mark H. Overmars,et al.  An Effective Framework for Path Planning Amidst Movable Obstacles , 2006, WAFR.

[8]  Yang Yang,et al.  A Deep Learning Approach to Grasping the Invisible , 2020, IEEE Robotics and Automation Letters.

[9]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[10]  Davide Scaramuzza,et al.  An information gain formulation for active volumetric 3D reconstruction , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  Dinesh Manocha,et al.  Path Planning among Movable Obstacles: A Probabilistically Complete Approach , 2008, WAFR.

[13]  Wolfram Burgard,et al.  Learning to Singulate Objects using a Push Proposal Network , 2017, ISRR.

[14]  Gordon Cheng,et al.  Tactile-based active object discrimination and target object search in an unknown workspace , 2018, Autonomous Robots.

[15]  Gaurav S. Sukhatme,et al.  Interactive environment exploration in clutter , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Siddhartha S. Srinivasa,et al.  A Planning Framework for Non-Prehensile Manipulation under Clutter and Uncertainty , 2012, Autonomous Robots.

[17]  C. Rasmussen,et al.  Gaussian Process Priors with Uncertain Inputs - Application to Multiple-Step Ahead Time Series Forecasting , 2002, NIPS.

[18]  Siddhartha S. Srinivasa,et al.  Object search by manipulation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Uwe D. Hanebeck,et al.  Analytic moment-based Gaussian process filtering , 2009, ICML '09.

[20]  Jaime Valls Miró,et al.  Gaussian processes autonomous mapping and exploration for range-sensing mobile robots , 2016, Autonomous Robots.

[21]  Takamitsu Matsubara,et al.  Reinforcement Learning Boat Autopilot: A Sample-efficient and Model Predictive Control based Approach , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Sethu Vijayakumar,et al.  Active Sequential Learning with Tactile Feedback , 2010, AISTATS.

[23]  Joni Pajarinen,et al.  Robotic manipulation in object composition space , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Marc Peter Deisenroth,et al.  Efficient reinforcement learning using Gaussian processes , 2010 .

[25]  Christopher Amato,et al.  Online Planning for Target Object Search in Clutter under Partial Observability , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[26]  Abhinav Gupta,et al.  Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[29]  Takamitsu Matsubara,et al.  Probabilistic Active Filtering for Object Search in Clutter , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[30]  Gregory D. Hager,et al.  Visual Robot Task Planning , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[31]  Takamitsu Matsubara,et al.  Object manifold learning with action features for active tactile object recognition , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.