A Bayesian based Methodology for Indirect Object Search

The main goal of this paper is to propose a Bayesian based methodology for implementing robot informed search for objects. The methodology uses convolutions between observation likelihoods of secondary objects and spatial relation masks for estimating the probability map of the object being searched for, and also a search procedure that uses this probability map. A method for computing complex spatial relation masks by using a basis composed of basic relation masks and a database of co-occurrences of objects is used. Each basic relation mask corresponds to a qualitative spatial relation (QSR), such as: ‘very near’, ‘near’, or ‘far’. The search procedure takes into account the probability that the main object can be in different regions on the map and the distance to those regions. Also, the object search procedure is able to detect objects and generate new plans while moving. The proposed methodology is compared with uninformed and alternative informed search approaches using simulations and real-world experiments with a service robot. In simulations, the use of the proposed methodology increases the detection rate from 28% (direct uninformed search) to 79%, when the main object can be detected within a maximum distance of 1 meter. In the real world experiments, the use of the proposed methodology increases the detection rate from 40% (direct uninformed search) to 87% when using convolutions with soft masks, global search, and information on the positive detection of secondary objects. The detection rates obtained when using the proposed methodology are also much higher than those obtained by alternative informed search methods, both in the simulated and in the real-world experiments.

[1]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[2]  Markus Vincze,et al.  Web mining driven object locality knowledge acquisition for efficient robot behavior , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  T. Garvey Perceptual strategies for purposive vision , 1975 .

[4]  Javier Ruiz-del-Solar,et al.  Robot Head Pose Detection and Gaze Direction Determination Using Local Invariant Features , 2009, Adv. Robotics.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Ariel Felner,et al.  Theta*: Any-Angle Path Planning on Grids , 2007, AAAI.

[7]  Moritz Tenorth,et al.  RoboEarth Semantic Mapping: A Cloud Enabled Knowledge-Based Approach , 2015, IEEE Transactions on Automation Science and Engineering.

[8]  Rüdiger Dillmann,et al.  Using spatial relations of objects in real world scenes for scene structuring and scene understanding , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[9]  John K. Tsotsos,et al.  Visual search for an object in a 3D environment using a mobile robot , 2010, Comput. Vis. Image Underst..

[10]  Javier Ruiz-del-Solar,et al.  Object Recognition for Manipulation Tasks in Real Domestic Settings: A Comparative Study , 2014, RoboCup.

[11]  Chris Burbridge,et al.  Bootstrapping Probabilistic Models of Qualitative Spatial Relations for Active Visual Object Search , 2014, AAAI Spring Symposia.

[12]  Patric Jensfelt,et al.  Active Visual Object Search in Unknown Environments Using Uncertain Semantics , 2013, IEEE Transactions on Robotics.

[13]  Roland Siegwart,et al.  Cognitive maps for mobile robots - an object based approach , 2007, Robotics Auton. Syst..

[14]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[15]  Nick Hawes,et al.  Using Qualitative Spatial Relations for indirect object search , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Yiming Ye,et al.  Sensor Planning for 3D Object Search , 1999 .

[17]  Lambert E. Wixson,et al.  Using intermediate objects to improve the efficiency of visual search , 1994, International Journal of Computer Vision.

[18]  James J. Little,et al.  Automated Spatial-Semantic Modeling with Applications to Place Labeling and Informed Search , 2009, 2009 Canadian Conference on Computer and Robot Vision.

[19]  John Folkesson,et al.  Search in the real world: Active visual object search based on spatial relations , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Richard T. Vaughan,et al.  Reusable Robot Software and the Player/Stage Project , 2005, PPSDR@ICRA.

[21]  Urbano Nunes,et al.  Trainable classifier-fusion schemes: An application to pedestrian detection , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[22]  Patric Jensfelt,et al.  Object search on a mobile robot using relational spatial information , 2010 .

[23]  Gregory Dudek,et al.  Learning to generalize 3D spatial relationships , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning: An Overview , 2001, Fundam. Informaticae.

[26]  Marc Hanheide,et al.  Robot task planning and explanation in open and uncertain worlds , 2017, Artif. Intell..

[27]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[28]  Anthony G. Cohn,et al.  Reasoning about Topological and Cardinal Direction Relations Between 2-Dimensional Spatial Objects , 2014, J. Artif. Intell. Res..

[29]  Javier Ruiz-del-Solar,et al.  Bender: a general-purpose social robot with human-robot interaction capabilities , 2013, HRI 2013.

[30]  Javier Ruiz-del-Solar,et al.  Semantic Object Search Using Semantic Categories and Spatial Relations between Objects , 2013, RoboCup.

[31]  Patricio Loncomilla,et al.  A Bayesian framework for informed search using convolutions between observation likelihoods and spatial relation masks , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[32]  Javier Ruiz-del-Solar,et al.  Object recognition using local invariant features for robotic applications: A survey , 2016, Pattern Recognit..

[33]  Jos Elfring,et al.  Active Object Search Exploiting Probabilistic Object-Object Relations , 2013, RoboCup.