Active classifier selection for RGB-D object categorization using a Markov random field ensemble method

In this work, a new ensemble method for the task of category recognition in different environments is presented. The focus is on service robotic perception in an open environment, where the robot’s task is to recognize previously unseen objects of predefined categories, based on training on a public dataset. We propose an ensemble learning approach to be able to flexibly combine complementary sources of information (different state-of-the-art descriptors computed on color and depth images), based on a Markov Random Field (MRF). By exploiting its specific characteristics, the MRF ensemble method can also be executed as a Dynamic Classifier Selection (DCS) system. In the experiments, the committee- and topology-dependent performance boost of our ensemble is shown. Despite reduced computational costs and using less information, our strategy performs on the same level as common ensemble approaches. Finally, the impact of large differences between datasets is analyzed.

[1]  Zoltan-Csaba Marton,et al.  Tutorial: Point Cloud Library: Three-Dimensional Object Recognition and 6 DOF Pose Estimation , 2012, IEEE Robotics & Automation Magazine.

[2]  Philippe Lucidarme,et al.  Object recognition based on radial basis function neural networks: Experiments with RGB-D camera embedded on mobile robots , 2012, 2012 1st International Conference on Systems and Computer Science (ICSCS).

[3]  Daphne Koller,et al.  Active Classification based on Value of Classifier , 2011, NIPS.

[4]  Dieter Fox,et al.  NEOL: Toward Never-Ending Object Learning for robots , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Fabio Roli,et al.  An approach to the automatic design of multiple classifier systems , 2001, Pattern Recognit. Lett..

[6]  Kevin Leyton-Brown,et al.  Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms , 2012, KDD.

[7]  Cristian Sminchisescu,et al.  Efficient Match Kernel between Sets of Features for Visual Recognition , 2009, NIPS.

[8]  Nico Blodow,et al.  Persistent Point Feature Histograms for 3D Point Clouds , 2008 .

[9]  Emilio Corchado,et al.  A survey of multiple classifier systems as hybrid systems , 2014, Inf. Fusion.

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Zoltan-Csaba Marton,et al.  Ensembles of strong learners for multi-cue classification , 2013, Pattern Recognit. Lett..

[12]  MalikJitendra,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001 .

[13]  Fabio Roli,et al.  Design of effective neural network ensembles for image classification purposes , 2001, Image Vis. Comput..

[14]  Marco Loog,et al.  Dissimilarity-Based Ensembles for Multiple Instance Learning , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[16]  Fabio Roli,et al.  Methods for dynamic classifier selection , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[17]  D. Kragic,et al.  2 D / 3 D Object Categorization for Task Based Grasping , 2011 .

[18]  Ching Y. Suen,et al.  Optimal combinations of pattern classifiers , 1995, Pattern Recognit. Lett..

[19]  Luiz Eduardo Soares de Oliveira,et al.  Dynamic selection of classifiers - A comprehensive review , 2014, Pattern Recognit..

[20]  Fabio Roli,et al.  Design of effective multiple classifier systems by clustering of classifiers , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[21]  Anne M. P. Canuto,et al.  A Dynamic Classifier Selection Method to Build Ensembles using Accuracy and Diversity , 2006, 2006 Ninth Brazilian Symposium on Neural Networks (SBRN'06).

[22]  Ben Taskar,et al.  Learning associative Markov networks , 2004, ICML.

[23]  Martin A. Riedmiller,et al.  On the Applicability of Unsupervised Feature Learning for Object Recognition in RGB-D Data , 2011 .

[24]  Athena Vakali,et al.  Contextual object category recognition for RGB-D scene labeling , 2014, Robotics Auton. Syst..

[25]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[26]  Zoltan-Csaba Marton,et al.  Evaluation of feature selection and model training strategies for object category recognition , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[28]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Sven Behnke,et al.  RGB-D object recognition and pose estimation based on pre-trained convolutional neural network features , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[31]  Amar Mitiche,et al.  Classifier combination for hand-printed digit recognition , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).