Weakly Supervised Classification of Objects in Images Using Soft Random Forests

The development of robust classification model is among the important issues in computer vision. This paper deals with weakly supervised learning that generalizes the supervised and semi-supervised learning. In weakly supervised learning training data are given as the priors of each class for each sample. We first propose a weakly supervised strategy for learning soft decision trees. Besides, the introduction of class priors for training samples instead of hard class labels makes natural the formulation of an iterative learning procedure. We report experiments for UCI object recognition datasets. These experiments show that recognition performance close to the supervised learning can be expected using the propose framework. Besides, an application to semi-supervised learning, which can be regarded as a particular case of weakly supervised learning, further demonstrates the pertinence of the contribution. We further discuss the relevance of weakly supervised learning for computer vision applications.

[1]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[2]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[3]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[4]  Pietro Perona,et al.  Unsupervised Learning of Models for Recognition , 2000, ECCV.

[5]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[6]  W. Loh,et al.  SPLIT SELECTION METHODS FOR CLASSIFICATION TREES , 1997 .

[7]  Daniel P. Huttenlocher,et al.  Weakly Supervised Learning of Part-Based Spatial Models for Visual Object Recognition , 2006, ECCV.

[8]  Riwal Lefort,et al.  Combining image-level and object-level inference for weakly supervised object recognition. Application to fisheries acoustics , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[9]  Cordelia Schmid,et al.  Toward Category-Level Object Recognition (Lecture Notes in Computer Science) , 2007 .

[10]  G. V. Kass An Exploratory Technique for Investigating Large Quantities of Categorical Data , 1980 .

[11]  G. Michailidis,et al.  An Iterative Algorithm for Extending Learners to a Semi-Supervised Setting , 2008 .

[12]  Riwal Lefort,et al.  Weakly supervised learning using proportion-based information: An application to fisheries acoustics , 2008, 2008 19th International Conference on Pattern Recognition.

[13]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[14]  Foster Provost,et al.  A Simple Relational Classifier , 2003 .

[15]  Pietro Perona,et al.  Unsupervised learning of models for object recognition , 2000 .

[16]  Vincent Lepetit,et al.  Keypoint Signatures for Fast Learning and Recognition , 2008, ECCV.

[17]  Alfred Stein,et al.  Incorporating Uncertainty via Hierarchical Classification Using Fuzzy Decision Trees , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Martial Hebert,et al.  Semi-Supervised Self-Training of Object Detection Models , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[19]  Jennifer Neville,et al.  Iterative Classification in Relational Data , 2000 .

[20]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[21]  Cordelia Schmid,et al.  Toward Category-Level Object Recognition , 2006, Toward Category-Level Object Recognition.

[22]  Gholamreza Haffari,et al.  Analysis of Semi-Supervised Learning with the Yarowsky Algorithm , 2007, UAI.

[23]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[24]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[25]  金田 重郎,et al.  C4.5: Programs for Machine Learning (書評) , 1995 .

[26]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[27]  Sebastian Thrun,et al.  Learning to Classify Text from Labeled and Unlabeled Documents , 1998, AAAI/IAAI.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[30]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[31]  Jonathan Rossiter,et al.  Bio-mimetic learning from images using imprecise expert information , 2007, Fuzzy Sets Syst..

[32]  Ilkay Ulusoy,et al.  Generative versus discriminative methods for object recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Antti Oulasvirta,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[34]  Pietro Perona,et al.  Weakly Supervised Scale-Invariant Learning of Models for Visual Recognition , 2007, International Journal of Computer Vision.

[35]  Sotiris B. Kotsiantis,et al.  Logitboost of Simple Bayesian Classifier , 2005, Informatica.

[36]  Cordelia Schmid,et al.  Weakly Supervised Learning of Visual Models and Its Application to Content-Based Retrieval , 2004, International Journal of Computer Vision.

[37]  Christopher M. Bishop,et al.  Non-linear Bayesian Image Modelling , 2000, ECCV.

[38]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[39]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2004, International Journal of Computer Vision.

[40]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[41]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.