Sufficient Statistics Feature Mapping over Deep Boltzmann Machine for Detection

As an important and fundamental methodology in the fields of pattern recognition and image processing, learning middle level feature has attracted increasing interest during the recent years, where generative feature mapping has shown highly completive performance in diverse applications. In this paper, a middle level feature representation is proposed based on Deep Boltzmann Machine (DBM) and sufficient statistics (SS) feature mapping for detection. In the approach, DBM is employed to model data distribution and the hidden information inferred by DBM together with other informative variables are then exploited by SS to form the middle level features. The features, learnt from data, can be fed to standard classifiers for classification. In order to evaluate the performance of our method, we apply our feature mapping method to two challenging tasks: (1) contour detection through distinguishing border and non-border pixels, (2) sales pipeline prediction, which predicts the winning propensity of the ongoing sales opportunity in the pipeline. In comparison with other leading methods in the literature on the Berkeley Segmentation Dataset and Sales Pipeline Database (SPDB), our proposed algorithm performs favorably against state-of-the-art methods in terms of effectiveness and efficiency.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Changsheng Li,et al.  Learning ordinal discriminative features for age estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[4]  Tai Sing Lee,et al.  Hybrid generative-discriminative classification using posterior divergence , 2011, CVPR 2011.

[5]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[6]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Geoffrey E. Hinton,et al.  A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants , 1998, Learning in Graphical Models.

[8]  Sholom M. Weiss,et al.  Operations Research Improves Sales Force Productivity at IBM , 2010, Interfaces.

[9]  Carlo Tomasi,et al.  Color edge detection with the compass operator , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[11]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[12]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[13]  Nicolai Petkov,et al.  An improved model for surround suppression by steerable filters and multilevel inhibition with application to contour detection , 2011, Pattern Recognit..

[14]  Changsheng Li,et al.  Ordinal regularized manifold feature extraction for image ranking , 2013, Signal Process..

[15]  Ming-Hsuan Yang,et al.  Contour detection via random forest , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[16]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Nebojsa Jojic,et al.  Free Energy Score Spaces: Using Generative Information in Discriminative Classifiers , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[19]  J. Ross Quinlan,et al.  Improved Use of Continuous Attributes in C4.5 , 1996, J. Artif. Intell. Res..

[20]  Will Kaydos Implementing A Formal Selling Process and Performance Measures In A Sales Organization , 1998 .

[21]  Tai Sing Lee,et al.  Stochastic feature mapping for PAC-Bayes classification , 2015, Machine Learning.

[22]  Bin Wang,et al.  Learning Discriminative Sufficient Statistics Score Space for Classification , 2013, ECML/PKDD.