Scene Categorization Using Topic Model Based Hierarchical Conditional Random Fields

We propose a novel hierarchical framework for scene categorization. The scene representation is defined by latent topics extracted by Latent Dirichlet Allocation. The interaction of these topics across scene categories is learned by probabilistic graphical modelling. We use Conditional Random Fields in a hierarchical setting for discovering the global context of these topics. The learned random fields are further used for categorization of a new scene. The experimental results of the proposed framework is presented on standard datasets and on image collection obtained from the internet.

[1]  Ioannis Patras,et al.  Latent Semantics Local Distribution for CRF-based Image Semantic Segmentation , 2009, BMVC.

[2]  Yong Wang,et al.  Conditional Random Field for Natural Scene Categorization , 2007, BMVC.

[3]  Nafiz Arica,et al.  Scene Classification Using Spatial Pyramid of Latent Topics , 2010, 2010 20th International Conference on Pattern Recognition.

[4]  Takuma Yamaguchi,et al.  Image categorization by a classifier based on probabilistic topic model , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[6]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Ping Zhong,et al.  Learning Conditional Random Fields for Classification of Hyperspectral Images , 2010, IEEE Transactions on Image Processing.

[8]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Antonio Torralba,et al.  Learning hierarchical models of scenes, objects, and parts , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Alexei A. Efros,et al.  Unsupervised discovery of visual object class hierarchies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Xi Liu,et al.  Voting conditional random fields for multi-label image classification , 2010, 2010 3rd International Congress on Image and Signal Processing.

[12]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, CVPR.

[13]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..