Exploring features in a Bayesian framework for material recognition

We are interested in identifying the material category, e.g. glass, metal, fabric, plastic or wood, from a single image of a surface. Unlike other visual recognition tasks in computer vision, it is difficult to find good, reliable features that can tell material categories apart. Our strategy is to use a rich set of low and mid-level features that capture various aspects of material appearance. We propose an augmented Latent Dirichlet Allocation (aLDA) model to combine these features under a Bayesian generative framework and learn an optimal combination of features. Experimental results show that our system performs material recognition reasonably well on a challenging material database, outperforming state-of-the-art material/texture recognition systems.

[1]  F. E. Nicodemus.  Directional Reflectance and Emissivity of an Opaque Surface , 1965 .

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Shree K. Nayar,et al.  Histogram model for 3D textures , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[5]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[7]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[8]  E. Adelson,et al.  Recognition of Surface Reflectance Properties from a Single Image under Unknown Real-World Illumination , 2001 .

[9]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[10]  Kristin J. Dana,et al.  Recognition methods for 3D textured surfaces , 2001, IS&T/SPIE Electronic Imaging.

[11]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[12]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[13]  J. Koenderink,et al.  Representation of local geometry in the visual system , 1987, Biological Cybernetics.

[14]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[15]  J. Koenderink,et al.  Bidirectional Texture Contrast Function , 2004, International Journal of Computer Vision.

[16]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[17]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[18]  David A. Forsyth,et al.  Automatic Detection of Human Nudes , 1999, International Journal of Computer Vision.

[19]  Stephen H. Westin,et al.  Measuring and modeling the appearance of finished wood , 2005, ACM Trans. Graph..

[20]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[22]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, ACM Trans. Graph..

[23]  Jean Ponce,et al.  A Geodesic Active Contour Framework for Finding Glass , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  E. Adelson,et al.  Image statistics for surface reflectance perception. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Trevor Darrell,et al.  An Additive Latent Feature Model for Transparent Object Recognition , 2009, NIPS.

[27]  Antonio Torralba,et al.  Nonparametric scene parsing: Label transfer via dense scene alignment , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Edward H. Adelson,et al.  Material perception: What can you see in a brief glance? , 2010 .

[29]  Mario Fritz,et al.  Classifying materials in the real world , 2010, Image Vis. Comput..

[30]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.