Material Recognition for Efficient Acquisition of Geometry and Reflectance

Typically, 3D geometry acquisition and reflectance acquisition techniques strongly rely on some basic assumptions about the surface reflectance behavior of the sample to be measured. Methods are tailored e.g. to Lambertian reflectance, mirroring reflectance, smooth and homogeneous surfaces or surfaces exhibiting mesoscopic effects. In this paper, we analyze whether multi-view material recognition can be performed robust enough to guide a subsequent acquisition process by reliably recognizing a certain material in a database with its respective annotation regarding the reconstruction methods to be chosen. This allows selecting the appropriate geometry/reflectance reconstruction approaches and, hence, increasing the efficiency of the acquisition process. In particular, we demonstrate that considering only a few view-light configurations is sufficient for obtaining high recognition scores.

[1]  Kristin J. Dana,et al.  Texture histograms as a function of irradiation and viewing direction , 1999, International Journal of Computer Vision.

[2]  Mario Fritz,et al.  Recognizing Materials from Virtual Examples , 2012, ECCV.

[3]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Mario Fritz,et al.  Classifying materials in the real world , 2010, Image Vis. Comput..

[5]  Maria Petrou,et al.  Estimating Lighting Direction and Classifying Textures , 2002, BMVC.

[6]  Ken-ichi Maeda,et al.  Face recognition using temporal image sequence , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Christopher Schwartz,et al.  Design and Implementation of Practical Bidirectional Texture Function Measurement Devices Focusing on the Developments at the University of Bonn , 2014, Sensors.

[8]  David W. Jacobs,et al.  Using specularities for recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[11]  Chao Liu,et al.  Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Andrew Zisserman,et al.  Unifying statistical texture classification frameworks , 2004, Image Vis. Comput..

[13]  Barbara Caputo,et al.  Class-Specific Material Categorisation , 2005, ICCV.

[14]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Michael Weinmann,et al.  Material Classification Based on Training Data Synthesized Using a BTF Database , 2014, ECCV.

[16]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[17]  Krista A. Ehinger,et al.  SUN database: Large-scale scene recognition from abbey to zoo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Mario Fritz,et al.  On the Significance of Real-World Conditions for Material Classification , 2004, ECCV.

[19]  Edward H. Adelson,et al.  Recognizing Materials Using Perceptually Inspired Features , 2013, International Journal of Computer Vision.

[20]  Shree K. Nayar,et al.  Histogram model for 3D textures , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[21]  Gertjan J. Burghouts,et al.  Color Textons for Texture Recognition , 2006, BMVC.

[22]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Xiaofeng Ren,et al.  Toward Robust Material Recognition for Everyday Objects , 2011, BMVC.

[24]  Kristin J. Dana,et al.  3D Texture Recognition Using Bidirectional Feature Histograms , 2004, International Journal of Computer Vision.

[25]  Andrew Zisserman,et al.  Classifying Images of Materials: Achieving Viewpoint and Illumination Independence , 2002, ECCV.

[26]  M. Chantler,et al.  Illumination-invariant texture classification using simple training images , 2005 .

[27]  Osamu Yamaguchi,et al.  Face Recognition Using Multi-viewpoint Patterns for Robot Vision , 2003, ISRR.

[28]  Andrew Zisserman,et al.  A Statistical Approach to Material Classification Using Image Patch Exemplars , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Edward H. Adelson,et al.  Exploring features in a Bayesian framework for material recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.