Material classification with thermal imagery

Material classification is an important area of research in computer vision. Typical algorithms use color and texture information for classification, but there are problems due to varying lighting conditions and diversity of colors in a single material class. In this work we study the use of long wave infrared (i.e. thermal) imagery for material classification. Thermal imagery has the benefit of relative invariance to color changes, invariance to lighting conditions, and can even work in the dark. We collect a database of 21 different material classes with both color and thermal imagery. We develop a set of features that describe water permeation and heating/cooling properties, and test several variations on these methods to obtain our final classifier. The results show that the proposed method outperforms typical color and texture features, and when combined with color information, the results are improved further.

[1]  Jordi-Roger Riba,et al.  Recovered Paperboard Samples Identification by Means of Mid-Infrared Sensors , 2013, IEEE Sensors Journal.

[2]  Majid Mirmehdi,et al.  Segmentation of Color Textures , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Chao Liu,et al.  Discriminative illumination: Per-pixel classification of raw materials based on optimal projections of spectral BRDF , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Edward R. Dougherty,et al.  An introduction to morphological image processing , 1992 .

[5]  G. Rybicki,et al.  Radiative processes in astrophysics , 1979 .

[6]  Nawid Jamali,et al.  Material classification by tactile sensing using surface textures , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Oliver Wang,et al.  Material classification using BRDF slices , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Chao Liu,et al.  Discriminative illumination: Per-pixel classification of raw materials based on optimal projections of spectral BRDF , 2012, CVPR.

[9]  Takahiko Horiuchi,et al.  Spectral imaging method for material classification and inspection of printed circuit boards , 2010 .

[10]  Paul F. Whelan,et al.  Experiments in colour texture analysis , 2001, Pattern Recognit. Lett..

[11]  T. Martin McGinnity,et al.  Material classification based on thermal properties — A robot and human evaluation , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[12]  Lawrence B. Wolff.  Polarization phase-based method for material classification and object recognition in computer vision , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Sabine Süsstrunk,et al.  Material Classification Using Color and NIR Images , 2009, CIC.

[14]  Lawrence B. Wolff,et al.  Polarization-Based Material Classification from Specular Reflection , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Chao Liu,et al.  Learning Discriminative Illumination and Filters for Raw Material Classification with Optimal Projections of Bidirectional Texture Functions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Zhang Xiaoting,et al.  Unsupervised Color Classification for Yarn-dyed Fabric Based on FCM Algorithm , 2010, 2010 International Conference on Artificial Intelligence and Computational Intelligence.

[17]  Bert Bras,et al.  Technologies for the Identification, Separation and Recycling of Automotive Plastics , 1996 .

[18]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[19]  C. Loan.  Computational Frameworks for the Fast Fourier Transform , 1992 .

[20]  Lixin Wu,et al.  Infrared Imaging Detection of Water Permeation on Field Large-Scale Rock Relics , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[21]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[22]  J. Crank,et al.  A practical method for numerical evaluation of solutions of partial differential equations of the heat-conduction type , 1947, Mathematical Proceedings of the Cambridge Philosophical Society.