SVM with Stochastic Parameter Selection for Bovine Leather Defect Classification

The performance of Support Vector Machines, as many other machine learning algorithms, is very sensitive to parameter tuning,mainly in real world problems. In this paper, two well known and widely used SVM implementations, Weka SMO and LIBSVM, were compared using Simulated Annealing as a parameter tuner. This approach increased significantly the classification accuracy over the Weka SMO and LIBSVM standard configuration. The paper also presents an empirical evaluation of SVM against AdaBoost and MLP, for solving the leather defect classification problem. The results obtained are very promising in successfully discriminating leather defects, with the highest overall accuracy, of 99.59%, being achieved by LIBSVM tuned with Simulated Annealing.

[1]  Frank H. Fuller,et al.  Brazil: The Future of Modern Agriculture? , 2004 .

[2]  Kaloyan Krastev,et al.  Identification of surface leather defects , 2003, CompSysTech '03.

[3]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[4]  Ian Witten,et al.  Data Mining , 2000 .

[5]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[6]  A. Bhalerao,et al.  Image Matching Based On The Co-occurrence Matrix , 1999 .

[7]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[8]  A. Gomes.  Aspectos da cadeia produtiva do couro bovino no Brasil e em Mato Grosso do Sul. , 2002 .

[9]  Giovanni Attolico,et al.  Automated system for detection and classification of leather defects , 1996 .

[10]  Kaloyan Krastev,et al.  Leather features selection for defects' recognition using fuzzy logic , 2004, CompSysTech '04.

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[13]  João Luís Sobral,et al.  Optimised filters for texture defect detection , 2005, IEEE International Conference on Image Processing 2005.

[14]  Dmitry Chetverikov,et al.  Texture analysis using feature-based pairwise interaction maps , 1999, Pattern Recognit..

[15]  Hemerson Pistori,et al.  Defect detection in raw hide and wet blue leather , 2006, CompIMAGE.

[16]  Thomas P. Trappenberg,et al.  A Heuristic for Free Parameter Optimization with Support Vector Machines , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[17]  J. Platt.  Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[18]  Desenvolvimento de um Software de Processamento e Geração de Imagens para Classificação de Couro Bovino , 2006 .

[19]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[20]  K. Lebart,et al.  A stochastic optimization approach for parameter tuning of support vector machines , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[21]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Ajay Kumar,et al.  Defect detection in textured materials using Gabor filters , 2000, Conference Record of the 2000 IEEE Industry Applications Conference. Thirty-Fifth IAS Annual Meeting and World Conference on Industrial Applications of Electrical Energy (Cat. No.00CH37129).

[23]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[24]  Der-Baau Perng,et al.  Establishing a Demerit Count Reference Standard for the Classification and Grading of Leather Hides , 2001 .