Vehicle color classification using manifold learning methods from urban surveillance videos

Color identification of vehicles plays a significant role in crime detection. In this study, a novel scheme for the color identification of vehicles is proposed using the locating algorithm of regions of interest (ROIs) as well as the color histogram features from still images. A coarse-to-fine strategy was adopted to efficiently locate the ROIs for various vehicle types. Red patch labeling, geometrical-rule filtering, and a texture-based classifier were cascaded to locate the valid ROIs. A color space fusion together with a dimension reduction scheme was designed for color classification. Color histograms in ROIs were extracted and classified by a trained classifier. Seven different classes of color were identified in this work. Experiments were conducted to show the performance of the proposed method. The average rates of ROI location and color classification were 98.45% and 88.18%, respectively. Moreover, the classification efficiency of the proposed method was up to 18 frames per second.

[1]  Bernt Schiele,et al.  Comprehensive Colour Image Normalization , 1998, ECCV.

[2]  Yi-Ta Wu,et al.  A Vehicle Color Classification Method for Video Surveillance System Concerning Model-Based Background Subtraction , 2010, PCM.

[3]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Anneli Folkesson Electronic commerce and security , 2007 .

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Chin-Chuan Han,et al.  The color identification of automobiles for video surveillance , 2011, 2011 Carnahan Conference on Security Technology.

[7]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Sun-Mi Park,et al.  Vehicle Color Classification Based on the Support Vector Machine Method , 2007, ICIC.

[9]  Jui-Chen Wu,et al.  Vehicle Retrieval Using Eigen Color and Multiple Instance Learning , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[10]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[11]  I. Song,et al.  Working Set Selection Using Second Order Information for Training Svm, " Complexity-reduced Scheme for Feature Extraction with Linear Discriminant Analysis , 2022 .

[12]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[13]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[14]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Rui Mo,et al.  Over-exposure image correction with automatic texture synthesis , 2011, 2011 4th International Congress on Image and Signal Processing.

[16]  Jian Wu,et al.  Vehicle Color Recognition Using Vector Matching of Template , 2010, 2010 Third International Symposium on Electronic Commerce and Security.

[17]  Reiner Lenz,et al.  Compact colour descriptors for colour-based image retrieval , 2005, Signal Process..

[18]  Chih-Jen Lin,et al.  Working Set Selection Using Second Order Information for Training Support Vector Machines , 2005, J. Mach. Learn. Res..

[19]  Ying-Nong Chen,et al.  Face Recognition Using Nearest Feature Space Embedding , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Chin-Chuan Han,et al.  A vision-based system for the prevention of car collisions at night , 2009, Machine Vision and Applications.

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Liang Li,et al.  Vehicle color recognition using monocular camera , 2011, 2011 International Conference on Wireless Communications and Signal Processing (WCSP).

[23]  Theo Gevers,et al.  Selection and Fusion of Color Models for Image Feature Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  W D Wright,et al.  Color Science, Concepts and Methods. Quantitative Data and Formulas , 1967 .

[25]  Lisa M. Brown Example-Based Color Vehicle Retrieval for Surveillance , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[26]  P. Wolfe THE SIMPLEX METHOD FOR QUADRATIC PROGRAMMING , 1959 .

[27]  Guoping Qiu Embedded colour image coding for content-based retrieval , 2004, J. Vis. Commun. Image Represent..

[28]  Kuo-Chin Fan,et al.  Vehicle Detection Using Normalized Color and Edge Map , 2007, IEEE Transactions on Image Processing.

[29]  Muhittin Gökmen,et al.  A convenient feature vector construction for vehicle color recognition , 2010 .

[30]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[31]  Stan Z. Li,et al.  Face recognition based on nearest linear combinations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[32]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[33]  Marco Aiello,et al.  IEEE Asia-Pacific Services Computing Conference , 2010 .

[34]  Yoo-Joo Choi,et al.  Deciding the Number of Color Histogram Bins for Vehicle Color Recognition , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.

[35]  Yuan Cheng,et al.  Correcting over-exposure in photographs , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.