A smart camera for the surveillance of vehicles in intelligent transportation systems

The paper presents a smart camera aimed at security and law enforcement applications for intelligent transportation systems. An extended background is presented first as a scholar literature review. The smart camera components and their capabilities for automatic detection and recognition of selected parameters of cars, as well as different aspects of the system efficiency, are described and discussed in detail in subsequent sections. Smart features of make and model recognition (MMR), license plate recognition (LPR) and color recognition (CR) are highlighted as the main benefits of the system. Their implementations, flowcharts and recognition rates are described, discussed and finally reported in detail. In addition to MMR, three different approaches, referred to as bag-of-features, scalable vocabulary tree and pyramid match, are also considered. The conclusion includes a discussion of the smart camera system efficiency as a whole, with an insight into potential future improvements.

[1]  Yi Zhang,et al.  A License Plate Character Segmentation Method Based on Character Contour and Template Matching , 2013 .

[2]  Shi-Jinn Horng,et al.  Fast License Plate Localization Using Discrete Wavelet Transform , 2009, ICA3PP.

[3]  S. P. Narote,et al.  License Plate Recognition System‐Survey , 2010 .

[4]  David J. Kriegman,et al.  Video-based Car Surveillance: License Plate, Make, and Model Recognition , 2005 .

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Andrzej Glowacz,et al.  The efficient real- and non-real-time make and model recognition of cars , 2013, Multimedia Tools and Applications.

[7]  Ian Witten,et al.  Data Mining , 2000 .

[8]  Jing Bie,et al.  License Plate Recognition Algorithm for Passenger Cars in Chinese Residential Areas , 2012, Sensors.

[9]  Jian Yang,et al.  A license plate recognition system based on machine vision , 2013, Proceedings of 2013 IEEE International Conference on Service Operations and Logistics, and Informatics.

[10]  Chien-Hung Chen,et al.  An intelligent strategy for checking the annual inspection status of motorcycles based on license plate recognition , 2009, Expert Syst. Appl..

[11]  Anton Kummert,et al.  People Detection and Tracking from a Top-View Position Using a Time-of-Flight Camera , 2013, MCSS.

[12]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Lulu Zhang,et al.  A multi-filter based license plate localization and recognition framework , 2013, 2013 Ninth International Conference on Natural Computation (ICNC).

[14]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  W. Y. Szeto,et al.  Dynamic Modeling for Intelligent Transportation System Applications , 2014, J. Intell. Transp. Syst..

[16]  Remigiusz Baran,et al.  Signal compression based on zonal selection methods , 2000, Conference Proceedings 2000 International Conference on Mathematical Methods in Electromagnetic Theory (Cat. No.00EX413).

[17]  N. Vishwanath,et al.  Connected component analysis for Indian license plate infra-red and color image character segmentation , 2012, 2012 IEEE International Conference on Computational Intelligence and Computing Research.

[18]  Zhi-Yong Yuan,et al.  Research on License Plate Detection Based on Wavelet , 2008, ICIC.

[19]  Liang-Hua Chen,et al.  Integration of Keypoints and Edges for Image Retrieval , 2013, Int. J. Pattern Recognit. Artif. Intell..

[20]  Timothy F. Cootes,et al.  Vehicle type recognition with match refinement , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[21]  Mahmood Fathy,et al.  Ieee Transactions on Intelligent Transportation Systems 1 an Iranian License Plate Recognition System Based on Color Features , 2022 .

[22]  K Arulmozhi,et al.  Application of Top Hat Transform technique on Indian license plate image localization , 2012, 2012 IEEE International Conference on Computational Intelligence and Computing Research.

[23]  M. Ghazal,et al.  License plate automatic detection and recognition using level sets and neural networks , 2013, 2013 1st International Conference on Communications, Signal Processing, and their Applications (ICCSPA).

[24]  Maurizio Guida,et al.  Microsimulation Approach for Predicting Crashes at Unsignalized Intersections Using Traffic Conflicts , 2012 .

[25]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[26]  Il-Seok Oh,et al.  Learning-based Detection of License Plate using SIFT and Neural Network , 2013 .

[27]  Yi-Ta Wu,et al.  A Vehicle Color Classification Method for Video Surveillance System Concerning Model-Based Background Subtraction , 2010, PCM.

[28]  Eleftherios Kayafas,et al.  Vehicle model recognition from frontal view image measurements , 2011, Comput. Stand. Interfaces.

[29]  Eran A. Edirisinghe,et al.  Vehicle make & model identification using scale invariant transforms , 2007 .

[30]  Nick Pears,et al.  Automatic make and model recognition from frontal images of cars , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[31]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[32]  Jaeyeon Lee,et al.  Best Combination of Binarization Methods for License Plate Character Segmentation , 2013 .

[33]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[34]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[35]  Jun-Wei Hsieh,et al.  Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[36]  Marian B. Gorzalczany,et al.  Cluster Analysis Via Dynamic Self-organizing Neural Networks , 2006, ICAISC.

[37]  Figen Özen,et al.  A New License Plate Recognition System Based on Probabilistic Neural Networks , 2012 .

[38]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[39]  Qingming Huang,et al.  A configurable method for multi-style license plate recognition , 2009, Pattern Recognit..

[40]  David Anthony Torres.  More Local Structure Information for Make-Model Recognition , 2005 .

[41]  Ryszard Tadeusiewicz,et al.  Artificial Intelligence and Soft Computing - ICAISC 2006, 8th International Conference, Zakopane, Poland, June 25-29, 2006, Proceedings , 2006, International Conference on Artificial Intelligence and Soft Computing.

[42]  Kristen Grauman.  Matching sets of features for efficient retrieval and recognition , 2006 .

[43]  Mahmood Fathy,et al.  An image detection technique based on morphological edge detection and background differencing for real-time traffic analysis , 1995, Pattern Recognit. Lett..

[44]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[45]  Raja Bala,et al.  Computer vision in roadway transportation systems: a survey , 2013, J. Electronic Imaging.

[46]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[47]  Maurice Milgram,et al.  An Oriented-Contour Point Based Voting Algorithm for Vehicle Type Classification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[48]  Trevor Darrell,et al.  The Pyramid Match Kernel: Efficient Learning with Sets of Features , 2007, J. Mach. Learn. Res..

[49]  Saeid Rahati,et al.  Vehicle Recognition Using Contourlet Transform and SVM , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[50]  Orhan Bulan,et al.  Efficient processing of transportation surveillance videos in the compressed domain , 2013, J. Electronic Imaging.

[51]  Jianhua Song,et al.  A character segmentation method based on character structural features and projection , 2013, Other Conferences.

[52]  Lucjan Janowski,et al.  Quality assessment for a visual and automatic license plate recognition , 2012, Multimedia Tools and Applications.

[53]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[54]  Tomasz Parkoła,et al.  Report on the comparison of Tesseract and ABBYY FineReader OCR engines , 2012 .

[55]  Aili Wang,et al.  Vehicle License Plate Location Based on Improved Roberts Operator and Mathematical Morphology , 2012, 2012 Second International Conference on Instrumentation, Measurement, Computer, Communication and Control.

[56]  Krishnan Nallaperumal,et al.  Image refinement using skew angle detection and correction for Indian license plates , 2012, 2012 IEEE International Conference on Computational Intelligence and Computing Research.

[57]  Remigiusz Baran,et al.  Scalar quantization in the PWL transform spectrum domain , 2000, Conference Proceedings 2000 International Conference on Mathematical Methods in Electromagnetic Theory (Cat. No.00EX413).

[58]  A. Dziech,et al.  Contour transmultiplexing , 2005, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[59]  Xiaojun Zhai,et al.  Real-time optical character recognition on field programmable gate array for automatic number plate recognition system , 2013, IET Circuits Devices Syst..

[60]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[61]  Suh-Yin Lee,et al.  A view-invariant and anti-reflection algorithm for car body extraction and color classification , 2012, Multimedia Tools and Applications.

[62]  Sun-Mi Park,et al.  PCA-SVM Based Vehicle Color Recognition , 2008 .

[63]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[64]  Zhi Yong Ju,et al.  License Plate Image Skew Correction Algorithm Based on Geometric Constraint , 2012 .

[65]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[66]  Wei Hu,et al.  A new approach for vehicle color recognition based on specular-free image , 2013, Other Conferences.

[67]  Muhittin Gökmen,et al.  A convenient feature vector construction for vehicle color recognition , 2010 .

[68]  Marian B. Gorzalczany,et al.  WWW-Newsgroup-Document Clustering by Means of Dynamic Self-organizing Neural Networks , 2008, ICAISC.

[69]  Yoo-Joo Choi,et al.  Deciding the Number of Color Histogram Bins for Vehicle Color Recognition , 2008, 2008 IEEE Asia-Pacific Services Computing Conference.

[70]  Hamid Reza Pourreza,et al.  Vehicle Recognition Based on Fourier, Wavelet and Curvelet Transforms - a Comparative Study , 2007, Fourth International Conference on Information Technology (ITNG'07).

[71]  Orhan Bulan,et al.  Video-based real-time on-street parking occupancy detection system , 2013, J. Electronic Imaging.

[72]  Pengfei Shi,et al.  An Algorithm for License Plate Recognition Applied to Intelligent Transportation System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[73]  Dimo Dimov,et al.  Towards a Multinational Car License Plate Recognition System , 2006, Machine Vision and Applications.

[74]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[75]  Youngwoo Yoon,et al.  Blob detection and filtering for character segmentation of license plates , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).