An intelligent vision-based approach for helmet identification for work safety

Abstract Helmets are essential equipments to protect workers from danger during inspection and operation. Considering that some workers would not always obey the regulation, video surveillance systems covering the whole factory and supervisors are needed to monitor whether workers are wearing helmets or not. However, with a large number of surveillance screens, it is difficult to identify any helmet violation behavior during any time, which can lead to severe accidents. With the rapid development of image recognition technologies, computer vision-based inspections have been one of the most important industrial application areas. In this paper, an intelligent vision-based approach for helmet identification is proposed. This approach focuses on monitoring whether workers are wearing helmets or not, at the same time, identifying the colors of helmets. A color-based hybrid descriptor composed of local binary patterns (LBP), hu moment invariants (HMI) and color histograms (CH) is proposed to extract features of helmets with different colors (red, yellow and blue). Then a hierarchical support vector machine (H-SVM) is constructed to classify all features into four classes (red-helmet, yellow-helmet, blue-helmet and non-helmet). This approach is tested on our data set and the average accuracy of helmet identification is 90.3%.

[1]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Subrajeet Mohapatra,et al.  Machine learning approach for automated coal characterization using scanned electron microscopic images , 2016, Comput. Ind..

[3]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[4]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Trans. Syst. Man Cybern..

[5]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[7]  Krzysztof Baszczyński,et al.  The effect of temperature on the capability of industrial safety helmets to absorb impact energy , 2014 .

[8]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[9]  A. Gilchrist,et al.  Industrial helmet performance in impacts , 1993 .

[10]  Paolo Napoletano,et al.  Visual recognition of aircraft mechanical parts for smart maintenance , 2017, Comput. Ind..

[11]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[12]  Yanfang Ye,et al.  Automatic Detection of Helmet Uses for Construction Safety , 2016, 2016 IEEE/WIC/ACM International Conference on Web Intelligence Workshops (WIW).

[13]  Szu-Hao Huang,et al.  Automated visual inspection in the semiconductor industry: A survey , 2015, Comput. Ind..

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[18]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[19]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[20]  Kunsoo Huh,et al.  Vision-based vehicle detection and tracking algorithm design , 2009 .

[21]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[22]  Shamik Sural,et al.  Segmentation and histogram generation using the HSV color space for image retrieval , 2002, Proceedings. International Conference on Image Processing.

[23]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, 2011 International Conference on Computer Vision.

[24]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[26]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[27]  Jennifer G. Dy,et al.  A hierarchical method for multi-class support vector machines , 2004, ICML.

[28]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[29]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[31]  Romuere Rôdrigues Veloso e Silva,et al.  Automatic detection of motorcyclists without helmet , 2013, 2013 XXXIX Latin American Computing Conference (CLEI).

[32]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[33]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[34]  P. Wayne Power,et al.  Understanding Background Mixture Models for Foreground Segmentation , 2002 .

[35]  Bernt Schiele,et al.  Ten Years of Pedestrian Detection, What Have We Learned? , 2014, ECCV Workshops.

[36]  Che-Yen Wen.  The safety helmet detection technology and its application to the surveillance system. , 2004, Journal of forensic sciences.

[37]  Bernt Schiele,et al.  A Performance Evaluation of Single and Multi-feature People Detection , 2008, DAGM-Symposium.

[38]  John Chiverton,et al.  Helmet presence classification with motorcycle detection and tracking , 2012 .

[39]  Mauricio Orozco-Alzate,et al.  Automatic visual inspection: An approach with multi-instance learning , 2016, Comput. Ind..

[40]  R. Saravanan,et al.  A knowledge model for gray scale image interpretation with emphasis on welding defect classification - An ontology based approach , 2010, Comput. Ind..

[41]  Rattapoom Waranusast,et al.  Machine vision techniques for motorcycle safety helmet detection , 2013, 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013).

[42]  Chulung Chen,et al.  Color pattern recognition with the multi-channel non-zero-order joint transform correlator based on the HSV color space , 2005 .

[43]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Yeh-Liang Hsu,et al.  Improving thermal properties of industrial safety helmets , 2000 .

[45]  C. Krishna Mohan,et al.  Automatic detection of bike-riders without helmet using surveillance videos in real-time , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[46]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[48]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Ioannis Brilakis,et al.  Detection of Construction Workers in Video Frames for Automatic Initialization of Vision Trackers , 2012 .

[50]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Romuere Rôdrigues Veloso e Silva,et al.  Helmet Detection on Motorcyclists Using Image Descriptors and Classifiers , 2014, SIBGRAPI.

[52]  Liana Stanescu,et al.  A New Method for Segmentation of Images Represented in a HSV Color Space , 2009, ACIVS.

[53]  Bill Triggs,et al.  Feature Sets and Dimensionality Reduction for Visual Object Detection , 2010, BMVC.

[54]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.

[55]  Weilin Huang,et al.  Robust face recognition with structural binary gradient patterns , 2017, Pattern Recognit..

[56]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[57]  Ignacio Parra,et al.  Combination of Feature Extraction Methods for SVM Pedestrian Detection , 2007, IEEE Transactions on Intelligent Transportation Systems.

[58]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[59]  Jan-Olof Eklundh,et al.  Statistical background subtraction for a mobile observer , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[60]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[61]  Vivian W. Y Tam,et al.  A feasibility study of introducing chin straps of safety helmets as a statutory requirement in Hong Kong construction industry , 2014 .

[62]  Ioannis A. Papazoglou,et al.  Occupational risk quantification owing to falling objects , 2014 .

[63]  Ramakant Nevatia,et al.  Optimizing discrimination-efficiency tradeoff in integrating heterogeneous local features for object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.