Construction worker detection in video frames for initializing vision trackers

Monitoring the location of resources on large scale, congested, outdoor sites can be performed more efficiently with vision tracking, as this approach does not require any pre-tagging of resources. However, the greatest impediment to the use of vision tracking in this case is the lack of detection methods that are needed to automatically mark the resources of interest and initiate the tracking. This paper presents such a novel method for construction worker detection that localizes construction workers in video frames. The proposed method exploits motion, shape, and color cues to narrow down the detection regions to moving objects, people, and finally construction workers, respectively. The three cues are characterized by using background subtraction, the histogram of oriented gradients (HOG), and the HSV color histogram. The method has been tested on videos taken in various environments. The results demonstrate its suitability for automatic initialization of vision trackers.

[1]  Bo Li,et al.  An Improving Technique of Color Histogram in Segmentation-based Image Retrieval , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[2]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Jie Gong,et al.  Computer Vision-Based Video Interpretation Model for Automated Productivity Analysis of Construction Operations , 2010 .

[5]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[6]  Lung-Chuang Wang,et al.  Enhancing construction quality inspection and management using RFID technology , 2008 .

[7]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[8]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[9]  Amr A. Oloufa,et al.  Situational awareness of construction equipment using GPS, wireless and web technologies , 2003 .

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Ioannis Brilakis,et al.  Comparative study of vision tracking methods for tracking of construction site resources , 2011 .

[12]  Carlos H. Caldas,et al.  Integration of Automated Data Collection Technologies for Real-Time Field Materials Management , 2004 .

[13]  Christian Koch,et al.  Three-Dimensional Tracking of Construction Resources Using an On-Site Camera System , 2012, J. Comput. Civ. Eng..

[14]  Jing-li Zhou,et al.  Image retrieval using both color and local spatial feature histograms , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[15]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[16]  Qi Tian,et al.  Foreground object detection in changing background based on color co-occurrence statistics , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[17]  Zhongke Shi,et al.  Tracking multiple workers on construction sites using video cameras , 2010, Adv. Eng. Informatics.

[18]  Tomohiro Yoshida,et al.  Application of RFID technology to prevention of collision accident with heavy equipment , 2010 .

[19]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[21]  Ioannis Brilakis,et al.  Initializing Vision Based Trackers Using Semantic Texton Forests , 2011 .

[22]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Chien-Ho Ko,et al.  RFID 3D location sensing algorithms , 2010 .

[24]  Seokho Chi,et al.  Automated Object Identification Using Optical Video Cameras on Construction Sites , 2011, Comput. Aided Civ. Infrastructure Eng..

[25]  Patricio A. Vela,et al.  Personnel tracking on construction sites using video cameras , 2009, Adv. Eng. Informatics.

[26]  Wu Chen,et al.  Positioning and tracking construction vehicles in highly dense urban areas and building construction sites , 2007 .

[27]  Frank Boukamp,et al.  Managing construction information using RFID-based semantic contexts , 2010 .

[28]  Ioannis K. Brilakis,et al.  Automated vision tracking of project related entities , 2011, Adv. Eng. Informatics.

[29]  James J. Little,et al.  Tracking and recognizing actions of multiple hockey players using the boosted particle filter , 2009, Image Vis. Comput..

[30]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[31]  Ioannis Brilakis,et al.  Truck-face recognition using Semantic Texton Forests , 2011 .

[32]  Ryusuke Miyamoto,et al.  Parallel implementation of pedestrian tracking using multiple cues on GPGPU , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[33]  Burcu Akinci,et al.  Tracking and locating components in a precast storage yard utilizing radio frequency identification technology and GPS , 2007 .

[34]  Vineet R. Kamat,et al.  Evaluation of position tracking technologies for user localization in indoor construction environments , 2009 .