Automated Visual Recognition of Dump Trucks in Construction Videos

Earthmoving plants are essential, but costly, resources in the construction of heavy civil engineering projects. In addition to proper allocation, ongoing control of this equipment is necessary to ensure and increase the productivity of earthmoving operations. Captured videos from construction sites are potential tools to control earthmoving operations; however, the current practice of manual data extraction from surveillance videos is tedious, costly, and error prone. Cutting-edge computer vision techniques have the potential to automate equipment-monitoring tasks. This paper presents research in the evaluation of combinations of existing object recognition and background subtraction algorithms, to recognize off-highway dump trucks in noisy video streams containing other active machines. Two detection algorithms, namely, Haar–histogram of oriented gradients (HOG) and Blob-HOG, are presented and evaluated for their ability to recognize dump trucks in videos, as measured by both effectiveness and timeliness. The results of this study can help practitioners select a suitable approach to recognize such equipment in videos for real-time applications such as productivity measurement, performance control, and proactive work-zone safety.

[1]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[2]  Janaka Y. Ruwanpura,et al.  AUTOMATED DATA ACQUISITION SYSTEM TO ASSESS CONSTRUCTION WORKER PERFORMANCE , 2009 .

[3]  James H. Garrett,et al.  Automated defect detection for sewer pipeline inspection and condition assessment , 2009 .

[4]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Regis Hoffman,et al.  Visual classification of coarse vehicle orientation using Histogram of Oriented Gradients features , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[6]  Lucio Soibelman,et al.  Content-Based Search Engines for Construction Image Databases , 2005 .

[7]  W. Eric L. Grimson,et al.  Using adaptive tracking to classify and monitor activities in a site , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Osama Moselhi,et al.  Optimization of Earthmoving Operations in Heavy Civil Engineering Projects , 2009 .

[9]  Jie Gong,et al.  An object recognition, tracking, and contextual reasoning-based video interpretation method for rapid productivity analysis of construction operations , 2011 .

[10]  Ronie Navon,et al.  Automated project performance control of construction projects , 2005 .

[11]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[12]  Ronie Navon,et al.  A concept proving prototype of automated earthmoving control , 2004 .

[13]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[14]  Seokho Chi,et al.  Automated Object Identification Using Optical Video Cameras on Construction Sites , 2011, Comput. Aided Civ. Infrastructure Eng..

[15]  Jonathan Jingsheng Shi,et al.  A neural network based system for predicting earthmoving production , 1999 .

[16]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Mohamed Marzouk,et al.  Multiobjective Optimization of Earthmoving Operations , 2004 .

[18]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Seokho Chi,et al.  Image-Based Safety Assessment: Automated Spatial Safety Risk Identification of Earthmoving and Surface Mining Activities , 2012 .

[20]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[21]  Kris G. Mattila,et al.  Determination of Haul Distance and Direction in Mass Excavation , 2005 .

[22]  Kyoungmin Kim,et al.  Case Study on the Evaluation of Equipment Flow at a Construction Site , 2010 .

[23]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[24]  Ioannis Brilakis,et al.  Machine Vision-Based Concrete Surface Quality Assessment , 2010 .

[25]  Ioannis Brilakis,et al.  Comparison of Optical Sensor-Based Spatial Data Collection Techniques for Civil Infrastructure Modeling , 2009 .

[26]  Simaan M. AbouRizk,et al.  Performance measurement indices for simulated construction operations , 2001 .

[27]  Xiaoqing Ding,et al.  Human Detection Based on Fusion of Histograms of Oriented Gradients and Main Partial Features , 2009, 2009 2nd International Congress on Image and Signal Processing.

[28]  Jeffrey S. Russell,et al.  Framework for an intelligent earthwork system: Part II. Task identification/scheduling and resource allocation methodology , 2003 .

[29]  Jeffrey S. Russell,et al.  Framework for an intelligent earthwork system: Part I. System architecture , 2003 .

[30]  Lionel Prevost,et al.  A Cascade of Boosted Generative and Discriminative Classifiers for Vehicle Detection , 2008, EURASIP J. Adv. Signal Process..

[31]  Lucio Soibelman,et al.  Material-Based Construction Site Image Retrieval , 2005 .

[32]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[33]  Hyoungkwan Kim,et al.  Using Hue, Saturation, and Value Color Space for Hydraulic Excavator Idle Time Analysis , 2007 .

[34]  Jun Yang,et al.  2D VISION TRACKING METHODS' PERFORMANCE COMPARISON FOR 3D TRACKING OF CONSTRUCTION RESOURCES , 2010 .

[35]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[36]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[37]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[38]  Seung Heon Han,et al.  Object recognition in construction-site images using 3D CAD-based filtering , 2010 .

[39]  Yong Bai,et al.  A Petri net simulation model for virtual construction of earthmoving operations , 2011 .