Server-Customer Interaction Tracker: Computer Vision-Based System to Estimate Dirt-Loading Cycles

AbstractReal-time monitoring of heavy equipment can help practitioners improve machine-intensive and cyclic earthmoving operations. It can also provide reliable data for future planning. Surface earthmoving job sites are among the best candidates for vision-based systems due to relatively clear sightlines and recognizable equipment. Several cutting-edge computer vision algorithms are integrated with spatiotemporal information, and background knowledge to develop a framework, called server-customer interaction tracker (SCIT), which recognizes and measures the dirt loading cycles. The SCIT system detects dirt loading plants, including excavator and dump trucks, tracks them, and then uses captured spatiotemporal data to recognize loading cycles. A novel hybrid tracking algorithm is developed for the SCIT system to track dump trucks under visually noisy conditions of loading zones. The developed framework was evaluated using videos taken under various conditions. The SCIT system with novel hybrid tracking eng...

[1]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Andrew J. Viterbi,et al.  Convolutional Codes and Their Performance in Communication Systems , 1971 .

[3]  Hyoungkwan Kim,et al.  Using Hue, Saturation, and Value Color Space for Hydraulic Excavator Idle Time Analysis , 2007 .

[4]  Ioannis Brilakis,et al.  Comparative study of vision tracking methods for tracking of construction site resources , 2011 .

[5]  Allen Newell,et al.  Heuristic Problem Solving: The Next Advance in Operations Research , 1958 .

[6]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[7]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ronie Navon,et al.  FIELD EXPERIMENTS IN AUTOMATED MONITORING OF ROAD CONSTRUCTION , 2005 .

[10]  Ioannis Brilakis,et al.  Truck-face recognition using Semantic Texton Forests , 2011 .

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Rafael Sacks,et al.  Assessing research issues in Automated Project Performance Control (APPC) , 2007 .

[13]  Brenda McCabe,et al.  Part based model and spatial–temporal reasoning to recognize hydraulic excavators in construction images and videos , 2012 .

[14]  Ioannis K. Brilakis,et al.  Automated vision tracking of project related entities , 2011, Adv. Eng. Informatics.

[15]  Eddy M. Rojas.  Construction Productivity: A Practical Guide for Building and Electrical Contractors , 2008 .

[16]  S. Abourizk,et al.  STATISTICAL PROPERTIES OF CONSTRUCTION DURATION DATA , 1992 .

[17]  Ronie Navon,et al.  A concept proving prototype of automated earthmoving control , 2004 .

[18]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[19]  Seokho Chi,et al.  Automated Object Identification Using Optical Video Cameras on Construction Sites , 2011, Comput. Aided Civ. Infrastructure Eng..

[20]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[21]  Osama Moselhi,et al.  RFID+ for Tracking Earthmoving Operations , 2012 .

[22]  François Peyret,et al.  High-precision application of GPS in the field of real-time equipment positioning , 2000 .

[23]  Janaka Y. Ruwanpura,et al.  AUTOMATED DATA ACQUISITION SYSTEM TO ASSESS CONSTRUCTION WORKER PERFORMANCE , 2009 .

[24]  Jie Gong,et al.  An object recognition, tracking, and contextual reasoning-based video interpretation method for rapid productivity analysis of construction operations , 2011 .

[25]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[26]  Ronie Navon,et al.  Automated project performance control of construction projects , 2005 .

[27]  Abhinav Peddi.  Development of human pose analyzing algorithms for the determination of construction productivity in real-time , 2009 .

[28]  Brenda McCabe,et al.  Automated Visual Recognition of Dump Trucks in Construction Videos , 2012, J. Comput. Civ. Eng..

[29]  Sven J. Dickinson,et al.  Video In Sentences Out , 2012, UAI.

[30]  David J. Edwards,et al.  The state of health and safety in the UK construction industry with a focus on plant operators , 2002 .