Initializing Vision Based Trackers Using Semantic Texton Forests

Vision based tracking can provide the spatial location of project related entities such as equipment, workers, and materials in a large-scale congested construction site. It tracks entities in a video stream by inferring their motion. To initiate the process, it is required to determine the pixel areas of the entities to be tracked in the following consecutive video frames. For the purpose of fully automating the process, this paper presents an automated way of initializing trackers using Semantic Texton Forests (STFs) method. STFs method performs simultaneously the segmentation of the image and the classification of the segments based on the low-level semantic information and the context information. In this paper, STFs method is tested in the case of wheel loaders recognition. In the experiments, wheel loaders are further divided into several parts such as wheels and body parts to help learn the context information. The results show 79% accuracy of recognizing the pixel areas of the wheel loader. These results signify that STFs method has the potential to automate the initialization process of vision based tracking.

[1]  Burcu Akinci,et al.  Tracking and locating components in a precast storage yard utilizing radio frequency identification technology and GPS , 2007 .

[2]  A. Kummert,et al.  A signal theoretic approach to measure the influence of image resolution for appearance-based vehicle detection , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[3]  Kamel S. Saidi,et al.  Static and dynamic performance evaluation of a commercially-available ultra wideband tracking system , 2011 .

[4]  Zehang Sun,et al.  Improving the performance of on-road vehicle detection by combining Gabor and wavelet features , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[5]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Alexandre Bernardino,et al.  Detection and classification of highway lanes using vehicle motion trajectories , 2006, IEEE Transactions on Intelligent Transportation Systems.

[7]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[8]  ZuWhan Kim,et al.  Evaluation of feature-based vehicle trajectory extraction algorithms , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[9]  Jitendra Malik,et al.  Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[10]  Ioannis K. Brilakis,et al.  Automated vision tracking of project related entities , 2011, Adv. Eng. Informatics.

[11]  Quoc Bao Truong,et al.  Vehicle Detection Algorithm Using Hypothesis Generation and Verification , 2009, ICIC.

[12]  Paul M. Goodrum,et al.  The application of active radio frequency identification technology for tool tracking on construction job sites , 2006 .

[13]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[14]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[15]  R. D. Ervin,et al.  System for Assessment of the Vehicle Motion Environment (SAVME): volume II , 2000 .

[16]  Arnold W. M. Smeulders,et al.  Real-Time Visual Concept Classification , 2010, IEEE Transactions on Multimedia.

[17]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[18]  Takeo Kanade,et al.  A statistical approach to 3d object detection applied to faces and cars , 2000 .

[19]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .