A crash avoidance framework for heavy equipment control systems using 3D imaging sensors

This paper presents a preliminary crash avoidance framework for heavy equipment control systems. Safe equipment operation is a major concern on construction sites since fatal on-site injuries are an industry-wide problem. The proposed framework has potential for effecting active safety for equipment operation. The framework contains algorithms for spatial modeling, object tracking, and path planning. Beyond generating spatial models in fractions of seconds, these algorithms can successfully track objects in an environment and produce a collision-free 3D motion trajectory for equipment.

[1]  Jochen Teizer,et al.  Real-time spatial modeling to detect and track resources on construction sites , 2006 .

[2]  Jochen Teizer,et al.  Combined Ultra-Wideband Positioning and Range Imaging Sensing for Productivity and Safety Monitoring in Building Construction , 2007 .

[3]  Frank Dellaert,et al.  Jacobian images of super-resolved texture maps for model-based motion estimation and tracking , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[4]  Teresa M Adams,et al.  Spatial Model for Path Planning of Multiple Mobile Construction Robots , 2004 .

[5]  Parvaneh Saeedi,et al.  An autonomous excavator with vision-based track-slippage control , 2005, IEEE Transactions on Control Systems Technology.

[6]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[7]  Olivier Faugeras,et al.  3D Dynamic Scene Analysis , 1992 .

[8]  Sanjiv Singh,et al.  A Robotic Excavator for Autonomous Truck Loading , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[9]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Gérard G. Medioni,et al.  3-D Surface Description from Binocular Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  A. R. Soltani,et al.  A fuzzy based multi-objective path planning of construction sites , 2004 .

[12]  T M Ruff,et al.  TEST RESULTS OF COLLISION WARNING SYSTEMS FOR SURFACE MINING DUMP TRUCKS. , 2000 .

[13]  Yong K. Cho,et al.  Wireless Sensor-Driven Intelligent Navigation Method for Mobile Robot Applications in Construction , 2007 .

[14]  Changwan Kim.  Spatial information acquisition and its use for infrastructure operation and maintenance , 2004 .

[15]  Carlos Balaguer,et al.  A mechatronics security system for the construction site , 2003 .

[16]  黄莎白,et al.  A fast strategy for image matching using Hausdorff distance , 2003 .

[17]  Kyo-Jin Koo,et al.  Construction Robot Path-Planning for Earthwork Operations , 2003 .

[18]  Soon Ki Jung,et al.  A model-based 3-D tracking of rigid objects from a sequence of multiple perspective views , 1998, Pattern Recognit. Lett..

[19]  Bin Ran,et al.  Interactive path planning for multi-equipment landfill operations , 2000 .

[20]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Hisashi Osumi,et al.  Development of Autonomous System for Loading Operation by Wheel Loader , 2006 .

[22]  Koshy Varghese,et al.  Automated Path Planning for Mobile Crane Lifts , 2002 .

[23]  Driss Aboutajdine,et al.  Estimation and segmentation of a dense disparity map for 3D reconstruction , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[24]  Chang-Sung Jeong,et al.  An Area-Based Stereo Matching Using Adaptive Search Range and Window Size , 2001, International Conference on Computational Science.

[25]  Takeo Kanade,et al.  Model-based tracking of self-occluding articulated objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[26]  Roger Chorley.  A Blue-Print for the Future , 1990 .

[27]  Wilfried Brauer,et al.  Intensity- and Gradient-Based Stereo Matching Using Hierarchical Gaussian Basis Functions , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Kevin Nickels,et al.  Model-based tracking of complex articulated objects , 2001, IEEE Trans. Robotics Autom..

[29]  Carlos H. Caldas,et al.  Human-Assisted Obstacle Avoidance System using 3D Workspace Modeling for Construction Equipment Operation , 2006 .

[30]  Amr A. Oloufa,et al.  GPS-Based Wireless Collision Detection of Construction Equipment , 2002 .

[31]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Mohan M. Trivedi,et al.  Multi-Primitive Hierarchical (MPH) Stereo Analysis , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[34]  Merl K. Miller,et al.  The personal robot navigator , 1999 .

[35]  William H. Schiffbauer,et al.  An Environmentally Robust Proximity Warning System for Hazardous Areas , 2001 .

[36]  H. Howe,et al.  Census of Fatal Occupational Injuries , 1996 .

[37]  Clark F. Olson,et al.  A probabilistic formulation for Hausdorff matching , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[38]  Ian Dowman,et al.  Automating Image Registration and Absolute Orientation: Solutions and Problems , 1998 .

[39]  Koshy Varghese,et al.  COLLISION FREE PATH PLANNING OF COOPERATIVE CRANE MANIPULATORS USING GENETIC ALGORITHM , 2005 .

[40]  David J. Edwards,et al.  SightSafety: A hybrid information and communication technology system for reducing vehicle/pedestrian collisions , 2006 .

[41]  Hissam Tawfik,et al.  Path planning in construction sites: performance evaluation of the Dijkstra, A*, and GA search algorithms , 2002, Adv. Eng. Informatics.

[42]  Jiaoying Shi,et al.  A robust algorithm for feature point matching , 2002, Comput. Graph..

[43]  Niels da Vitoria Lobo,et al.  Segment-based hand pose estimation , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[44]  Mohammed Yeasin,et al.  A 2D/3D model-based object tracking framework , 2003, Pattern Recognit..

[45]  Alain Crouzil,et al.  Towards correlation-based matching algorithms that are robust near occlusions , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[46]  Patrick Bouthemy,et al.  A 2D-3D model-based approach to real-time visual tracking , 2001, Image Vis. Comput..