Coarse head pose estimation of construction equipment operators to formulate dynamic blind spots

Several hundred workers die in construction in the United States every year because equipment operators are unable to see their fellow workers during operation of their vehicle. In this paper we propose a step towards improving this situation by providing an automated method based on range imaging for estimating the coarse head orientation of a construction equipment operator. This research utilizes commercially-available low resolution range cameras to measure the continuously changing field-of-view (FOV) of an equipment operator in outdoor construction. This paper presents a methodology to measure so-called dynamic blind spot maps. The dynamic blind spot map is then projected on a known static equipment blind spot map that already exists to each construction vehicle. A robust computational coarse head pose estimation algorithm and results to three different pieces of construction equipment and multiple operators are presented. The developed method has the potential in automatically determining the spaces around vehicles that are currently not in the field-of-view of the vehicle operator thus providing eventually additional means and technology for improving safety in construction.

[1]  Stephanie G. Pratt,et al.  BUILDING SAFER HIGHWAY WORK ZONES: MEASURES TO PREVENT WORKER INJURIES FROM VEHICLES AND EQUIPMENT , 2001 .

[2]  Qiang Ji,et al.  3D face pose discrimination using wavelets , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Sethuraman Panchanathan,et al.  Biased Manifold Embedding: A Framework for Person-Independent Head Pose Estimation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Wanqing Li,et al.  Kernel PCA of HOG features for posture detection , 2009, 2009 24th International Conference Image and Vision Computing New Zealand.

[5]  K. Kitaguchi,et al.  Appearance based object pose estimation using regression models , 2008, 2008 SICE Annual Conference.

[6]  Takeo Kanade,et al.  Rotation Invariant Neural Network-Based Face Detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[7]  Harry Wechsler,et al.  Face pose discrimination using support vector machines (SVM) , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  Matti Pietikäinen,et al.  Unsupervised learning using locally linear embedding: experiments with face pose analysis , 2002, Object recognition supported by user interaction for service robots.

[9]  Jochen Teizer,et al.  Visibility-related fatalities related to construction equipment , 2011 .

[10]  Youding Zhu,et al.  Head pose estimation for driver monitoring , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[11]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Shingo Ando,et al.  Appearance based pose estimation of 3D object using support vector regression , 2005, IEEE International Conference on Image Processing 2005.

[13]  Yuxiao Hu,et al.  Head pose estimation using Fisher Manifold learning , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[14]  Chabane Djeraba,et al.  Supervised Learning for Head Pose Estimation Using SVD and Gabor Wavelets , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[15]  Shaogang Gong,et al.  Support vector regression and classification based multi-view face detection and recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[16]  Kim L. Boyer,et al.  Head pose estimation using view based eigenspaces , 2002, Object recognition supported by user interaction for service robots.

[17]  Rainer Stiefelhagen,et al.  Head pose estimation using stereo vision for human-robot interaction , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[18]  Kun Liu,et al.  Attention recognition of drivers based on head pose estimation , 2008, 2008 IEEE Vehicle Power and Propulsion Conference.

[19]  Todd M. Ruff.  Monitoring Blind Spots: A Major Concern For Haul Trucks - Introduction , 1900 .

[20]  Michael G. Strintzis,et al.  Robust real-time 3D head pose estimation from range data , 2005, Pattern Recognit..

[21]  Hiroshi Murase,et al.  Illumination Planning for Object Recognition Using Parametric Eigenspaces , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Jochen Teizer,et al.  Automating the blind spot measurement of construction equipment , 2010 .

[23]  Jingyu Yang,et al.  A Fast Algorithm Face Detection and Head Pose Estimation for Driver Assistant System , 2006, 2006 8th international Conference on Signal Processing.

[24]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[26]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[27]  Katsuhiko Sakaue,et al.  Head pose estimation by nonlinear manifold learning , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[28]  Shihong Lao,et al.  Sparse Bayesian Regression for Head Pose Estimation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[29]  Ajit Rajwade,et al.  Facial pose from 3D data , 2006, Image Vis. Comput..

[30]  Harald Wuest,et al.  Linear-projection-based classification of human postures in time-of-flight data , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[31]  Jimmie Hinze,et al.  Autonomous pro-active real-time construction worker and equipment operator proximity safety alert system , 2010 .

[32]  Naomi Inoue,et al.  Real-Time Head Pose Estimation using Reconstructed 3D Face Data from Stereo Image Pair , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[33]  Carlos H. Caldas,et al.  Real-Time Three-Dimensional Occupancy Grid Modeling for the Detection and Tracking of Construction Resources , 2007 .