Seen and missed traffic objects: A traffic object-specific awareness estimation

Handing-over vehicle control from a human driver to an intelligent vehicle and vice versa needs elaborate and safe hand-over strategies. Before passing control it must be ensured that the driver is aware of all objects which are important in a particular traffic situation. In this work a decision tree is used to learn which objects attract the driver's gaze in a particular situation. The decision tree classifies on object features as the object's type, velocity, size, color, and brightness. This information is fused from laser-scanners, front camera, and the vehicle's CAN-bus data. Whilst driving, an awareness confidence is built for each object perceived by the laser-scanners. Unexpected gaze behavior is detected by comparing the awareness confidence of each object to the expected gaze behavior, learned by means of the decision tree. Objects overlooked by the driver are further classified as critical or uncritical. This provides valuable information for following human-car interaction, augmented-reality, or safety applications.

[1]  Dimitris Kanellopoulos,et al.  Data Preprocessing for Supervised Leaning , 2007 .

[2]  M. Land.  Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[3]  Tobias Bär,et al.  Driver head pose and gaze estimation based on multi-template ICP 3-D point cloud alignment , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[4]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[5]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[6]  Mohan M. Trivedi,et al.  Attention estimation by simultaneous observation of viewer and view , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[7]  Takatsugu Hirayama,et al.  Measuring driver awareness based on correlation between gaze behavior and risks of surrounding vehicles , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[8]  L. Petersson,et al.  A framework for driver-in-the-loop driver assistance systems , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..