Balancing Privacy and Safety: Protecting Driver Identity in Naturalistic Driving Video Data

Naturalistic driving dataset is at the heart of automotive user interface research, detecting/measuring driver distraction, and many other driver safety related studies. Recent advances in the collection of large scale naturalistic driving data include the second Strategic Highway Research Program (SHRP2) consisting of more than 3000 subjects and the 100-Car study. Public access to such data, however, is made difficult due to personal identifiable information and protection of privacy. We propose de-identification filters for protecting the privacy of drivers while preserving sufficient details to infer driver behavior, such as the gaze direction, in naturalistic driving videos. Driver's gaze estimation is of particular interest because it is a good indicator of driver's visual attention and a good predictor of driver's intent. We implement and compare de-identification filters, which are made up of a combination of preserving eye regions, superimposing head pose encoded face mask and replacing background with black pixels, and show promising results.

[1]  Zheng Pei,et al.  PERCLOS-Based recognition algorithms of motor driver fatigue , 2002 .

[2]  Thomas A. Dingus,et al.  An overview of the 100-car naturalistic study and findings , 2005 .

[3]  Mohan M. Trivedi,et al.  3-D Posture and Gesture Recognition for Interactivity in Smart Spaces , 2012, IEEE Transactions on Industrial Informatics.

[4]  Mohan M. Trivedi,et al.  Vision on Wheels: Looking at Driver, Vehicle, and Surround for On-Road Maneuver Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Yaobin Chen,et al.  Studying the Effects of Driver Distraction and Traffic Density on the Probability of Crash and Near-Crash Events in Naturalistic Driving Environment , 2013, IEEE Transactions on Intelligent Transportation Systems.

[7]  Emanuele Frontoni,et al.  Customers’ activity recognition in intelligent retail environments , 2013 .

[8]  Robert T. Collins,et al.  Silhouette-based human identification from body shape and gait , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[9]  Jingyu Yang,et al.  Driver Fatigue Detection: A Survey , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[10]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Mohan M. Trivedi,et al.  Head Dynamic Analysis: A Multi-view Framework , 2013, ICIAP Workshops.

[12]  Mohan M. Trivedi,et al.  Occupant posture analysis with stereo and thermal infrared video: algorithms and experimental evaluation , 2004, IEEE Transactions on Vehicular Technology.

[13]  A K Pradhan,et al.  The view from the road: the contribution of on-road glance-monitoring technologies to understanding driver behavior. , 2013, Accident; analysis and prevention.

[14]  Ignazio Gallo,et al.  Digital privacy: Replacing pedestrians from Google Street View images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[15]  Marco Zennaro,et al.  Large-scale privacy protection in Google Street View , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Linda Ng Boyle,et al.  Driver's lane keeping ability with eyes off road: Insights from a naturalistic study. , 2013, Accident; analysis and prevention.

[17]  P. J. Narayanan,et al.  Person De-Identification in Videos , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Mohan M. Trivedi,et al.  On the design and evaluation of robust head pose for visual user interfaces: algorithms, databases, and comparisons , 2012, AutomotiveUI.

[19]  Mohan Trivedi,et al.  Investigating the relationships between gaze patterns, dynamic vehicle surround analysis, and driver intentions , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[20]  Mohan M. Trivedi,et al.  Toward Privacy-Protecting Safety Systems for Naturalistic Driving Videos , 2014, IEEE Transactions on Intelligent Transportation Systems.

[21]  Serge J. Belongie,et al.  Removing pedestrians from Google street view images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[22]  M. Trivedi,et al.  Head and eye gaze dynamics during visual attention shifts in complex environments. , 2012, Journal of vision.