Safe semi-autonomous control with enhanced driver modeling

During semi-autonomous driving, threat assessment is used to determine when controller intervention that overwrites or corrects the driver's input is required. Since today's semi-autonomous systems perform threat assessment by predicting the vehicle's future state while treating the driver's input as a disturbance, controller intervention is limited to just emergency maneuvers. In order to improve vehicle safety and reduce the aggressiveness of maneuvers, threat assessment must occur over longer prediction horizons where driver's behavior cannot be neglected. We propose a framework that divides the problem of semi-autonomous control into two components. The first component reliably predicts the vehicle's potential behavior by using empirical observations of the driver's pose. The second component determines when the semi-autonomous controller should intervene. To quantitatively measure the performance of the proposed approach, we define metrics to evaluate the infor-mativeness of the prediction and the utility of the intervention procedure. A multi-subject driving experiment illustrates the usefulness, with respect to these metrics, of incorporating the driver's pose while designing a semi-autonomous system.

[1]  J. C. Stutts,et al.  Driver inattention, driver distraction and traffic crashes , 2003 .

[2]  Peter Meer,et al.  Nonlinear Mean Shift over Riemannian Manifolds , 2009, International Journal of Computer Vision.

[3]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[4]  Jonathan P. How,et al.  Threat assessment design for driver assistance system at intersections , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[5]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[6]  Sterling J. Anderson,et al.  An optimal-control-based framework for trajectory planning, threat assessment, and semi-autonomous control of passenger vehicles in hazard avoidance scenarios , 2010 .

[7]  R. Jafari,et al.  Body sensor networks for driver distraction identification , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[8]  John D. Lee,et al.  Driver Distraction : Theory, Effects, and Mitigation , 2008 .

[9]  Osama Masoud,et al.  Vision-based methods for driver monitoring , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[10]  Sebastian Thrun,et al.  A Personal Account of the Development of Stanley, the Robot That Won the DARPA Grand Challenge , 2006, AI Mag..

[11]  Alberto Bemporad,et al.  Model predictive control based on linear programming - the explicit solution , 2002, IEEE Transactions on Automatic Control.

[12]  Pravin Varaiya,et al.  Smart cars on smart roads: problems of control , 1991, IEEE Trans. Autom. Control..

[13]  Maria E. Jabon,et al.  Facial expression analysis for predicting unsafe driving behavior , 2011, IEEE Pervasive Computing.

[14]  Luis M. Bergasa,et al.  Real-time system for monitoring driver vigilance , 2005, ISIE 2005.

[15]  Alex Pentland,et al.  Graphical models for driver behavior recognition in a SmartCar , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[16]  A. Bemporad,et al.  Efficient on-line computation of constrained optimal control , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[17]  Pekka Aavikko,et al.  Network Time Protocol , 2010 .

[18]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[19]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[20]  D Basacik,et al.  Scoping study of driver distraction , 2008 .

[21]  Lotta Jakobsson,et al.  Collision Warning with Auto Brake - A Real-Life Safety Perspective , 2007 .

[22]  Cherian Varghese,et al.  An Examination of Driver Distraction as Recorded in NHTSA Databases , 2009 .

[23]  Dot Hs The Impact of Driver Inattention On Near-Crash/Crash Risk: , 2006 .

[24]  Hadas Kress-Gazit,et al.  Courteous Cars , 2008, IEEE Robotics & Automation Magazine.

[25]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[26]  Linda Ng Boyle,et al.  The Impact of Distraction Mitigation Strategies on Driving Performance , 2006, Hum. Factors.

[27]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[28]  Alberto Bemporad,et al.  Efficient On-Line Computation of Constrained Optimal Control , 2008, SIAM J. Control. Optim..

[29]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[30]  Linda Ng Boyle,et al.  Safety implications of providing real-time feedback to distracted drivers. , 2007, Accident; analysis and prevention.