Don't Sleep and Drive - VW's Fatigue Detection Technology

This paper takes an in-depth look at an innovative driver state monitoring system, which VW has developed to assist drivers. The system is designed to help drivers manage their physical and mental resources properly when they are behind the wheel. The article begins by explaining the motivation that led to the development of the system and then goes on to discuss the characteristics of the physical and cognitive states under observation as well as the system hardware and software components. The reader is given an insight into the empirical derivation of the prediction algorithm. The article also presents the results of the initial customer survey.

[1]  Takayuki Watanabe,et al.  Research on a Brake Assist System with a Preview Function , 2001 .

[2]  Alan L. Browne,et al.  AN EXTENDABLE AND RETRACTABLE KNEE BOLSTER , 2003 .

[3]  Takeshi Yamamoto,et al.  PRE-CRASH SENSOR FOR PRE-CRASH SAFETY , 2003 .

[4]  T J Hirsch.  LONGITUDINAL BARRIERS FOR BUSES AND TRUCKS , 1986 .

[5]  W. J. Fleming,et al.  Overview of automotive sensors , 2001 .

[6]  W. van der Mark,et al.  A comparative study of fast dense stereo vision algorithms , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[7]  Tim Horberry,et al.  REVIEW OF FATIGUE DETECTION AND PREDICTION TECHNOLOGIES , 2000 .

[8]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[9]  D. Dinges,et al.  Performing while sleepy: Effects of experimentally-induced sleepiness. , 1991 .

[10]  Charles C. Adams,et al.  Safety Aspects of CRT Touch Panel Controls in Automobiles , 1988 .

[11]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[12]  Wassim G. Najm,et al.  ANALYSIS OF LANE CHANGE CRASHES , 2003 .

[13]  D.J. Verburg,et al.  Pre-crash system validation with PRESCAN and VEHIL , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[14]  Hans-Jörg Bullinger,et al.  Virtual prototyping and testing of in-vehicle interfaces , 2003, Ergonomics.

[15]  Thomas S. Huang,et al.  Image processing , 1971 .

[16]  Rfc Ruud Kriens,et al.  The Necessity of an Adaptive Vehicle Structure to Optimize Deceleration Pulses for Different Crash Velocities , 2001 .

[17]  W. Lynn Beason,et al.  SINGLE-SLOPE CONCRETE MEDIAN BARRIER , 1991 .

[18]  C E Buth,et al.  Loads on bridge railings , 1981 .

[19]  Jens Rasmussen,et al.  Human errors. a taxonomy for describing human malfunction in industrial installations , 1982 .

[20]  Anil K. Jain,et al.  Deformable template models: A review , 1998, Signal Process..

[21]  John D Schulz.  IN A HURRY , 2003 .

[22]  Wassim G. Najm,et al.  Feasibility of Driver Judgment as Basis for a Crash Avoidance Database , 2002 .

[23]  B Fishburn,et al.  Road safety barrier systems , 1998 .

[24]  Charles E. Thorpe,et al.  Perception for collision avoidance and autonomous driving , 2003 .

[25]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Dennis A. Guenther,et al.  PARAMETER MEASUREMENT AND DEVELOPMENT OF A NADSDYNA VALIDATION DATA SET FOR A 1994 FORD TAURUS , 1997 .

[27]  J L Beaton,et al.  FULL SCALE TESTS OF CONCRETE BRIDGE RAILS SUBJECTED TO AUTOMOBILE IMPACTS , 1956 .

[28]  Mohamed Abdel-Aty,et al.  Analysis and prediction of traffic fatalities resulting from angle collisions including the effect of vehicles' configuration and compatibility. , 2004, Accident; analysis and prevention.

[29]  S Talmadge,et al.  DESCRIPTION AND PRELIMINARY DATA FROM TRW'S LANE CHANGE COLLISION AVOIDANCE TESTBED , 2000 .

[30]  J. Happian-Smith,et al.  An evaluation of the benefits of active restraint systems in frontal impacts through computer modelling and dynamic testing , 2001 .

[31]  Sueharu Nagiri,et al.  Evaluation of active safety performance of man-vehicle system , 1998 .

[32]  K.Z. Mao,et al.  Orthogonal forward selection and backward elimination algorithms for feature subset selection , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Raymond J. Kiefer.  Developing a Forward Collision Warning System Timing and Interface Approach by Placing Drivers in Realistic Rear-End Crash Situations , 2000 .

[34]  Ginger S. Watson,et al.  Examination of the Distraction Effects of Wireless Phone Interfaces Using the National Advanced Driving Simulator - Preliminary Report on Freeway Pilot Study , 2004 .

[35]  Bram van Ginneken,et al.  Automatic delineation of ribs in frontal chest radiographs , 2000, Medical Imaging: Image Processing.

[36]  Donal Heffernan,et al.  Expanding Automotive Electronic Systems , 2002, Computer.

[37]  R. Wilcox.  Kolmogorov–Smirnov Test , 2005 .

[38]  Gary J. Heydinger,et al.  Model Validation of the 1997 Jeep Cherokee for the National Advanced Driving Simulator , 2000 .

[39]  R Justen,et al.  Pre-safe - the next step in the enhancement of vehicle safety , 2003 .

[40]  O. J. Gietelink,et al.  Pre-crash system design and evaluation using Prescan, Vehil and Madymo , 2004 .

[41]  Julian Hill,et al.  THE EFFECT OF OCCUPANT CHARACTERISTICS ON INJURY RISK AND THE DEVELOPMENT OF ACTIVE-ADAPTIVE RESTRAINT SYSTEMS , 2001 .

[42]  Roger Zou,et al.  Roadside Hazard and Barrier Crashworthiness Issues Confronting Vehicle and Barrier Manufacturers and Government Regulators , 2005 .

[43]  P. Faber,et al.  A system architecture for an intelligent airbag deployment , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[44]  Chuck A. Plaxico,et al.  Impact Performance of the G4(1W) and G4(2W) Guardrail Systems: Comparison Under NCHRP Report 350 Test 3-11 Conditions , 2000 .

[45]  Kevin J. McClafferty,et al.  The Use of Event Data Recorders in the Analysis of Real-World Crashes , 2001 .

[46]  B L Cole,et al.  Visibility of traffic control devices: catering for the real observer. , 1976, Ergonomics.

[47]  P. Haggard.  Look and feel , 2001, Trends in Cognitive Sciences.

[48]  Dominique Gruyer,et al.  Merging lateral cameras information with proprioceptive sensors in vehicle location gives centimetric precision , 2003 .

[49]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[50]  J Lenard,et al.  Male and female car drivers--differences in collision and injury risks. , 2001, Annual proceedings. Association for the Advancement of Automotive Medicine.

[51]  Dennis A. Guenther,et al.  Vehicle dynamics modeling for the national advanced driving simulator of a 1997 jeep Cherokee , 1999 .

[52]  Z. Papp,et al.  An integrated design and validation environment for intelligent vehicle safety systems (IVSS) , 2003 .

[53]  D. Dinges,et al.  EVALUATION OF TECHNIQUES FOR OCULAR MEASUREMENT AS AN INDEX OF FATIGUE AND THE BASIS FOR ALERTNESS MANAGEMENT , 1998 .

[54]  Peter Rücker,et al.  Motorcycle Impacts into Roadside Barriers – Real-World Accident Studies, Crash Tests and Simulations Carried Out in Germany and Australia , 2005 .

[55]  Stein E. Husher,et al.  Vehicle Impact Response Analysis Through the Use of Accelerometer Data , 2000 .

[56]  King K. Mak,et al.  SINGLE-SLOPE CONCRETE BRIDGE RAIL , 1994 .

[57]  L. Rodney Long,et al.  World Wide Web platform-independent access to biomedical text/image databases , 1998, Medical Imaging.

[58]  Thierry Mousel,et al.  TOR (TOTAL OCCUPANT RECOGNITION) SYSTEM , 2001 .

[59]  Saravanan M. Peelamedu,et al.  Impact analysis of automotive structures with distributed smart material systems , 1999, Smart Structures.

[60]  C Gelau,et al.  ALTERSUNTERSCHIEDE IM ENTSCHEIDUNGSVERHALTEN AN LICHTSIGNALGEREGELTEN KNOTENPUNKTEN , 1994 .

[61]  Simon Lacroix,et al.  Evaluation of stereo matching algorithms for occupant detection , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[62]  C D Wylie,et al.  COMMERCIAL MOTOR VEHICLE DRIVER FATIGUE AND ALERTNESS STUDY: PROJECT REPORT , 1996 .

[63]  Raphael H. Grzebieta,et al.  Roadside crash barrier testing , 2002 .

[64]  Xiaowei Li,et al.  A COMPARATIVE ANALYSIS OF VEHICLE-TO-VEHICLE AND VEHICLE -TO-RIGID FIXED BARRIER FRONTAL IMPACTS , 2001 .

[65]  L Rickertsen.  CLEAR AS DAY , 2004 .

[66]  E. G. Janssen,et al.  European vehicle passive safety network , 1999 .

[67]  Mohan M. Trivedi,et al.  Occupant posture analysis with stereo and thermal infrared video: algorithms and experimental evaluation , 2004, IEEE Transactions on Vehicular Technology.

[68]  Ginger S. Watson,et al.  Hand-Held or Hands-Free? The Effects of Wireless Phone Interface Type on Phone Task Performance and Driver Preference , 2004 .

[69]  Raphael H. Grzebieta,et al.  Predicting impact loads of a car crashing into a concrete roadside safety barrier , 2004 .

[70]  Paul A. Grygier,et al.  Evaluation of Heavy Tractor-Trailer Model used in the National Advanced Driving Simulator , 2003 .

[71]  Burkard Wördenweber.  Driver assistance through lighting , 2001 .

[72]  Valentin Ivanov,et al.  Tendencies recognition and analysis of critical situations by the active safety systems , 2001 .

[73]  Paul A. Fay,et al.  POTENTIAL EFFECTIVENESS OF ELECTRONIC STABILITY PROGRAMS (ESP) - WHAT EUROPEAN FIELD STUDIES TELL US , 2001 .

[74]  Nico A. Kelling,et al.  The BRAKE Project - Centralized Versus Distributed Redundancy for Brake-by-Wire Systems , 2002 .

[75]  W G Najm.  IDENTIFICATION OF PRE-CRASH SCENARIOS FOR ESTIMATING THE SAFETY BENEFITS OF REAR-END COLLISION AVOIDANCE SYSTEMS , 1998 .

[76]  I. Brown,et al.  Vision in Vehicles III , 1991 .

[77]  Shun'ichi Doi,et al.  An Evaluation of Vehicle Steering Arrangement with Dexterity Measures of Virtual Human , 2001 .

[78]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[79]  Christopher J. Taylor,et al.  Automatic measurement of vertebral shape using active shape models , 1997, Image Vis. Comput..

[80]  Christopher D. Wickens,et al.  Does Workload Modulate the Effects of In-Vehicle Display Location on Concurrent Driving and Side Task Performance? , 2003 .

[81]  Jolyon Meara.  Parkinson's disease and parkinsonism in the elderly: A glossary of terms , 2000 .

[82]  Eduardo Nebot,et al.  Sensors Used for Autonomous Navigation , 1999 .

[83]  John Whittaker,et al.  Rules of Thumb , 1996 .

[84]  Alberto Broggi,et al.  Applications of computer vision to intelligent , 2000, Image Vis. Comput..

[85]  Hiroyuki Koike,et al.  REAR-END COLLISION AVOIDANCE ASSIST SYSTEM , 2003 .

[86]  Franjo Pernus,et al.  Statistical approach to anatomical landmark extraction in AP radiographs , 2001, SPIE Medical Imaging.

[87]  Tetsuo Maki,et al.  Development of pedestrian protection technologies for ASV , 2002 .

[88]  W. James,et al.  The Principles of Psychology. , 1983 .

[89]  Robert A. Galganski,et al.  CRASH VISUALIZATION USING REAL-WORLD ACCELERATION DATA , 2001 .

[90]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[91]  Hyun-Yong Jeong,et al.  New algorithm and accelerometer locations for frontal crash discrimination , 2001 .

[92]  Anders Kullgren,et al.  DEVELOPMENT OF A CRASHWORTHY SYSTEM: INTERACTION BETWEEN CAR STRUCTURAL INTEGRITY, RESTRAINT SYSTEMS AND GUARDRAILS , 2001 .

[93]  Anil K. Jain,et al.  Occupant classification system for automotive airbag suppression , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[94]  N. Warren,et al.  Blocking in mental and motor tasks during a 65-hour vigil. , 1937 .

[95]  J Mateja.  WARNING SYSTEM SHEDS LIGHT ON BLIND SPOT , 1995 .

[96]  Timothy F. Cootes,et al.  Active Shape Models and the shape approximation problem , 1996, Image Vis. Comput..

[97]  Wanda L Menges,et al.  Performance level 3 bridge railings , 1995 .

[98]  Paul A. Grygier,et al.  Parameter Determination and Vehicle Dynamics Modeling for the NADS of the 1998 Chevrolet Malibu , 2001 .

[99]  Wassim G. Najm,et al.  Comparison of alternative crash-avoidance sensor technologies , 1995, Other Conferences.

[100]  Zehang Sun,et al.  A real-time precrash vehicle detection system , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[101]  Klaus Bengler,et al.  Evaluation of in-vehicle HMI using occlusion techniques: experimental results and practical implications. , 2004, Applied ergonomics.

[102]  Paul A. Grygier,et al.  Model Validation of the 1998 Chevrolet Malibu for the National Advanced Driving Simulator , 2001 .

[103]  P Fancher,et al.  Intelligent Cruise Control Field Operational Test , 1997 .

[104]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[105]  P Moffa,et al.  DEVELOPMENT OF PERFORMANCE SPECIFICATIONS FOR COLLISIONS AVOIDANCE SYSTEMS FOR LANE CHANGE CRASHES , 2000 .

[106]  Jeroen Hogema,et al.  TIME-TO-COLLISION AND COLLISION AVOIDANCE SYSTEMS , 1994 .

[107]  Holger Zeltwanger,et al.  Time-Triggered Communication on CAN , 2002 .

[108]  Matthew P. Reed,et al.  Comparison of driving performance on-road and in a low-cost simulator using a concurrent telephone dialling task , 1999 .

[109]  Bayan S. Sharif,et al.  Skeletal growth estimation using radiographic image processing and analysis , 2000, IEEE Transactions on Information Technology in Biomedicine.

[110]  Richard C. Lind,et al.  An integrated approach to automotive safety systems , 2000 .

[111]  Dot Hs.  Investigation of Driver Reactions to Tread Separation Scenarios in the National Advanced Driving Simulator (NADS) , 2003 .

[112]  Richard Cuerden,et al.  THE POTENTIAL EFFECTIVENESS OF ADAPTIVE RESTRAINTS , 2001 .

[113]  Rainer Justen,et al.  The Vision of a Comprehensive Safety Concept , 2001 .

[114]  Qingfeng Huang,et al.  An adaptive peer-to-peer collision warning system , 2002, Vehicular Technology Conference. IEEE 55th Vehicular Technology Conference. VTC Spring 2002 (Cat. No.02CH37367).

[115]  Richard A. Glassco,et al.  FEASIBILITY OF MODELING LANE-CHANGE PERFORMANCE , 2003 .

[116]  Lori Summers,et al.  Development of an Occupant Position Sensor System to Improve Frontal Crash Protection , 2001 .

[117]  Glenn R. Widmann,et al.  Comparison of Lidar-Based and Radar-Based Adaptive Cruise Control Systems , 2000 .

[118]  Marcus Klomark,et al.  Occupant Detection using Computer Vision , 2000 .

[119]  John Hinch,et al.  REAL WORLD EXPERIENCE WITH EVENT DATA RECORDERS , 2001 .

[120]  Hitoshi Kanamori,et al.  A human factors study of switches installed on automotive steering wheel , 2003 .

[121]  J.C.M Kleijweg,et al.  Design and validation of a virtual fmcw radar for automotive applications , 2004 .

[122]  Timothy F. Cootes,et al.  Statistical Grey-Level Models for Object Location and Identification , 1995, BMVC.

[123]  C E Buth,et al.  PERFORMANCE LEVEL 2 BRIDGE RAILINGS , 1990 .

[124]  Elizabeth N. Mazzae,et al.  Wireless Phone and AutoPC Related Technology: Driver Distraction and Use Effects on the Road , 2004 .

[125]  Suzanne E. Lee,et al.  A COMPREHENSIVE EXAMINATION OF NATURALISTIC LANE-CHANGES , 2004 .