Driver Assistance System With a Dual Control Scheme: Effectiveness of Identifying Driver Drowsiness and Preventing Lane Departure Accidents

Driver drowsiness is a common cause of fatal traffic accidents. In this study, a driver assistance system with a dual control scheme is developed; it attempts to perform simultaneously the safety control of the vehicle and identification of the driver's state. The assistance system implements partial control in the event of lane departure and gives the driver the chance to voluntarily take the action needed. If the driver fails to implement the steering action needed within a limited time, the assistance system judges that “the driver's understanding of the given situation is incorrect” and executes the remaining control. We used a driving simulator equipped with the assistance system to investigate the effectiveness of identifying driver drowsiness and preventing lane departure accidents. Twenty students participated in three trials on a straight expressway, and they were required to implement only lateral control. We hypothesized that a participant cannot implement the action needed to maintain safety when he/she falls asleep, and that in such a case, the assistance system will implement the safety control repeatedly. The assistance system assisted the participants only when almost really needed, such as when their eyelids were closed. The results validated the hypothesis, showing that the assistance system implemented the safety control repeatedly when a participant fell asleep. In addition, the algorithms used by the assistance system to determine whether the driver can continue driving were evaluated through a leave-one-out cross-validation, and they were proven to be effective for identifying driver drowsiness.

[1]  T. Åkerstedt,et al.  Subjective sleepiness, simulated driving performance and blink duration: examining individual differences , 2006, Journal of sleep research.

[2]  Mona Omidyeganeh,et al.  Intelligent driver drowsiness detection through fusion of yawning and eye closure , 2011, 2011 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems Proceedings.

[3]  K. Yoshimoto Simulation of Man-Automobile Systems by the Driver's Steering Model with Predictability , 1968 .

[4]  C. Guilleminault,et al.  Determinants of sleepiness in automobile drivers. , 1996, Journal of psychosomatic research.

[5]  Makoto Itoh,et al.  Evaluating body movements of a drowsy driver with pressure distribution sensors , 2015 .

[6]  Masayoshi Kamijo,et al.  A Study of Facial Muscular Activities in Drowsy Expression , 2010 .

[7]  Yoshiyuki Ueno,et al.  131 EXPERIMENTAL STUDY ON PREDICTION OF SLEEP DURING WAKEFULNESS(O.S.5 Advanced Technology for Usage of Sound and Vibration III) , 2005 .

[8]  W W Wierwille,et al.  Evaluation of driver drowsiness by trained raters. , 1994, Accident; analysis and prevention.

[9]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[10]  T. Inagaki,et al.  Smart collaboration between humans and machines based on mutual understanding , 2008, Annu. Rev. Control..

[11]  G Maycock,et al.  Sleepiness and driving: the experience of U.K. car drivers. , 1997, Accident; analysis and prevention.

[12]  洋樹 北島,et al.  自動車運転時の眠気の予測手法についての研究 : 第1報, 眠気表情の評定法と眠気変動の予測に有効な指標について , 1997 .

[13]  S Motoyama,et al.  DEVELOPMENT OF LANE DEPARTURE WARNING SYSTEM , 2000 .

[14]  Kenji Ishida,et al.  Facial Expression Measurement for Detecting Driver Drowsiness , 2011, HCI.

[15]  H. Bubb,et al.  Methoden zur Entwicklung eines Fahrerbeobachters fuer ein System der aktiven Sicherheit / Methods to develop a driver observation system used in an active safety system , 2006 .

[16]  G. Kecklund,et al.  Sleepiness in long distance truck driving: an ambulatory EEG study of night driving. , 1993, Ergonomics.

[17]  P A Hancock,et al.  Alarm effectiveness in driver-centred collision-warning systems. , 1997, Ergonomics.

[18]  Hitoshi Soma,et al.  Designing Method of Warning Timing Based on the Time Criterion for Lane Departure Warning System , 2002 .

[19]  Andrew M. Pack,et al.  Characteristics of crashes attributed to the driver having fallen asleep. , 1995, Accident; analysis and prevention.

[20]  Toshiyuki Inagaki,et al.  ANALYSES OF DRIVER'S BODY MOVEMENT FOR DETECTION OF HYPOVIGILANCE DUE TO NON-DRIVING COGNITIVE TASK , 2006 .

[21]  Makoto Itoh,et al.  Dual control theoretic driver assistance - Dynamic characteristics of steering torque control based on linear quadratic regulator , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Heinz Unbehauen,et al.  Adaptive Dual Control: Theory and Applications , 2004 .

[23]  J. Horne,et al.  Vehicle accidents related to sleep: a review. , 1999, Occupational and environmental medicine.

[24]  Hiroshi Mouri,et al.  DESIGN OF LANE-KEEPING CONTROL WITH STEERING TORQUE INPUT , 2001 .

[25]  Wendy Macdonald,et al.  Review of Relationships Between Steering Wheel Reversal Rate and Driving Task Demand , 1980 .

[26]  Raúl Quintero,et al.  Drowsiness monitoring based on driver and driving data fusion , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[27]  M. Mitler,et al.  Methods of testing for sleepiness [corrected]. , 1996, Behavioral medicine.

[28]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[29]  T. Inagaki,et al.  Design of human–machine interactions in light of domain-dependence of human-centered automation , 2006, Cognition, Technology & Work.

[30]  다께시 기무라,et al.  Lane keeping assist device and lane keeping assist method , 2008 .

[31]  Graham Hole,et al.  The Future of Driving , 2018, The Psychology of Driving.

[32]  J. Horne,et al.  Sleep related vehicle accidents , 1995, BMJ.

[33]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[34]  M. Smolensky,et al.  Temporal patterns of reported single-vehicle car and truck accidents in Texas, U.S.A. during 1980-1983. , 1985, Chronobiology international.

[35]  Paul Milgram,et al.  The Development of a Time-Related Measure to Describe Driving Strategy , 1984 .

[36]  H Summala,et al.  Fatal Accidents among Car and Truck Drivers: Effects of Fatigue, Age, and Alcohol Consumption , 1994, Human factors.

[37]  Keiji Shimada,et al.  Estimation of Driver's Arousal State Using Multi-dimensional Physiological Indices , 2011, HCI.

[38]  T. Åkerstedt,et al.  Reaction of sleepiness indicators to partial sleep deprivation, time of day and time on task in a driving simulator – the DROWSI project , 2009, Journal of sleep research.

[39]  Брэд Игначак,et al.  warning system for a vehicle , 2015 .

[40]  Jean-Michel Hoc,et al.  Lateral Control Assistance for Car Drivers: A Comparison of Motor Priming and Warning Systems , 2007, Hum. Factors.

[41]  Håkan Jansson,et al.  An analysis of driver’s steering behaviour during auditory or haptic warnings for the designing of lane departure warning system , 2003 .

[42]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[43]  M. Beelke,et al.  The contributing role of sleepiness in highway vehicle accidents. , 2001, Sleep.

[44]  Dimitrios Tzovaras,et al.  Fuzzy Fusion of Eyelid Activity Indicators for Hypovigilance-Related Accident Prediction , 2008, IEEE Transactions on Intelligent Transportation Systems.

[45]  Huei Peng,et al.  Evaluation of automotive forward collision warning and collision avoidance algorithms , 2005 .

[46]  Jarek Krajewski,et al.  Steering wheel behavior based estimation of fatigue , 2017 .

[47]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[48]  Jean-Michel Hoc,et al.  Influence of risk expectation on haptically cued corrective manoeuvres during near lane departure , 2012, Ergonomics.

[49]  David Sandberg The performance of driver sleepiness indicators as a function of interval length , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).