Detecting Physiological Changes in Response to Sudden Events in Driving: A Nonlinear Dynamics Approach

In this study, we propose a novel analytic framework to detect emergency braking intentions in driving tasks by capturing the delay in human responses using multimodal biosensor data, e.g., electroencephalography (EEG) and electromyography (EMG). To quantity the response delay, we consider EEG and EMG signals as a coupled dynamic system and employ a recurrence plot (RP) based approach to characterize the nonlinear dynamics. We then apply the maximally stable extremal regions (MSER) method in computer vision for detecting transition states associated with sudden events (e.g., braking intentions in driving). Our proposed framework is tested on a publicly available dataset of driving experiments. The results demonstrate the effectiveness of our proposed approach for assessing the response delay to reflect the motor control command, which shows that the average response delays to the braking intentions are 300 milliseconds in EEG and 194 milliseconds in EMG prior to the actual emergency braking. The proposed quantification can be employed in driving assistant system for reducing or diminishing potential accidents.

[1]  John L. Andreassi,et al.  Psychophysiology: Human Behavior & Physiological Response , 2000 .

[2]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[3]  A Lie,et al.  Effectiveness of low speed autonomous emergency braking in real-world rear-end crashes. , 2015, Accident; analysis and prevention.

[4]  Hairi Zamzuri,et al.  Autonomous emergency braking system with potential field risk assessment for frontal collision mitigation , 2017, 2017 IEEE Conference on Systems, Process and Control (ICSPC).

[5]  Mohan M. Trivedi,et al.  Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles , 2007, Proceedings of the IEEE.

[6]  Klaus C. J. Dietmayer,et al.  Situation Assessment of an Autonomous Emergency Brake for Arbitrary Vehicle-to-Vehicle Collision Scenarios , 2009, IEEE Transactions on Intelligent Transportation Systems.

[7]  J. Kurths,et al.  Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[9]  E. Bradley,et al.  Recurrence plots of experimental data: To embed or not to embed? , 1998, Chaos.

[10]  David Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1995 .

[11]  Andrzej Sluzek,et al.  A maximally stable extremal regions system-on-chip for real-time visual surveillance , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[12]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[13]  Stefan Haufe,et al.  Electrophysiology-based detection of emergency braking intention in real-world driving , 2014, Journal of neural engineering.