Safety Awareness Online Detection System of Driving Behavior Based on Software and Hardware Co-design

The safety awareness online detection of driving behavior means that a kind of detection of the ongoing unsafe driving behavior as it starts but before it ends. This type of detection is significant important for achieving safe driving assistant because it is able to recognize the unsafe or aggressive driving behavior in advance and then give a buffer time to issue the vital alert. In order to achieve online detection, it is critical to reduce the processing time spent on the whole behavior recognition procedure, which usually is complex and involves a lot of computation loads. This paper proposes an approach to address the challenge by adopting a methodology of software and hardware co-design. We implement the most computation intensive stages of preprocessing and feature extraction as the hardware cores. A prototype safety awareness online behavior detection system is implemented on the programmable chip (SoPC) by using software and hardware co-design, and the experiment shows its effectiveness.

[1]  Lorenzo Torresani,et al.  CarSafe: a driver safety app that detects dangerous driving behavior using dual-cameras on smartphones , 2012, UbiComp.

[2]  Richard P. Martin,et al.  Toward Detection of Unsafe Driving with Wearables , 2015, WearSys@MobiSys.

[3]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[4]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys.

[5]  Cheng-Han Li,et al.  Hardware and Software Co-design of the Moving Object Tracking System , 2014, 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[6]  M. Amaç Güvensan,et al.  Driver Behavior Analysis for Safe Driving: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[7]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[8]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[9]  Harshvardhan Upadhyay,et al.  MULTI-MODEL BIOMETRICS AUTHENTICATION FRAMEWORK , 2016 .

[10]  Enrique Cantó,et al.  Hardware-software co-design of an iris recognition algorithm , 2011, IET Inf. Secur..

[11]  Norbert Schnell,et al.  Continuous Realtime Gesture Following and Recognition , 2009, Gesture Workshop.

[12]  Kang G. Shin,et al.  Invisible Sensing of Vehicle Steering with Smartphones , 2015, MobiSys.

[13]  Jin-Hyuk Hong,et al.  A smartphone-based sensing platform to model aggressive driving behaviors , 2014, CHI.

[14]  Erhan Akin,et al.  Estimating driving behavior by a smartphone , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[15]  Hongying Meng,et al.  Real-time human action recognition on an embedded, reconfigurable video processing architecture , 2008, Journal of Real-Time Image Processing.

[16]  Tomasz Kryjak,et al.  Real-time hardware–software embedded vision system for ITS smart camera implemented in Zynq SoC , 2018, Journal of Real-Time Image Processing.