Opportunistic IoT Service to Support Safety Driving from Heterogeneous Data Sources

The Internet of Things (IoT) represents an ecosystem where heterogeneous components seamlessly interoperate aiming to provide opportunistic (highly contextualized, dynamic, transient, and co-located) cyberphysical services in every application scenario, including smart automotive. Just in the context of advanced driving assistance systems, this paper proposes a modeling approach supporting the interactions among multiple Smart Objects (SOs, like Smartphone, Smart Bracelet, Smart Cushion, etc.) within the vehicle, in order to retrieve information regarding driver psycho-physical status and to alert if risky conditions (i.e., distraction, drowsiness, high stress level, or aggressive behaviors) are detected. The outlined “Driving Assistance Service” is expected to collect contextualized data from heterogeneous SOs (not purposely designed for implementing such service nor for interoperating), to perform data fusion and analysis, and finally to provide multimodal alerts on the driver’s smartphone. The goal of this work, indeed, is to show that the proposed metamodel-based approach facilitates the implementation of such an integrated IoT service, also improving the embedded and closed ADASs currently available at the state-of-the-art.

[1]  Giancarlo Fortino,et al.  Modelling and simulation of Opportunistic IoT Services with Aggregate Computing , 2019, Future Gener. Comput. Syst..

[2]  Luis Miguel Bergasa,et al.  Fusion of Optimized Indicators from Advanced Driver Assistance Systems (ADAS) for Driver Drowsiness Detection , 2014, Sensors.

[3]  Gang Li,et al.  Smartwatch-Based Wearable EEG System for Driver Drowsiness Detection , 2015, IEEE Sensors Journal.

[4]  Xuesong Wang,et al.  Driver drowsiness detection based on non-intrusive metrics considering individual specifics. , 2016, Accident; analysis and prevention.

[5]  G. Fortino,et al.  SPINE-HRV: A BSN-Based Toolkit for Heart Rate Variability Analysis in the Time-Domain , 2010 .

[6]  Tianwei Shi,et al.  Real-Time EEG-Based Detection of Fatigue Driving Danger for Accident Prediction , 2015, Int. J. Neural Syst..

[7]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[8]  Mudhakar Srivatsa,et al.  Darnet: a deep learning solution for distracted driving detection , 2017, Middleware '17.

[9]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .

[10]  Yu Zhang,et al.  Activity recognition of wheelchair users based on sequence feature in time-series , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[11]  K. U. G. S. Darshana,et al.  Riyadisi — Intelligent driver monitoring system , 2013, 2013 International Conference on Advances in ICT for Emerging Regions (ICTer).

[12]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[13]  MengChu Zhou,et al.  Opportunistic cyberphysical services: A novel paradigm for the future Internet of Things , 2018, 2018 IEEE 4th World Forum on Internet of Things (WF-IoT).

[14]  Christine L. Lisetti Affective Intelligent Car Interfaces with Emotion Recognition , 2005 .

[15]  Jean-Philippe Thiran,et al.  Detecting emotional stress from facial expressions for driving safety , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Reinhard Klette,et al.  Driver Drowsiness Detection , 2017 .

[17]  MengChu Zhou,et al.  Modeling Opportunistic IoT Services in Open IoT Ecosystems , 2017, WOA.

[18]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[19]  Enrico Grosso,et al.  Real time detection of driver attention: Emerging solutions based on robust iconic classifiers and dictionary of poses , 2014 .

[20]  Thierry Derrmann,et al.  Driver Behavior Profiling Using Smartphones: A Low-Cost Platform for Driver Monitoring , 2015, IEEE Intelligent Transportation Systems Magazine.

[21]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[22]  Raffaele Gravina,et al.  Emotion-relevant activity recognition based on smart cushion using multi-sensor fusion , 2019, Inf. Fusion.

[23]  Franklin M. Silva,et al.  Real Time Driver Drowsiness Detection Based on Driver's Face Image Behavior Using a System of Human Computer Interaction Implemented in a Smartphone , 2018, ICITS.

[24]  Giancarlo Fortino,et al.  Enabling IoT interoperability through opportunistic smartphone-based mobile gateways , 2017, J. Netw. Comput. Appl..