Driver Fatigue Detection Systems Using Multi-Sensors, Smartphone, and Cloud-Based Computing Platforms: A Comparative Analysis

Internet of things (IoT) cloud-based applications deliver advanced solutions for smart cities to decrease traffic accidents caused by driver fatigue while driving on the road. Environmental conditions or driver behavior can ultimately lead to serious roadside accidents. In recent years, the authors have developed many low-cost, computerized, driver fatigue detection systems (DFDs) to help drivers, by using multi-sensors, and mobile and cloud-based computing architecture. To promote safe driving, these are the most current emerging platforms that were introduced in the past. In this paper, we reviewed state-of-the-art approaches for predicting unsafe driving styles using three common IoT-based architectures. The novelty of this article is to show major differences among multi-sensors, smartphone-based, and cloud-based architectures in multimodal feature processing. We discussed all of the problems that machine learning techniques faced in recent years, particularly the deep learning (DL) model, to predict driver hypovigilance, especially in terms of these three IoT-based architectures. Moreover, we performed state-of-the-art comparisons by using driving simulators to incorporate multimodal features of the driver. We also mention online data sources in this article to test and train network architecture in the field of DFDs on public available multimodal datasets. These comparisons assist other authors to continue future research in this domain. To evaluate the performance, we mention the major problems in these three architectures to help researchers use the best IoT-based architecture for detecting DFDs in a real-time environment. Moreover, the important factors of Multi-Access Edge Computing (MEC) and 5th generation (5G) networks are analyzed in the context of deep learning architecture to improve the response time of DFD systems. Lastly, it is concluded that there is a research gap when it comes to implementing the DFD systems on MEC and 5G technologies by using multimodal features and DL architecture.

[1]  Shutao Wang,et al.  Real-time Alarm Monitoring System for Detecting Driver Fatigue in Wireless Areas , 2017 .

[2]  Mario Muñoz-Organero,et al.  Predicting Upcoming Values of Stress While Driving , 2017, IEEE Transactions on Intelligent Transportation Systems.

[3]  Hyeran Byun,et al.  Efficient Measurement of the Eye Blinking by Using Decision Function for Intelligent Vehicles , 2007, International Conference on Computational Science.

[4]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Majid A. Al-Taee,et al.  HRV-based operator fatigue analysis and classification using wearable sensors , 2016, 2016 13th International Multi-Conference on Systems, Signals & Devices (SSD).

[6]  Charles Gouin-Vallerand,et al.  Feature selection for driving fatigue characterization and detection using visual- and signal-based sensors , 2018, Applied Informatics.

[7]  Mohamed Abdel-Aty,et al.  Utilizing UAV video data for in-depth analysis of drivers' crash risk at interchange merging areas. , 2019, Accident; analysis and prevention.

[8]  Sheikh Ziauddin,et al.  Driver Fatigue Detection Using Viola Jones and Principal Component Analysis , 2020, Appl. Artif. Intell..

[9]  Sarbani Roy,et al.  Smartphone based system for real-time aggressive driving detection and marking rash driving-prone areas , 2018, ICDCN Workshops.

[10]  Ronald R Knipling,et al.  Vehicle-based drowsy driver detection : current status and future prospects , 1994 .

[11]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[12]  Jiahui Pan,et al.  Convolutional Two-Stream Network Using Multi-Facial Feature Fusion for Driver Fatigue Detection , 2019, Future Internet.

[13]  Wan-Young Chung,et al.  Smartwatch-Based Driver Vigilance Indicator With Kernel-Fuzzy-C-Means-Wavelet Method , 2016, IEEE Sensors Journal.

[14]  Hans P A Van Dongen,et al.  Efficient driver drowsiness detection at moderate levels of drowsiness. , 2013, Accident; analysis and prevention.

[15]  Bao-Liang Lu,et al.  A multimodal approach to estimating vigilance using EEG and forehead EOG , 2016, Journal of neural engineering.

[16]  Mahesh H. Dodani,et al.  The Silver Lining of Cloud Computing , 2009, J. Object Technol..

[17]  Deepak Khosla,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2014, International Journal of Computer Vision.

[18]  Yu Zhu,et al.  Hierarchical CNN-based real-time fatigue detection system by visual-based technologies using MSP model , 2018, IET Image Process..

[19]  Jie Li,et al.  A Hybrid Vigilance Monitoring Study for Mental Fatigue and Its Neural Activities , 2015, Cognitive Computation.

[20]  Lin Wu,et al.  PersonNet: Person Re-identification with Deep Convolutional Neural Networks , 2016, ArXiv.

[21]  Zhendong Mu,et al.  Developing and evaluating a mobile driver fatigue detection network based on electroencephalograph signals , 2017, Healthcare technology letters.

[22]  Fengfeng Zhou,et al.  Accurate Fatigue Detection Based on Multiple Facial Morphological Features , 2019, J. Sensors.

[23]  Peter M. Corcoran,et al.  Statistical models of appearance for eye tracking and eye-blink detection and measurement , 2008, IEEE Transactions on Consumer Electronics.

[24]  John D Lee,et al.  A contextual and temporal algorithm for driver drowsiness detection. , 2018, Accident; analysis and prevention.

[25]  Imen Jegham,et al.  A novel public dataset for multimodal multiview and multispectral driver distraction analysis: 3MDAD , 2020, Signal Process. Image Commun..

[26]  M. Amaç Güvensan,et al.  Driver Behavior Analysis for Safe Driving: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[27]  Yan Yang,et al.  Driver Drowsiness Detection Based on Novel Eye Openness Recognition Method and Unsupervised Feature Learning , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[28]  Shahzad Anwar,et al.  Driver Fatigue Detection Systems: A Review , 2019, IEEE Transactions on Intelligent Transportation Systems.

[29]  Peng Li,et al.  A Novel Cloud Computing Architecture Oriented Internet of Vehicles , 2016, 3PGCIC.

[30]  Abdelhamid Mellouk,et al.  Data dissemination for Internet of vehicle based on 5G communications: A survey , 2020, Trans. Emerg. Telecommun. Technol..

[31]  Subramanian Arumugam,et al.  A survey on driving behavior analysis in usage based insurance using big data , 2019, Journal of Big Data.

[32]  Fei Pan,et al.  Driver Drowsiness Detection System Based on Feature Representation Learning Using Various Deep Networks , 2016, ACCV Workshops.

[33]  Qiang Ji,et al.  A joint cascaded framework for simultaneous eye detection and eye state estimation , 2017, Pattern Recognit..

[34]  Xi He,et al.  Cloud Computing: a Perspective Study , 2010, New Generation Computing.

[35]  Aurobinda Routray,et al.  A Multimodal System for Assessing Alertness Levels Due to Cognitive Loading , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Rifai Chai,et al.  Driver Fatigue Classification With Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System , 2017, IEEE Journal of Biomedical and Health Informatics.

[37]  Samir El Kaddouhi,et al.  Eye detection based on the Viola-Jones method and corners points , 2017, Multimedia Tools and Applications.

[38]  Kang Ryoung Park,et al.  Deep Learning-Based Gaze Detection System for Automobile Drivers Using a NIR Camera Sensor , 2018, Sensors.

[39]  Chin-Teng Lin,et al.  Multi-channel EEG recordings during a sustained-attention driving task , 2018, Scientific Data.

[40]  Qi Zhang,et al.  Webcam-based, non-contact, real-time measurement for the physiological parameters of drivers , 2017 .

[41]  Stefanos Zafeiriou,et al.  A Semi-automatic Methodology for Facial Landmark Annotation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[42]  Alexey Kashevnik,et al.  Cloud-Based Driver Monitoring System Using a Smartphone , 2020, IEEE Sensors Journal.

[43]  Fernando García,et al.  Data Fusion for Driver Behaviour Analysis , 2015, Sensors.

[44]  Michael Schrauf,et al.  EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions , 2011, Clinical Neurophysiology.

[45]  Wan-Young Chung,et al.  A Smartphone-Based Driver Safety Monitoring System Using Data Fusion , 2012, Sensors.

[46]  Mohamed Abouelenien,et al.  Cascaded multimodal analysis of alertness related features for drivers safety applications , 2015, PETRA.

[47]  Rahul K. Kher,et al.  Mobile and E-Healthcare: Recent Trends and Future Directions , 2016 .

[48]  Victor C. M. Leung,et al.  Health Drive: Mobile Healthcare Onboard Vehicles to Promote Safe Driving , 2015, 2015 48th Hawaii International Conference on System Sciences.

[49]  Ling Huang,et al.  Monitoring drivers’ sleepy status at night based on machine vision , 2016, Multimedia Tools and Applications.

[50]  Jennifer Healey,et al.  SmartCar: detecting driver stress , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[51]  Victor C. M. Leung,et al.  SAfeDJ , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[52]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[53]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[54]  Marco Congedo,et al.  EEG Alpha Waves Dataset , 2018 .

[55]  Xuelong Li,et al.  Detection of Co-salient Objects by Looking Deep and Wide , 2016, International Journal of Computer Vision.

[56]  Mari Carmen Domingo,et al.  Integration of Body Sensor Networks and Vehicular Ad-hoc Networks for Traffic Safety , 2016, Sensors.

[57]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[58]  Alaa Mohamed Riad,et al.  A machine learning model for improving healthcare services on cloud computing environment , 2018 .

[59]  Christer Ahlström,et al.  Driver Sleepiness Classification Based on Physiological Data and Driving Performance From Real Road Driving , 2019, IEEE Transactions on Intelligent Transportation Systems.

[60]  Xavier Fernando,et al.  Fog Assisted Driver Behavior Monitoring for Intelligent Transportation System , 2017, 2017 IEEE 86th Vehicular Technology Conference (VTC-Fall).

[61]  Klaus Wehrle,et al.  A comprehensive approach to privacy in the cloud-based Internet of Things , 2016, Future Gener. Comput. Syst..

[62]  A. Morales,et al.  mEBAL: A Multimodal Database for Eye Blink Detection and Attention Level Estimation , 2020, ICMI Companion.

[63]  Mehdi Bennis,et al.  Wireless Network Intelligence at the Edge , 2018, Proceedings of the IEEE.

[64]  Doug Johnson,et al.  Computing in the Clouds. , 2010 .

[65]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[66]  Rongrong Fu,et al.  Automated Detection of Driver Fatigue Based on Entropy and Complexity Measures , 2014, IEEE Transactions on Intelligent Transportation Systems.

[67]  Deng Cai,et al.  Tracking people in RGBD videos using deep learning and motion clues , 2016, Neurocomputing.

[68]  Akshay Bhaskar EyeAwake: A cost effective drowsy driver alert and vehicle correction system , 2017, 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS).

[69]  Ausif Mahmood,et al.  Deep face liveness detection based on nonlinear diffusion using convolution neural network , 2016, Signal, Image and Video Processing.

[70]  Necmettin Sezgin,et al.  The ANN-based computing of drowsy level , 2009, Expert Syst. Appl..

[71]  Ko Keun Kim,et al.  A Smart Health Monitoring Chair for Nonintrusive Measurement of Biological Signals , 2012, IEEE Transactions on Information Technology in Biomedicine.

[72]  Azzedine Boukerche,et al.  Vehicular cloud computing: Architectures, applications, and mobility , 2018, Comput. Networks.

[73]  Johnathon P Ehsani,et al.  Measuring Risky Driving Behavior Using an mHealth Smartphone App: Development and Evaluation of gForce , 2018, JMIR mHealth and uHealth.

[74]  José Manuel Ferrández,et al.  EEG-Based Detection of Braking Intention Under Different Car Driving Conditions , 2018, Front. Neuroinform..

[75]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[76]  Zhu Wang,et al.  CrowdSafe: Detecting extreme driving behaviors based on mobile crowdsensing , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[77]  Bo-Yeong Kang,et al.  Multimodal System to Detect Driver Fatigue Using EEG, Gyroscope, and Image Processing , 2020, IEEE Access.

[78]  Liang-Bi Chen,et al.  A wearable-glasses-based drowsiness-fatigue-detection system for improving road safety , 2016, 2016 IEEE 5th Global Conference on Consumer Electronics.

[79]  Ping Wang,et al.  Driver fatigue detection through multiple entropy fusion analysis in an EEG-based system , 2017, PloS one.

[80]  Emmanuelle Diaz,et al.  Detection and prediction of driver drowsiness using artificial neural network models. , 2017, Accident; analysis and prevention.

[81]  James Jin Kang,et al.  An Integrated mHealth and Vehicular Sensor Based Alarm System Emergency Alarm Notification System for Long Distance Drivers using Smart Devices and Cloud Networks , 2018, 2018 28th International Telecommunication Networks and Applications Conference (ITNAC).

[82]  Dessislava A. Pachamanova,et al.  Recent trends and future directions. , 2007 .

[83]  Mario Ignacio Chacon Murguia,et al.  Detecting Driver Drowsiness: A survey of system designs and technology. , 2015, IEEE Consumer Electronics Magazine.

[84]  Antonio M. López,et al.  A reduced feature set for driver head pose estimation , 2016, Appl. Soft Comput..

[85]  Marco Grossi,et al.  A sensor-centric survey on the development of smartphone measurement and sensing systems , 2019, Measurement.

[86]  Kuei-Fang Hsiao,et al.  Smartphone intelligent applications: a brief review , 2013, Multimedia Systems.

[87]  Magnus Johnsson,et al.  Collaborative Working Architecture for IoT-Based Applications† , 2018, Sensors.

[88]  Xiaogang Wang,et al.  Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[89]  Igor Skrjanc,et al.  Evolving cloud-based system for the recognition of drivers' actions , 2017, Expert Syst. Appl..

[90]  Fernando García,et al.  Driver Monitoring Based on Low-Cost 3-D Sensors , 2014, IEEE Transactions on Intelligent Transportation Systems.

[91]  Minglu Li,et al.  Fine-Grained Abnormal Driving Behaviors Detection and Identification with Smartphones , 2017, IEEE Transactions on Mobile Computing.

[92]  Alexander J. Casson,et al.  Design and Implementation of a Convolutional Neural Network on an Edge Computing Smartphone for Human Activity Recognition , 2019, IEEE Access.

[93]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[94]  DaeYoub Kim,et al.  ZONE-Based Multi-Access Edge Computing Scheme for User Device Mobility Management , 2019, Applied Sciences.

[95]  Yuxi Peng,et al.  Driver fatigue detection based on deeply-learned facial expression representation , 2020, J. Vis. Commun. Image Represent..

[96]  Chonho Lee,et al.  A survey of mobile cloud computing: architecture, applications, and approaches , 2013, Wirel. Commun. Mob. Comput..

[97]  Fakhri Karray,et al.  Driver distraction detection and recognition using RGB-D sensor , 2015, ArXiv.

[98]  Rahul Banerjee,et al.  A comparative evaluation of neural network classifiers for stress level analysis of automotive drivers using physiological signals , 2013, Biomed. Signal Process. Control..

[99]  Selvakumar Manickam,et al.  Survey of Authentication and Privacy Schemes in Vehicular ad hoc Networks , 2021, IEEE Sensors Journal.

[100]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[101]  Najlae Idrissi,et al.  Real-Time System for Driver Fatigue Detection Based on a Recurrent Neuronal Network , 2020, J. Imaging.

[102]  Doheon Lee,et al.  Drowsy Driving Warning System Based on GS1 Standards with Machine Learning , 2017, 2017 IEEE International Congress on Big Data (BigData Congress).

[103]  Anirban Dasgupta,et al.  A Smartphone-Based Drowsiness Detection and Warning System for Automotive Drivers , 2019, IEEE Transactions on Intelligent Transportation Systems.

[104]  Hui He,et al.  Low-Power Listen Based Driver Drowsiness Detection System Using Smartwatch , 2018, ICCCS.

[105]  Li Bai,et al.  Deep Learning in Visual Computing and Signal Processing , 2017, Appl. Comput. Intell. Soft Comput..

[106]  Alexander V. Smirnov,et al.  Smartphone-based two-wheeled self-balancing vehicles rider assistant , 2015, 2015 17th Conference of Open Innovations Association (FRUCT).

[107]  Qaisar Abbas,et al.  Video scene analysis: an overview and challenges on deep learning algorithms , 2017, Multimedia Tools and Applications.

[108]  Hong Wang,et al.  Detecting Unfavorable Driving States in Electroencephalography Based on a PCA Sample Entropy Feature and Multiple Classification Algorithms , 2020, Entropy.

[109]  Caio Bezerra Souto Maior,et al.  Real-time classification for autonomous drowsiness detection using eye aspect ratio , 2020, Expert Syst. Appl..

[110]  Mohammed M. Razooq,et al.  Automatic driver drowsiness detection using haar algorithm and support vector machine techniques , 2015 .

[111]  Chao Liu,et al.  Research on fatigue driving detection using forehead EEG based on adaptive multi-scale entropy , 2019, Biomed. Signal Process. Control..

[112]  Eka Adi Prasetyo Joko Prawiro,et al.  Integrated Wearable System for Monitoring Heart Rate and Step during Physical Activity , 2016, Mob. Inf. Syst..

[113]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[114]  Haneen Farah,et al.  Multi-Level Driver Workload Prediction using Machine Learning and Off-the-Shelf Sensors , 2018, Transportation Research Record: Journal of the Transportation Research Board.

[115]  Ali Nahvi,et al.  Evaluation of driver drowsiness using respiration analysis by thermal imaging on a driving simulator , 2020, Multimedia Tools and Applications.

[116]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[117]  Wei Liu,et al.  Detecting driving fatigue with multimodal deep learning , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[118]  Satoshi Oyama,et al.  Fine-tuning deep convolutional neural networks for distinguishing illustrations from photographs , 2016, Expert Syst. Appl..

[119]  Wan-Young Chung,et al.  Standalone Wearable Driver Drowsiness Detection System in a Smartwatch , 2016, IEEE Sensors Journal.

[120]  Michael G. Pecht,et al.  IoT-Based Prognostics and Systems Health Management for Industrial Applications , 2016, IEEE Access.

[121]  Zhang Yi,et al.  Moving object recognition using multi-view three-dimensional convolutional neural networks , 2016, Neural Computing and Applications.

[122]  Zahid Halim,et al.  Artificial intelligence techniques for driving safety and vehicle crash prediction , 2016, Artificial Intelligence Review.

[123]  Jaka Sodnik,et al.  An analysis of the suitability of a low-cost eye tracker for assessing the cognitive load of drivers. , 2018, Applied ergonomics.

[124]  Harpreet Singh,et al.  Analyzing driver behavior under naturalistic driving conditions: A review. , 2020, Accident; analysis and prevention.

[125]  Hyeonjoon Moon,et al.  A Survey on Internet of Things and Cloud Computing for Healthcare , 2019, Electronics.

[126]  Jingyu Yang,et al.  Driver Fatigue Detection: A Survey , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[127]  Ji-Hoon Lee,et al.  Mobile Personal Multi-Access Edge Computing Architecture Composed of Individual User Devices , 2020 .

[128]  Jie Lin,et al.  Towards Detection of Bus Driver Fatigue Based on Robust Visual Analysis of Eye State , 2017, IEEE Transactions on Intelligent Transportation Systems.

[129]  Radovan Smisek,et al.  Multimodal Features for Detection of Driver Stress and Fatigue: Review , 2020, IEEE Transactions on Intelligent Transportation Systems.

[130]  Hyukjoon Lee,et al.  A Location-Based Interactive Model of Internet of Things and Cloud (IoT-Cloud) for Mobile Cloud Computing Applications † , 2017, Sensors.

[131]  Slawomir Gruszczynski,et al.  Hybrid computer vision system for drivers' eye recognition and fatigue monitoring , 2014, Neurocomputing.

[132]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[133]  Leonard Barolli,et al.  Performance Evaluation of an Integrated Fuzzy-Based Driving-Support System for Real-Time Risk Management in VANETs , 2020, Sensors.

[134]  Liu Jinfeng,et al.  Research on Fatigue Driving Monitoring Model and Key Technologies Based on Multi-input Deep Learning , 2020 .

[135]  Lei Wei,et al.  A Survey on Mobile Sensing Based Mood-Fatigue Detection for Drivers , 2016 .

[136]  Yiran Chen,et al.  ApesNet: a pixel-wise efficient segmentation network , 2016, 2016 14th ACM/IEEE Symposium on Embedded Systems For Real-time Multimedia (ESTIMedia).

[137]  Guojun Dai,et al.  EEG classification of driver mental states by deep learning , 2018, Cognitive Neurodynamics.

[138]  SafeDrive: An autonomous driver safety application in aware cities , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[139]  Seyed Navid Resalat,et al.  Real Time Driver’s Drowsiness Detection by Processing the EEG Signals Stimulated with External Flickering Light , 2014, Basic and clinical neuroscience.

[140]  Ridha Soua,et al.  Recent Trends in Driver Safety Monitoring Systems: State of the Art and Challenges , 2017, IEEE Transactions on Vehicular Technology.

[141]  Jonny Kuo,et al.  Computer vision and driver distraction: developing a behaviour-flagging protocol for naturalistic driving data. , 2014, Accident; analysis and prevention.

[142]  Wanda Benesova,et al.  Eye blink completeness detection , 2018, Comput. Vis. Image Underst..

[143]  Wei Sun,et al.  A Real-Time Fatigue Driving Recognition Method Incorporating Contextual Features and Two Fusion Levels , 2017, IEEE Transactions on Intelligent Transportation Systems.

[144]  Liang-Bi Chen,et al.  A band-pass IR light photodetector for wearable intelligent glasses in a drowsiness-fatigue-detection system , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[145]  Sebastià Sallent,et al.  Deep Learning at the Mobile Edge: Opportunities for 5G Networks , 2020, Applied Sciences.

[146]  Ehsan T. Esfahani,et al.  A machine learning approach to detect changes in gait parameters following a fatiguing occupational task , 2018, Ergonomics.

[147]  Stephanie G Pratt,et al.  Analytical observational study of nonfatal motor vehicle collisions and incidents in a light-vehicle sales and service fleet. , 2019, Accident; analysis and prevention.

[148]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[149]  Liang Wang,et al.  Learning Representative Deep Features for Image Set Analysis , 2015, IEEE Transactions on Multimedia.

[150]  Alessandra Flammini,et al.  Easy implementation of sensing systems for smart living , 2017, 2017 IEEE International Systems Engineering Symposium (ISSE).

[151]  Wazir Zada Khan,et al.  Detecting Human Driver Inattentive and Aggressive Driving Behavior Using Deep Learning: Recent Advances, Requirements and Open Challenges , 2020, IEEE Access.

[152]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[153]  Gerald Matthews,et al.  Dangerous intersections? A review of studies of fatigue and distraction in the automated vehicle. , 2019, Accident; analysis and prevention.

[154]  Seema Verma,et al.  Smartphone based context-aware driver behavior classification using dynamic bayesian network , 2019, J. Intell. Fuzzy Syst..

[155]  Kaigui Bian,et al.  Sober-Drive: A smartphone-assisted drowsy driving detection system , 2014, 2014 International Conference on Computing, Networking and Communications (ICNC).

[156]  Taorong Qiu,et al.  Research on Recognition Method of Driving Fatigue State Based on Sample Entropy and Kernel Principal Component Analysis , 2018, Entropy.

[157]  Wan-Young Chung,et al.  Mobile Healthcare for Automatic Driving Sleep-Onset Detection Using Wavelet-Based EEG and Respiration Signals , 2014, Sensors.

[158]  Liang Lin,et al.  Deep feature learning with relative distance comparison for person re-identification , 2015, Pattern Recognit..

[159]  Qaisar Abbas,et al.  A comprehensive review of recent advances on deep vision systems , 2018, Artificial Intelligence Review.

[160]  V.V.S.A. Sunil Kumar,et al.  Smart driver assistance system using raspberry pi and sensor networks , 2020, Microprocess. Microsystems.

[161]  Eleni I. Vlahogianni,et al.  Driving analytics using smartphones: Algorithms, comparisons and challenges , 2017 .

[162]  Pawel Forczmanski,et al.  Deep Learning Approach to Detection of Preceding Vehicle in Advanced Driver Assistance , 2016, TST.

[163]  Seema Verma,et al.  Detecting Aggressive Driving Behavior using Mobile Smartphone , 2019 .

[164]  Soo-Young Lee,et al.  Hierarchical committee of deep convolutional neural networks for robust facial expression recognition , 2016, Journal on Multimodal User Interfaces.

[165]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[166]  Jiaqi Wang,et al.  SAR: A Social-Aware Route Recommendation System for Intelligent Transportation , 2018, Comput. J..

[167]  Zeeshan Ahmad,et al.  Human Action Recognition Using Deep Multilevel Multimodal ( ${M}^{2}$ ) Fusion of Depth and Inertial Sensors , 2019, IEEE Sensors Journal.

[168]  Wan-Young Chung,et al.  MULTI-CLASSIFIER FOR HIGHLY RELIABLE DRIVER DROWSINESS DETECTION IN ANDROID PLATFORM , 2012 .

[169]  Ahmed Emam,et al.  Intelligent drowsy eye detection using image mining , 2014, Information Systems Frontiers.

[170]  Der-Jiunn Deng,et al.  A Cloud-Based Smart-Parking System Based on Internet-of-Things Technologies , 2015, IEEE Access.

[171]  Shang-Hong Lai,et al.  Driver Drowsiness Detection via a Hierarchical Temporal Deep Belief Network , 2016, ACCV Workshops.

[172]  Xin Chen,et al.  Simultaneous Tracking and Recognition of Dynamic Digit Gestures for Smart TV Systems , 2012, 2012 Fourth International Conference on Digital Home.

[173]  Ali Al-Ataby,et al.  Modular design of fatigue detection in naturalistic driving environments. , 2018, Accident; analysis and prevention.

[174]  Chun-Hsiang Chuang,et al.  Wireless and Wearable EEG System for Evaluating Driver Vigilance , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[175]  Arief Koesdwiady,et al.  Driver Inattention Detection System: A PSO-Based Multiview Classification Approach , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[176]  Auni Syahirah Abu Bakar,et al.  IOT – eye drowsiness detection system by using intel edison with gps navigation , 2019 .

[177]  Melanie Swan,et al.  Connected Car: Quantified Self becomes Quantified Car , 2015, J. Sens. Actuator Networks.

[178]  Paul A. Jennings,et al.  Towards hybrid driver state monitoring: Review, future perspectives and the role of consumer electronics , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[179]  Ig-Jae Kim,et al.  Detecting driver drowsiness using feature-level fusion and user-specific classification , 2014, Expert Syst. Appl..

[180]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[181]  Liang-Bi Chen,et al.  Design and Implementation of a Drowsiness-Fatigue-Detection System Based on Wearable Smart Glasses to Increase Road Safety , 2018, IEEE Transactions on Consumer Electronics.

[182]  Walid Mahdi,et al.  Spatio-temporal features for the automatic control of driver drowsiness state and lack of concentration , 2014, Machine Vision and Applications.

[183]  Fabiola Becerra-Riera,et al.  Facial marks for improving face recognition , 2017, Pattern Recognit. Lett..

[184]  Michael Spann,et al.  3D Facial Expression Classification Using 3D Facial Surface Normals , 2014 .

[185]  In Lee,et al.  The Internet of Things (IoT): Applications, investments, and challenges for enterprises , 2015 .

[186]  Ying Li,et al.  Automatic Dangerous Driving Intensity Analysis for Advanced Driver Assistance Systems From Multimodal Driving Signals , 2018, IEEE Sensors Journal.

[187]  Victor C. M. Leung,et al.  A Novel Cloud-Based Crowd Sensing Approach to Context-Aware Music Mood-Mapping for Drivers , 2015, 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom).

[188]  Seema Verma,et al.  A survey on driver behavior detection techniques for intelligent transportation systems , 2017, 2017 7th International Conference on Cloud Computing, Data Science & Engineering - Confluence.

[189]  Nikita Gordienko Multi-Parametric Statistical Method for Estimation of Accumulated Fatigue by Sensors in Ordinary Gadgets , 2016, ArXiv.

[190]  Bairong Shen,et al.  Physiological Informatics: Collection and Analyses of Data from Wearable Sensors and Smartphone for Healthcare. , 2017, Advances in experimental medicine and biology.

[191]  Filipe Neves dos Santos,et al.  Automatic Eye Localization; Multi-block LBP vs. Pyramidal LBP Three-Levels Image Decomposition for Eye Visual Appearance Description , 2015, IbPRIA.

[192]  Masahiro Inoue,et al.  Neck posture monitoring system based on image detection and smartphone sensors using the prolonged usage classification concept , 2018, IEEJ Transactions on Electrical and Electronic Engineering.

[193]  Oscar Castillo,et al.  Multimodal human eye blink recognition method using feature level fusion for exigency detection , 2020, Soft Comput..

[194]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[195]  Seonghun Park,et al.  Design of Wearable EEG Devices Specialized for Passive Brain–Computer Interface Applications , 2020, Sensors.

[196]  Gys Albertus Marthinus Meiring,et al.  A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms , 2015, Sensors.

[197]  Ashish Kumar,et al.  Driver drowsiness monitoring system using visual behaviour and machine learning , 2018, 2018 IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE).

[198]  Abdulkadir Sengur,et al.  An Effective Hybrid Model for EEG-Based Drowsiness Detection , 2019, IEEE Sensors Journal.

[199]  Naixue Xiong,et al.  A game-theoretic method of fair resource allocation for cloud computing services , 2010, The Journal of Supercomputing.

[200]  Javier Cubo,et al.  A Cloud-Based Internet of Things Platform for Ambient Assisted Living , 2014, Sensors.

[201]  Hung-Hsu Tsai,et al.  Facial expression recognition using a combination of multiple facial features and support vector machine , 2018, Soft Comput..

[202]  Wei Liu,et al.  Continuous Vigilance Estimation Using LSTM Neural Networks , 2016, ICONIP.