Detecting Drivers Smartphone: A Learned Features Approach using Aggregated Scalogram Images

In this paper, we propose an image representation approach for detecting driver mobile phone from the accelerometer signals produced by a set of smartphones in a vehicle. Rather than following the classic paradigm of classifying the signal as driver or non-driver, we propose an original paradigm whereby we aggregate the signals together and train a classifier to detect the driver signal in that aggregation. We do so by stacking-up the Scalograms images of the smartphone signals and training a CNN classifier to identify the driver's Scalograms instance in the Scalograms stack image. To the best our knowledge, this is the first time such an image-fusion and classification scheme is proposed for detecting driver's smartphone. Experiments performed with an in-house dataset confirms the potential and the merit of our approach.

[2]  Naoufel Werghi,et al.  Automatic target recognition in SAR images: Comparison between pre-trained CNNs in a tranfer learning based approach , 2018, 2018 International Conference on Artificial Intelligence and Big Data (ICAIBD).

[3]  Xiang-Yang Li,et al.  TEXIVE: Detecting Drivers Using Personal Smart Phones by Leveraging Inertial Sensors , 2013, ArXiv.

[4]  Naoufel Werghi,et al.  Ground Moving Radar Targets Classification Based on Spectrogram Images Using Convolutional Neural Networks , 2018, 2018 19th International Radar Symposium (IRS).

[5]  Basim Nasih,et al.  Application of Wavelet Transform and Its Advantages Compared To Fourier Transform , 2016 .

[6]  Naoufel Werghi,et al.  Convolutional neural networkasa feature extractor for automatic polyp detection , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[7]  Faouzi Kamoun,et al.  Estimating meteorological visibility range under foggy weather conditions: A deep learning approach , 2018, EUSPN/ICTH.

[8]  Richard P. Martin,et al.  Detecting driver phone use leveraging car speakers , 2011, MobiCom.

[9]  Naoufel Werghi,et al.  Transfer learning with convolutional neural networks for moving target classification with micro-Doppler radar spectrograms , 2018, 2018 International Conference on Artificial Intelligence and Big Data (ICAIBD).

[10]  Weijian Si,et al.  Robust Heading Estimation for Indoor Pedestrian Navigation Using Unconstrained Smartphones , 2018, Wirel. Commun. Mob. Comput..

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Romit Roy Choudhury,et al.  In-Vehicle Driver Detection Using Mobile Phone Sensors , 2011 .

[13]  Naoufel Werghi,et al.  Classification of ground moving radar targets using convolutional neural network , 2018, 2018 22nd International Microwave and Radar Conference (MIKON).

[14]  N. Kalra,et al.  Analyzing Driver Behavior using Smartphone Sensors : A Survey , 2014 .

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Naoufel Werghi,et al.  SAR Automatic Target Recognition Using Transfer Learning Approach , 2018, 2018 International Conference on Intelligent Autonomous Systems (ICoIAS).

[17]  Naoufel Werghi,et al.  Automatic polyp detection in endoscopy videos: A survey , 2017, 2017 13th IASTED International Conference on Biomedical Engineering (BioMed).