DeepWalking: Enabling Smartphone-Based Walking Speed Estimation Using Deep Learning

Walking speed estimation is an essential component of mobile apps in various fields such as fitness, transportation, navigation, and health-care. Most existing solutions are focused on specialized medical applications that utilize body-worn motion sensors. These approaches do not serve effectively the general use case of numerous apps where the user holding a smartphone tries to find his or her walking speed solely based on smartphone sensors. However, existing smartphone-based approaches fail to provide acceptable precision for walking speed estimation. This leads to a question: is it possible to achieve comparable speed estimation accuracy using a smartphone over wearable sensor based obtrusive solutions? We find the answer from advanced neural networks. In this paper, we present DeepWalking, the first deep learning- based walking speed estimation scheme for smartphone. A deep convolutional neural network (DCNN) is applied to automatically identify and extract the most effective features from the accelerometer and gyroscope data of smartphone and to train the network model for accurate speed estimation. Experiments are performed with 10 participants using a treadmill. The average root- mean-squared-error (RMSE) of estimated walking speed is 0.16m/s which is comparable to the results obtained by state-of- the-art approaches based on a number of body- worn sensors (i.e., RMSE of 0.11m/s). The results indicate that a smartphone can be a strong tool for walking speed estimation if the sensor data are effectively calibrated and supported by advanced deep learning techniques.

[1]  Shaghayegh Zihajehzadeh,et al.  Regression Model-Based Walking Speed Estimation Using Wrist-Worn Inertial Sensor , 2016, PloS one.

[2]  Matteo Gadaleta,et al.  IDNet: Smartphone-based Gait Recognition with Convolutional Neural Networks , 2016, Pattern Recognit..

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[5]  Gaurav S. Sukhatme,et al.  Toward free-living walking speed estimation using Gaussian Process-based Regression with on-body accelerometers and gyroscopes , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[6]  David W. Mizell,et al.  Using gravity to estimate accelerometer orientation , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[7]  Julius Hannink,et al.  Mobile Stride Length Estimation With Deep Convolutional Neural Networks , 2016, IEEE Journal of Biomedical and Health Informatics.

[8]  Marco Gruteser,et al.  LookUp: Enabling Pedestrian Safety Services via Shoe Sensing , 2015, MobiSys.

[9]  Sang H. Son,et al.  HybridBaro: Mining Driving Routes Using Barometer Sensor of Smartphone , 2017, IEEE Sensors Journal.

[10]  Seth J. Teller,et al.  Online pose classification and walking speed estimation using handheld devices , 2012, UbiComp '12.

[11]  Angelo M. Sabatini,et al.  Ambulatory Assessment of Instantaneous Velocity during Walking Using Inertial Sensor Measurements , 2016, Sensors.

[12]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[13]  S. Fritz,et al.  White paper: "walking speed: the sixth vital sign". , 2009, Journal of geriatric physical therapy.

[14]  K. Aminian,et al.  The prediction of speed and incline in outdoor running in humans using accelerometry. , 1999, Medicine and science in sports and exercise.

[15]  Ivan Marsic,et al.  Deep Learning for RFID-Based Activity Recognition , 2016, SenSys.

[16]  Andrea Mannini,et al.  Walking speed estimation using foot-mounted inertial sensors: comparing machine learning and strap-down integration methods. , 2014, Medical engineering & physics.

[17]  Jwu-Sheng Hu,et al.  A model-based human walking speed estimation using body acceleration data , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[18]  William J. Kaiser,et al.  AutoGait: A mobile platform that accurately estimates the distance walked , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[19]  Degui Xiao,et al.  Smartphone-Based Walking Speed Estimation for Stroke Mitigation , 2014, 2014 IEEE International Symposium on Multimedia.

[20]  John Lach,et al.  Deepmotion: a deep convolutional neural network on inertial body sensors for gait assessment in multiple sclerosis* , 2016, 2016 IEEE Wireless Health (WH).

[21]  Antonio Corradi,et al.  WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads , 2012, HotMobile '12.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Shyamal Patel,et al.  A machine learning approach for gait speed estimation using skin-mounted wearable sensors: From healthy controls to individuals with multiple sclerosis , 2017, PloS one.

[24]  Q Li,et al.  Walking speed estimation using a shank-mounted inertial measurement unit. , 2010, Journal of biomechanics.

[25]  T P Andriacchi,et al.  Walking speed as a basis for normal and abnormal gait measurements. , 1977, Journal of biomechanics.