Autonomous tracking and counting of footsteps by mobile phone cameras

In this paper, we present an autonomous method to track and count footsteps by using the camera data from mobile phones or tablets. Many step counters, relying on accelerometer data, are widely available. However, accelerometer-based algorithms are prone to overcounting. In our proposed method, feature points are detected first. Then, in order to increase robustness and accuracy especially in the case of highly-textured ground and floor surfaces, Kalman filter based tracking is performed. The proposed method is compared with existing accelerometer-based step counters. Experiments are performed with multiple subjects carrying five mobile devices simultaneously, including smart phones and watches, at different locations on their body. A SamsungTM Galaxy S4 smartphone is used to capture the videos. The results show that the proposed camera-based footstep counting has the lowest average error rate for different users, and is more reliable compared to accelerometer-based counters. The average error rate for the proposed method is 2.68%, and the standard deviation of the error is 2.39%.

[1]  Senem Velipasalar,et al.  Robust and reliable step counting by mobile phone cameras , 2015, ICDSC.

[2]  Raúl Rojas,et al.  Kalman filter for vision tracking , 2005 .

[3]  Senem Velipasalar,et al.  Wearable Camera- and Accelerometer-Based Fall Detection on Portable Devices , 2016, IEEE Embedded Systems Letters.

[4]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[5]  Mohan S. Kankanhalli,et al.  An evaluation of wearable activity monitoring devices , 2013, PDM '13.

[6]  Yongcai Wang,et al.  Health sensing by wearable sensors and mobile phones: A survey , 2014, 2014 IEEE 16th International Conference on e-Health Networking, Applications and Services (Healthcom).

[7]  T. Kailath The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[8]  Hojung Cha,et al.  Smartphone-based pedestrian tracking in indoor corridor environments , 2011, Personal and Ubiquitous Computing.

[9]  Meng-Shiuan Pan,et al.  A Step Counting Algorithm for Smartphone Users: Design and Implementation , 2015, IEEE Sensors Journal.

[10]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[11]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Huiru Zheng,et al.  Activity Monitoring Using a Smart Phone's Accelerometer with Hierarchical Classification , 2010, 2010 Sixth International Conference on Intelligent Environments.

[13]  Carsten Isert,et al.  Camera based step detection on mobile phones , 2011, 2011 International Conference on Indoor Positioning and Indoor Navigation.

[14]  Edward D. Lemaire,et al.  A smartphone approach for the 2 and 6-minute walk test , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[16]  K. Volpp,et al.  Accuracy of smartphone applications and wearable devices for tracking physical activity data. , 2015, JAMA.