Multi-modal bike sensing for automatic geo-annotation geo-annotation of road/terrain type by participatory bike-sensing

This paper presents a novel road/terrain classification system based on the analysis of volunteered geographic information gathered by bikers. By ubiquitous collection of multi-sensor bike data, consisting of visual images, accelerometer information and GPS coordinates of the bikers' smartphone, the proposed system is able to distinguish between 6 different road/terrain types. In order to perform this classification task, the system employs a random decision forest (RDF), fed with a set of discriminative image and accelerometer features. For every instance of road (5 seconds), we extract these features and map the RDF result onto the GPS data of the users' smartphone. Finally, based on all the collected instances, we can annotate geographic maps with the road/terrain types and create a visualization of the route. The accuracy of the novel multi-modal bike sensing system for the 6-class road/terrain classification task is 92%. This result outperforms both the visual and accelerometer only classification, showing that the combination of both sensors is a win-win. For the 2-class on-road/off-road classification an accuracy of 97% is achieved, almost six percent above the state-of-the-art in this domain. Since these are the individual scores (measured on a single user/bike segment), the collaborative accuracy is expected to even further improve these results.

[1]  Andreas Zell,et al.  Visual terrain classification by flying robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Shervan Fekri-Ershad.  Texture Classification Approach Based on Combination of Edge & Co-occurrence and Local Binary Pattern , 2012 .

[3]  Shervan Fekri Ershad,et al.  Texture Classification Approach Based on Combination of Edge & Co-occurrence and Local Binary Pattern , 2012, ArXiv.

[4]  Mani Srivastava,et al.  Human-centric sensing , 2012, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[5]  Luc Van Gool,et al.  An Introduction to Random Forests for Multi-class Object Detection , 2011, Theoretical Foundations of Computer Vision.

[6]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[7]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[8]  Toby P. Breckon,et al.  Automatic Road Environment Classification , 2011, IEEE Transactions on Intelligent Transportation Systems.

[9]  Andreas Zell,et al.  Grid-based visual terrain classification for outdoor robots using local features , 2011, 2011 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS) Proceedings.

[10]  Girts Strazdins,et al.  Virtual Ground Truth in Vehicular Sensing Experiments: How to Mark it Accurately , 2011 .

[11]  M. Archana,et al.  Human Behavior Classification Using Multi-Class Relevance Vector Machine , 2010 .

[12]  Deborah Estrin,et al.  Biketastic: sensing and mapping for better biking , 2010, CHI.

[13]  Deborah Estrin,et al.  Using mobile phones to determine transportation modes , 2010, TOSN.

[14]  António M. G. Pinheiro,et al.  Image Descriptors Based on the Edge Orientation , 2009, 2009 Fourth International Workshop on Semantic Media Adaptation and Personalization.

[15]  Karl Iagnemma,et al.  Speed-independent vibration-based terrain classification for passenger vehicles , 2009 .

[16]  Mark H. Hansen,et al.  Participatory Sensing: A Citizen-Powered Approach to Illuminating the Patterns that Shape our World , 2009 .

[17]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[18]  Dan Popescu,et al.  Road analysis based on texture similarity evaluation , 2008 .

[19]  Andreas Zell,et al.  Vibration-based Terrain Classification Using Support Vector Machines , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[21]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[22]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[23]  C. Goose,et al.  Glossary of Terms , 2004, Machine Learning.