A New Terrain Classification Framework Using Proprioceptive Sensors for Mobile Robots

Mobile robots that operate in real-world environments interact with the surroundings to generate complex acoustics and vibration signals, which carry rich information about the terrain. This paper presents a new terrain classification framework that utilizes both acoustics and vibration signals resulting from the robot-terrain interaction. As an alternative to handcrafted domain-specific feature extraction, a two-stage feature selection method combining ReliefF and mRMR algorithms was developed to select optimal feature subsets that carry more discriminative information. As different data sources can provide complementary information, a multiclassifier combination method was proposed by considering a priori knowledge and fusing predictions from five data sources: one acoustic data source and four vibration data sources. In this study, four conceptually different classifiers were employed to perform the classification, each with a different number of optimal features. Signals were collected using a tracked robot moving at three different speeds on six different terrains. The new framework successfully improved classification performance of different classifiers using the newly developed optimal feature subsets. The greater improvement was observed for robot traversing at lower speeds.

[1]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[2]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[3]  Nino Srour,et al.  Feature extraction and fusion of acoustic and seismic sensors for target identification , 1997, Defense, Security, and Sensing.

[4]  John H. L. Hansen,et al.  A comparative study of traditional and newly proposed features for recognition of speech under stress , 2000, IEEE Trans. Speech Audio Process..

[5]  James P. Ostrowski,et al.  Visual motion planning for mobile robots , 2002, IEEE Trans. Robotics Autom..

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  S. Dubowsky,et al.  Visual, tactile, and vibration-based terrain analysis for planetary rovers , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[8]  Ron Kohavi,et al.  Guest Editors' Introduction: On Applied Research in Machine Learning , 1998, Machine Learning.

[9]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[10]  Steven Dubowsky,et al.  Vibration-based Terrain Analysis for Mobile Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  Sergios Theodoridis,et al.  Violence Content Classification Using Audio Features , 2006, SETN.

[12]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[13]  Andreas Zell,et al.  Vibration-based Terrain Classification Using Support Vector Machines , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Gary Witus,et al.  Terrain characterization and classification with a mobile robot , 2006, J. Field Robotics.

[15]  Andreas Zell,et al.  Comparison of Different Approaches to Vibration-based Terrain Classification , 2007, EMCR.

[16]  Andreas Zell,et al.  A combination of vision- and vibration-based terrain classification , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[18]  Karl Iagnemma,et al.  Self‐supervised terrain classification for planetary surface exploration rovers , 2012, J. Field Robotics.

[19]  Qiang Li,et al.  Vibration-based Terrain Classification for Mobile Robots Using Support Vector Machine , 2012 .

[20]  Anthony Stentz,et al.  Using sound to classify vehicle-terrain interactions in outdoor environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[21]  Panagiotis Papadakis,et al.  Terrain traversability analysis methods for unmanned ground vehicles: A survey , 2013, Eng. Appl. Artif. Intell..

[22]  Krzysztof Skonieczny,et al.  Analysis of Grouser Performance to Develop Guidelines for Design for Planetary Rovers , 2014 .

[23]  Jane Labadin,et al.  Feature selection based on mutual information , 2015, 2015 9th International Conference on IT in Asia (CITA).

[24]  Masahiro Ono,et al.  Risk-aware planetary rover operation: Autonomous terrain classification and path planning , 2015, 2015 IEEE Aerospace Conference.

[25]  K. Walas Terrain Classification and Negotiation with a Walking Robot , 2015, J. Intell. Robotic Syst..

[26]  Wolfram Burgard,et al.  Deep Feature Learning for Acoustics-Based Terrain Classification , 2015, ISRR.

[27]  Feng Zhao,et al.  Road profile classification for vehicle semi-active suspension system based on Adaptive Neuro-Fuzzy Inference System , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[28]  Navinda Kottege,et al.  Acoustics based terrain classification for legged robots , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Zongquan Deng,et al.  Real-Time Drilling Strategy for Planetary Sampling: Method and Validation , 2016 .

[30]  Minh Le Nguyen,et al.  Feature weighting and SVM parameters optimization based on genetic algorithms for classification problems , 2016, Applied Intelligence.

[31]  Mingming Dong,et al.  Road excitation classification for semi-active suspension system based on system response , 2018 .