Cost-Sensitive Learning of Classification Knowledge and Its Applications in Robotics

Traditional learning-from-examples methods assume that examples are given beforehand and all features are measured for each example. However, in many robotic domains the number of features that could be measured is very large, the cost of measuring those features is significant, and thus the robot must judiciously select which features it will measure. Finding a proper tradeoff between the accuracy (e.g., number of prediction errors) and efficiency (e.g., cost of measuring features) during learning (prior to convergence) is an important part of the problem. Inspired by such robotic domains, this article considers realistic measurement costs of features in the process of incremental learning of classification knowledge. It proposes a unified framework for learning-from-examples methods that trade off accuracy for efficiency during learning, and analyzes two methods (CS-ID3 and CS-IBL) in detail. Moreover, this article illustrates the application of such a cost-sensitive-learning method to a real robot designed for an approach-recognize task. The resulting robot learns to approach, recognize, and grasp objects on a floor effectively and efficiently. Experimental results show that highly accurate classification procedures can be learned without sacrificing efficiency in the case of both synthetic and real domains.

[1]  H. Simon,et al.  EPAM-like Models of Recognition and Learning , 1984, Cogn. Sci..

[2]  Richard M. Keller,et al.  Defining Operationality for Explanation-Based Learning , 1987, Artificial Intelligence.

[3]  Paul E. Utgoff,et al.  ID5: An Incremental ID3 , 1987, ML Workshop.

[4]  Ming Tan,et al.  Cost-sensitive robot learning , 1991 .

[5]  Kenneth Y. Goldberg,et al.  Bayesian grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[6]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[7]  Allen Newell,et al.  Chunking in Soar: The anatomy of a general learning mechanism , 1985, Machine Learning.

[8]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[9]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.

[10]  Matthew Thomas Mason,et al.  Manipulator grasping and pushing operations , 1982 .

[11]  Ming Tan,et al.  Cost-Sensitive Reinforcement Learning for Adaptive Classification and Control , 1991, AAAI.

[12]  Jeffrey C. Trinkle,et al.  The initial grasp liftability chart , 1989, IEEE Trans. Robotics Autom..

[13]  David W. Aha,et al.  Incremental, Instance-Based Learning of Independent and Graded Concept Descriptions , 1989, ML.

[14]  David P. Miller Execution Monitoring for a Mobile Robot System , 1990, Other Conferences.

[15]  Ming Tan,et al.  Cost-Sensitive Concept Learning of Sensor Use in Approach ad Recognition , 1989, ML.

[16]  Kenneth Basye,et al.  Coping with Uncertainty in a Control System for Navigation and Exploration , 1990, AAAI.

[17]  Tom Michael Mitchell,et al.  Explanation-based generalization: A unifying view , 1986 .

[18]  Steven W. Norton Generating Better Decision Trees , 1989, IJCAI.

[19]  Prasanna G. Mulgaonkar,et al.  Feature-utility measures for automatic vision programming , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[20]  John H. Gennari,et al.  Focused Concept Formation , 1989, ML.

[21]  Katsushi Ikeuchi,et al.  Minimum cost aspect classification: a module of a vision algorithm compiler , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[22]  Louis Anthony Cox Incorporating statistical information into expert classification systems to reduce classification costs , 2005, Annals of Mathematics and Artificial Intelligence.

[23]  Sharon A. Stansfield,et al.  Reasoning About Grasping , 1988, AAAI.

[24]  Ming Tan,et al.  A cost-sensitive machine learning method for the approach and recognize task , 1991, Robotics Auton. Syst..

[25]  Tom M. Mitchell,et al.  Version Spaces: A Candidate Elimination Approach to Rule Learning , 1977, IJCAI.

[26]  Ming Tan,et al.  Two Case Studies in Cost-Sensitive Concept Acquisition , 1990, AAAI.

[27]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .