Information Theoretic Sensor Data Selection for Active Object Recognition and State Estimation

We introduce a formalism for optimal sensor parameter selection for iterative state estimation in static systems. Our optimality criterion is the reduction of uncertainty in the state estimation process, rather than an estimator-specific metric (e.g., minimum mean squared estimate error). The claim is that state estimation becomes more reliable if the uncertainty and ambiguity in the estimation process can be reduced. We use Shannon's information theory to select information-gathering actions that maximize mutual information, thus optimizing the information that the data conveys about the true state of the system. The technique explicitly takes into account the a priori probabilities governing the computation of the mutual information. Thus, a sequential decision process can be formed by treating the a priori probability at a certain time step in the decision process as the a posteriori probability of the previous time step. We demonstrate the benefits of our approach in an object recognition application using an active camera for sequential gaze control and viewpoint selection. We describe experiments with discrete and continuous density representations that suggest the effectiveness of the approach.

[1]  Lucas Paletta,et al.  Learning temporal context in active object recognition using Bayesian analysis , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[3]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[4]  Yiming Ye,et al.  Sensor Planning for 3D Object Search, , 1999, Comput. Vis. Image Underst..

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[7]  Michael I. Jordan,et al.  Mixtures of Probabilistic Principal Component Analyzers , 2001 .

[8]  Lucas Paletta,et al.  Appearance-based active object recognition , 2000, Image Vis. Comput..

[9]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[10]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[11]  Andrew L. Rukhin,et al.  Tools for statistical inference , 1991 .

[12]  Joachim Denzler,et al.  Viewpoint selection - a classifier independent learning approach , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[13]  H.F. Durrant-Whyte,et al.  On sensor management in decentralized data fusion , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[14]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[15]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[16]  John W. Fisher,et al.  A Nonparametric Methodology for Information Theoretic Feature Extraction , 1998 .

[17]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[18]  K. J. Orford,et al.  Entropy measures of multi-sensor fusion performance , 1996 .

[19]  John K. Tsotsos,et al.  Integration of camera motion behaviours for active object recognition , 1994 .

[20]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[21]  Lucas Paletta,et al.  Active object recognition by view integration and reinforcement learning , 2000, Robotics Auton. Syst..

[22]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[23]  Lucas Paletta,et al.  Active Object Recognition in Parametric Eigenspace , 1998, BMVC.

[24]  John K. Tsotsos,et al.  Active object recognition , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Joachim Denzler,et al.  Optimal Selection of Camera Parameters for State Estimation of Static Systems: An Information Theoretic Approach , 2000 .

[26]  Wolfram Burgard,et al.  Active Markov localization for mobile robots , 1998, Robotics Auton. Syst..

[27]  Bernt Schiele,et al.  Transinformation for active object recognition , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[28]  Frank P. Ferrie,et al.  Viewpoint selection by navigation through entropy maps , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[29]  Andri Ariste,et al.  Pattern analysis and understanding , 1990 .