Observability Properties of Object Pose Estimation

Estimating the pose (position and orientation) of 3D objects solely from images is a challenging task of current relevance to a wide range of robotic and artificial intelligence applications. In this paper, we employ the empirical local observability Gramian as a metric for assessing the quality of image-based pose estimation. We show how the Gramian can be used to describe the local “estimatability” of images of static and dynamic objects. We also show connections between the Gramian matrix and symmetries and near-symmetries of an object, and use this result to characterize the subspace of the pose vector which is unobservable using image data. Results are demonstrated using images constructed in a 3D virtual environment.

[1]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[2]  Kristi A. Morgansen,et al.  Observability-Based Optimal Sensor Placement for Flapping Airfoil Wake Estimation , 2014 .

[3]  Wei Kang,et al.  Partial observability for some distributed parameter systems , 2014 .

[4]  Arthur J. Krener,et al.  Measures of unobservability , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[5]  Kristi A. Morgansen,et al.  Optimal disease outbreak detection in a community using network observability , 2016, 2016 American Control Conference (ACC).

[6]  Jana Kosecka,et al.  Fast Single Shot Detection and Pose Estimation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[7]  Pascal Fua,et al.  Real-Time Seamless Single Shot 6D Object Pose Prediction , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Dieter Fox,et al.  PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes , 2017, Robotics: Science and Systems.

[9]  H. Weber,et al.  Analysis and optimization of certain qualities of controllability and observability for linear dynamical systems , 1972 .

[10]  Kai Sun,et al.  Optimal PMU placement for power system dynamic state estimation by using empirical observability Gramian , 2015, 2015 IEEE Power & Energy Society General Meeting.

[11]  Vincent Lepetit,et al.  BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depth , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).