Uncertainty Model for Template Feature Matching

Using visual odometry and inertial measurements, indoor and outdoor positioning systems can perform an accurate self-localization in unknown, unstructured environments where absolute positioning systems (e.g. GNSS) are unavailable. However, the achievable accuracy is highly affected by the residuals of calibration, the quality of the noise model, etc. Only if these unavoidable uncertainties of sensors and data processing can be taken into account and be handled via error propagation, which allows to propagate them through the entire system. The central filter (e.g. Kalman filter) of the system can then make use of the enhanced statistical model and use the propagated errors to calculate the optimal result. In this paper, we focus on the uncertaintiy calculation of the elementary part of the optical navigation, the template feature matcher. First of all, we propose a method to model the image noise. Then we use Taylor’s theorem to extend two very popular and efficient template feature matchers sum-of-absolute-differences (SAD) and normalized-cross-correlation (NCC) to get sub-pixel matching results. Based on the proposed noise model and the extended matcher, we propagate the image noise to the uncertainties of sub-pixel matching results. Although the SAD and NCC are used, the image noise model can be easily combined with other feature matchers. We evaluate our method by an Integrated Positioning System (IPS) which is developed by German Aerospace Center. The experimental results show that our method can improve the quality of the measured trajectory. Moreover, it increases the robustness of the system.

[1]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[2]  Kenichi Kanatani,et al.  Uncertainty modeling and model selection for geometric inference , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[4]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[5]  Fawaz Waselallah Alsaade Fast and Accurate Template Matching Algorithm Based on Image Pyramid and Sum of Absolute Difference Similarity Measure , 2012 .

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Vito Cappellini,et al.  Estimate of PRNU Noise Based on Different Noise Models for Source Camera Identification , 2010, Int. J. Digit. Crime Forensics.

[8]  Denis Grießbach Stereo-Vision-Aided Inertial Navigation , 2015 .

[9]  Kaj Madsen,et al.  Methods for Non-Linear Least Squares Problems , 1999 .

[10]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[11]  Nassir Navab,et al.  Estimation of Location Uncertainty for Scale Invariant Features Points , 2009, BMVC.

[12]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[13]  Dirk Baumbach,et al.  Stereo-vision-aided inertial navigation for unknown indoor and outdoor environments , 2014, 2014 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[14]  Junichi Nakamura,et al.  Image Sensors and Signal Processing for Digital Still Cameras , 2005 .

[15]  Kenichi Kanatani,et al.  Do We Really Have to Consider Covariance Matrices for Image Feature Points , 2002 .

[16]  Nikolay N. Evtikhiev,et al.  Measurement of noises and modulation transfer function of cameras used in optical-digital correlators , 2011, Electronic Imaging.

[17]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[18]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Anthony Alan Clifford,et al.  Multivariate error analysis : a handbook of error propagation and calculation in many-parameter systems , 1973 .

[20]  Roland Siegwart,et al.  Robust visual inertial odometry using a direct EKF-based approach , 2015, IROS 2015.

[21]  Roberto Brunelli,et al.  Advanced , 1980 .

[22]  Clark N. Taylor,et al.  Uncertainty Estimation for KLT Tracking , 2014, ACCV Workshops.

[23]  Jong Soo Kim,et al.  Fourier Based Image Registration for Sub-Pixel Using Pyramid Edge Detection and Line Fitting , 2008, 2008 First International Conference on Intelligent Networks and Intelligent Systems.

[24]  Kenichi Kanatani,et al.  Do we really have to consider covariance matrices for image features? , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[25]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[26]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[28]  Brijendra Kumar Joshi,et al.  A Review Paper: Noise Models in Digital Image Processing , 2015, ArXiv.

[29]  Jürgen Wohlfeil,et al.  EXTENSION AND EVALUATION OF THE AGAST FEATURE DETECTOR , 2016 .