Map quality assessment

The maps generated by robots in real environment are usually incomplete, distorted, and noisy. The map quality is a quantitative performance measure of a robot's understanding of its environment. Map quality also helps researcher study the effects of different mapping algorithms and hardware components used. In this paper we present an algorithm to assess the quality of the map generated by the robot in terms of a ground truth map. To do that, First, localized features are calculated on the pre-evaluated map. Second, nearest neighbor of each valid local feature is searched between the map and the ground truth map. The quality of the map is defined according to the number of the features having the correspondence in the ground truth map. Three feature detectors are tested in terms of their effectiveness, these are the Harris corner detector, Hough Transform and Scale Invariant Feature Transform.

[1]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[2]  Mark Hedley,et al.  Fast corner detection , 1998, Image Vis. Comput..

[3]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[4]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[5]  Johannes Pellenz,et al.  Mapping and Map Scoring at the RoboCupRescue Competition , 2008 .

[6]  Daniel Marcu,et al.  Cognates Can Improve Statistical Translation Models , 2003, NAACL.

[7]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Proceedings of 1st International Conference on Image Processing.

[8]  C. J. van Rijsbergen,et al.  Information Retrieval , 1979, Encyclopedia of GIS.

[9]  Longin Jan Latecki,et al.  Shape Matching for Robot Mapping , 2004, PRICAI.

[10]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[11]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Paul Newman,et al.  Motion Estimation from Map Quality with Millimeter Wave Radar , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[14]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[16]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[17]  Andreas Birk,et al.  Determining Map Quality through an Image Similarity Metric , 2009, RoboCup.

[18]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Electronic Imaging.

[19]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[20]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[21]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[22]  Paul Newman,et al.  Assessing Map Quality Using Conditional Random Fields , 2007, FSR.

[23]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[24]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..