SPHORB: A Fast and Robust Binary Feature on the Sphere

In this paper, we propose SPHORB, a new fast and robust binary feature detector and descriptor for spherical panoramic images. In contrast to state-of-the-art spherical features, our approach stems from the geodesic grid, a nearly equal-area hexagonal grid parametrization of the sphere used in climate modeling. It enables us to directly build fine-grained pyramids and construct robust features on the hexagonal spherical grid, thus avoiding the costly computation of spherical harmonics and their associated bandwidth limitation. We further study how to achieve scale and rotation invariance for the proposed SPHORB feature. Extensive experiments show that SPHORB consistently outperforms other existing spherical features in accuracy, efficiency and robustness to camera movements. The superior performance of SPHORB has also been validated by real-world matching tests.

[1]  Krista A. Ehinger,et al.  Recognizing scene viewpoint using panoramic place representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  David L. Williamson,et al.  Integration of the barotropic vorticity equation on a spherical geodesic grid , 1968 .

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Jana Ko,et al.  Piecewise Planar City 3D Modeling from Street View Panoramic Sequences , 2009 .

[5]  Jean-Philippe Thiran,et al.  Scale Invariant Feature Transform on the Sphere: Theory and Applications , 2011, International Journal of Computer Vision.

[6]  Jay Yagnik,et al.  The power of comparative reasoning , 2011, 2011 International Conference on Computer Vision.

[7]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[8]  Marc Pollefeys,et al.  City-Scale Change Detection in Cadastral 3D Models Using Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  David J. Kriegman,et al.  Locally Uniform Comparison Image Descriptor , 2012, NIPS.

[10]  Achim J. Lilienthal,et al.  SIFT, SURF and Seasons: Long-term Outdoor Localization Using Local Features , 2007, EMCR.

[11]  Shigang Li,et al.  Corner Feature Detection Based on Discrete Spherical Model , 2012 .

[12]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[13]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Pascal Fua,et al.  LDAHash: Improved Matching with Smaller Descriptors , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[16]  Peter I. Corke,et al.  Wide-angle Visual Feature Matching for Outdoor Localization , 2010, Int. J. Robotics Res..

[17]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[18]  Tien-Tsin Wong,et al.  Cube2Video: Navigate Between Cubic Panoramas in Real-Time , 2013, IEEE Transactions on Multimedia.

[19]  Pascal Frossard,et al.  Scale-Invariant Features and Polar Descriptors in Omnidirectional Imaging , 2012, IEEE Transactions on Image Processing.

[20]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[21]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[22]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  E. Malis,et al.  Spherical Image Processing for Accurate Visual Odometry with Omnidirectional Cameras , 2008 .

[25]  Jana Kosecka,et al.  Piecewise planar city 3D modeling from street view panoramic sequences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Vincent Lepetit,et al.  Boosting Binary Keypoint Descriptors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[28]  Yuichi Yoshida,et al.  CARD: Compact And Real-time Descriptors , 2011, 2011 International Conference on Computer Vision.

[29]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[30]  Peter I. Corke,et al.  Scale-Invariant Features on the Sphere , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  Luis Puig,et al.  Scale space for central catadioptric systems: Towards a generic camera feature extractor , 2011, 2011 International Conference on Computer Vision.

[32]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[33]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[34]  Todd D. Ringler,et al.  Climate modeling with spherical geodesic grids , 2002, Comput. Sci. Eng..

[35]  T. Bulow Spherical diffusion for 3D surface smoothing , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .