Pan360: INS Assisted 360-Degree Panorama

We propose a practical stitching method in dealing with input images with weak salient points, high luminance variations, and repetitive structures in an artificial environment. We address these panorama-stitching challenges by inferring orientation of capturing pose by inertial sensors inside a mobile device. Our contributions include identifying an effective way to consider orientation, providing novel methods to further improve feature-matching rate, and solving the vignette effect in low light environments. Experimental results demonstrate that our global alignment method outperforms other stitchers, and the color tone is well maintained and more appealing.

[1]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[2]  Dan B. Goldman,et al.  Vignette and exposure calibration and compensation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[4]  Yoav Y. Schechner,et al.  Addressing radiometric nonidealities: a unified framework , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Richard Szeliski,et al.  Seamless Image Stitching of Scenes with Large Motions and Exposure Differences , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Zhe Wang,et al.  Multi-Probe LSH: Efficient Indexing for High-Dimensional Similarity Search , 2007, VLDB.

[7]  Yücel Altunbasak,et al.  A fast parametric motion estimation algorithm with illumination and lens distortion correction , 2003, IEEE Trans. Image Process..

[8]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[9]  Yingen Xiong,et al.  Color and luminance compensation for mobile panorama construction , 2010, ACM Multimedia.

[10]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[11]  Marc Pollefeys,et al.  Robust Radiometric Calibration and Vignetting Correction , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Edward Y. Chang,et al.  Inertial sensors aided image alignment and stitching for panorama on mobile phones , 2011, MLBS '11.

[13]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[14]  Wolfgang Heidrich,et al.  Color correction for tone mapping , 2009, Comput. Graph. Forum.