Panorama Mosaic Optimization for Mobile Camera Systems

In order to enable the real-time image mosaic in mobile devices that have very limited computing power and memory, we propose an efficient image mosaic algorithm with integer arithmetic. The proposed algorithm is focused not only on the computational efficiency, but also on the performance improvement of image mosaic. For the efficient projection without transform estimation, we obtain successive images through the semitransparent view finder which shows the fixed amount of right part of previously captured image. We project each images onto cylindrical surface by the proposed projection equation and integer arithmetic. We align the projected images by hierarchical hexagon search and a matching measure that is robust to illumination changes caused by different exposures and vignette distortion. Finally, the images are naturally blended using color compensation and dynamic programming based stitching. The proposed mosaic algorithm is embedded and tested in mobile phone systems. According to various tests and experiments, the proposed algorithm shows good panorama composition in real-time compared with the other PC-based methods.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[3]  Dan B. Goldman,et al.  Vignette and exposure calibration and compensation , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Steven A. Shafer,et al.  Using color to separate reflection components , 1985 .

[5]  Kenneth Turkowski,et al.  Registration, calibration and blending in creating high quality panoramas , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Shmuel Peleg,et al.  Seamless image stitching by minimizing false edges , 2006, IEEE Transactions on Image Processing.

[8]  Sang Wook Lee,et al.  Estimation of diffuse and specular appearance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[10]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[12]  Jack Bresenham,et al.  A linear algorithm for incremental digital display of circular arcs , 1977, CACM.

[13]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[14]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[15]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[16]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[17]  Richard Szeliski,et al.  Eliminating ghosting and exposure artifacts in image mosaics , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.