Rectangling panoramic images via warping

Stitched panoramic images mostly have irregular boundaries. Artists and common users generally prefer rectangular boundaries, which can be obtained through cropping or image completion techniques. In this paper, we present a content-aware warping algorithm that generates rectangular images from stitched panoramic images. Our algorithm consists of two steps. The first local step is mesh-free and preliminarily warps the image into a rectangle. With a grid mesh placed on this rectangle, the second global step optimizes the mesh to preserve shapes and straight lines. In various experiments we demonstrate that the results of our approach are often visually plausible, and the introduced distortion is often unnoticeable.

[1]  Denis Zorin,et al.  Correction of geometric perceptual distortions in pictures , 1995, SIGGRAPH.

[2]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[3]  Shmuel Peleg,et al.  Mosaicing on Adaptive Manifolds , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[6]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[8]  David Salesin,et al.  Interactive digital photomontage , 2004, SIGGRAPH 2004.

[9]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[10]  P. Perona,et al.  Squaring the circle in panoramas , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  J. Warren,et al.  Mean value coordinates for closed triangular meshes , 2005, SIGGRAPH 2005.

[12]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[13]  Scott Schaefer,et al.  Image deformation using moving least squares , 2006, ACM Trans. Graph..

[14]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[16]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  Aseem Agarwala,et al.  Efficient gradient-domain compositing using quadtrees , 2007, ACM Trans. Graph..

[18]  Mark Meyer,et al.  Harmonic coordinates for character articulation , 2007, ACM Trans. Graph..

[19]  Nikos Komodakis,et al.  Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning , 2007, IEEE Transactions on Image Processing.

[20]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[21]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[22]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[23]  D. Levin,et al.  Green Coordinates , 2008, SIGGRAPH 2008.

[24]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2008, Commun. ACM.

[25]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Dani Lischinski,et al.  Locally Adapted Projections to Reduce Panorama Distortions , 2009, Comput. Graph. Forum.

[27]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[28]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[29]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[30]  Maneesh Agrawala,et al.  Optimizing content-preserving projections for wide-angle images , 2009, SIGGRAPH '09.

[31]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Maneesh Agrawala,et al.  Image warps for artistic perspective manipulation , 2010, ACM Trans. Graph..

[33]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[34]  Krista A. Ehinger,et al.  Recognizing scene viewpoint using panoramic place representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Steven M. Drucker,et al.  Quality prediction for image completion , 2012, ACM Trans. Graph..

[36]  Jeffrey Ho,et al.  Seam Segment Carving: Retargeting Images to Irregularly-Shaped Image Domains , 2012, ECCV.

[37]  Valerio Pascucci,et al.  Panorama weaving , 2012, ACM Trans. Graph..

[38]  Yung-Yu Chuang,et al.  A line-structure-preserving approach to image resizing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.