Content-Aware Rotation

We present an image editing tool called Content-Aware Rotation. Casually shot photos can appear tilted, and are often corrected by rotation and cropping. This trivial solution may remove desired content and hurt image integrity. Instead of doing rigid rotation, we propose a warping method that creates the perception of rotation and avoids cropping. Human vision studies suggest that the perception of rotation is mainly due to horizontal/vertical lines. We design an optimization-based method that preserves the rotation of horizontal/vertical lines, maintains the completeness of the image content, and reduces the warping distortion. An efficient algorithm is developed to address the challenging optimization. We demonstrate our content-aware rotation method on a variety of practical cases.

[1]  E Goldmeier,et al.  Similarity in visually perceived forms. , 1972, Psychological issues.

[2]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[3]  D Purves,et al.  Why are angles misperceived? , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Andrew C. Gallagher.  Using vanishing points to correct camera rotation in images , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[5]  Takeo Igarashi,et al.  As-rigid-as-possible shape manipulation , 2005, ACM Trans. Graph..

[6]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[8]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Michael Freeman,et al.  The Photographer's Eye: Composition and Design for Better Digital Photos , 2007 .

[10]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[11]  O. Sorkine-Hornung,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH Asia '08.

[12]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[13]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[14]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[15]  Dani Lischinski,et al.  Locally Adapted Projections to Reduce Panorama Distortions , 2009, Comput. Graph. Forum.

[16]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[17]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[18]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[19]  Maneesh Agrawala,et al.  Optimizing content-preserving projections for wide-angle images , 2009, SIGGRAPH '09.

[20]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[21]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Maneesh Agrawala,et al.  Image warps for artistic perspective manipulation , 2010, ACM Trans. Graph..

[23]  S. Saint,et al.  Clinical problem-solving. The right angle. , 2011, The New England journal of medicine.

[24]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[25]  Steven M. Drucker,et al.  Quality prediction for image completion , 2012, ACM Trans. Graph..

[26]  Seungyong Lee,et al.  Automatic upright adjustment of photographs , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Yung-Yu Chuang,et al.  A line-structure-preserving approach to image resizing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Eli Shechtman,et al.  Image melding , 2012, ACM Trans. Graph..

[29]  Jian Sun,et al.  Rectangling panoramic images via warping , 2013, ACM Trans. Graph..