Automatic image retargeting

We present a non-photorealistic algorithm for retargeting large images to small size displays, particularly on mobile devices. This method adapts large images so that important objects in the image are still recognizable when displayed at a lower target resolution. Existing image manipulation techniques such as cropping works well for images containing a single important object, and down-sampling works well for images containing low frequency information. However, when these techniques are automatically applied to images with multiple objects, the image quality degrades and important information may be lost. Our algorithm addresses the case of multiple important objects in an image. The retargeting algorithm segments an image into regions, identifies important regions, removes them, fills the resulting gaps, resizes the remaining image, and re-inserts the important regions. Our approach lies in constructing a topologically constrained epitome of an image based on a visual attention model that is both comprehensible and size varying, making the method suitable for display-critical applications.

[1]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[2]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[3]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  M. Sheelagh T. Carpendale,et al.  A framework for unifying presentation space , 2001, UIST '01.

[5]  Brendan J. Frey,et al.  Epitomic analysis of appearance and shape , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Narendra Ahuja,et al.  Mean-shift segmentation with wavelet-based bandwidth selection , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[7]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[8]  Penny Rheingans,et al.  Perceptual Measures For Effective Visualizations , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[9]  Sheena Rogers Perceiving Pictorial Space , 1995 .

[10]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[11]  Penny Rheingans,et al.  Perceptual Measures For Effective Visualizations , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[12]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[13]  Peter Meer,et al.  Synergism in low level vision , 2002, Object recognition supported by user interaction for service robots.

[14]  Peter Meer,et al.  Edge Detection with Embedded Confidence , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Xing Xie,et al.  Looking into video frames on small displays , 2003, ACM Multimedia.

[16]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[18]  Allison Woodruff,et al.  Using thumbnails to search the Web , 2001, CHI.

[19]  Stephen Michael,et al.  On the ontological status of visual mental images , 1978, TINLAP '78.

[20]  Thierry Blu,et al.  Least-squares image resizing using finite differences , 2001, IEEE Trans. Image Process..

[21]  Jon May,et al.  Perceptual Principles and Computer Graphics , 2000, Comput. Graph. Forum.

[22]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[23]  Xing Xie,et al.  Automatic browsing of large pictures on mobile devices , 2003, MULTIMEDIA '03.

[24]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[25]  David J. Fleet,et al.  Embedding invisible information in color images , 1997, Proceedings of International Conference on Image Processing.

[26]  Stephen M. Kosslyn,et al.  On the ontological status of visual mental images , 1978, TINLAP '78.

[27]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[28]  Jon May,et al.  Perceptual Principles and Computer Graphics , 1999 .

[29]  Takeo Kanade,et al.  Human Face Detection in Visual Scenes , 1995, NIPS.

[30]  Majid Mirmehdi,et al.  Segmentation of Color Textures , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Xing Xie,et al.  Image Adaptation Based on Attention Model for Small-Form-Factor Device , 2003, MMM.

[32]  Sheila S. Hemami,et al.  Edge-adaptive JPEG image compression , 1996, Other Conferences.

[33]  Paul Harrison,et al.  A Non-Hierarchical Procedure for Re-Synthesis of Complex Textures , 2001, WSCG.