Saliency-Based Content-Aware Image Mosaics

In this paper, we propose a novel content-aware image mosaic approach based on image saliency. The image saliency is used in the whole process of creating an image mosaic with variable size tiles, while a novel energy map is proposed by combining Neighborhood Inhomogeneity Factor and Graph-Based Visual Saliency. The target image is divided into small tiles with variable sizes based on the energy map. Image retrieval is introduced to choose the tile images from a certain database. Considering the specialization of tile image retrieval, we propose a new feature representation called brightness distribution vector, which indicates the image global brightness distribution. Extensive experiments are conducted to show that the proposed approach creates better mosaics in visual aspect than the conventional methods.

[1]  Zhong Bao-jiang Image retrieval based on saliency weighted color and texture , 2010 .

[2]  Sabine Süsstrunk,et al.  Saliency detection for content-aware image resizing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Pascal Fua,et al.  Image summaries using database saliency , 2009, SIGGRAPH ASIA '09.

[4]  Jing-Yu Yang,et al.  Exploiting Intensity Inhomogeneity to Extract Textured Objects from Natural Scenes , 2009, ACCV.

[5]  Meng Wang,et al.  Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification , 2012, IEEE Transactions on Multimedia.

[6]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[7]  Hongbin Zha,et al.  Computer Vision - ACCV 2009, 9th Asian Conference on Computer Vision, Xi'an, China, September 23-27, 2009, Revised Selected Papers, Part III , 2010, Asian Conference on Computer Vision.

[8]  Nicholas Tran,et al.  Generating photomosaics: an empirical study , 1999, SAC '99.

[9]  Adam Finkelstein,et al.  Image Mosaics , 1998, EP.

[10]  Thomas S. Huang,et al.  Image processing , 1971 .

[11]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[13]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.