How to Measure the Relevance of a Retargeting Approach?

Most cell phones today can receive and display video content. Nonetheless, we are still significantly behind the point where premium made for mobile content is mainstream, largely available, and affordable. Significant issues must be overcome. The small screen size is one of them. Indeed, the direct transfer of conventional contents (i.e. not specifically shot for mobile devices) will provide a video in which the main characters or objects of interest may become indistinguishable from the rest of the scene. Therefore, it is required to retarget the content. Different solutions exist, either based on distortion of the image, on removal of redundant areas, or cropping. The most efficient ones are based on dynamic adaptation of the cropping window. They significantly improve the viewing experience by zooming in the regions of interest. Currently, there is no common agreement on how to compare different solutions. A retargeting metric is proposed in order to gauge its quality. Eye-tracking experiments, zooming effect through coverage ratio and temporal consistency are introduced and discussed.

[1]  Patrick Le Callet,et al.  Efficient Saliency-Based Repurposing Method , 2006, 2006 International Conference on Image Processing.

[2]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[3]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  O. Meur,et al.  Predicting visual fixations on video based on low-level visual features , 2007, Vision Research.

[5]  Bärbel Mertsching,et al.  Fast and Robust Generation of Feature Maps for Region-Based Visual Attention , 2008, IEEE Transactions on Image Processing.

[6]  Markus H. Gross,et al.  A system for retargeting of streaming video , 2009, ACM Trans. Graph..

[7]  Hermann Ney,et al.  Pan, zoom, scan — Time-coherent, trained automatic video cropping , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jiaya Jia,et al.  Active Window Oriented Dynamic Video Retargeting , 2007 .

[9]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[10]  Christel Chamaret,et al.  Attention-based video reframing: Validation using eye-tracking , 2008, 2008 19th International Conference on Pattern Recognition.

[11]  Michael Gleicher,et al.  Video retargeting: automating pan and scan , 2006, MM '06.

[12]  Zigmantas L. Budrikis,et al.  Detail perception after scene changes in television image presentations , 1965, IEEE Trans. Inf. Theory.

[13]  Iain D. Gilchrist,et al.  Visual correlates of fixation selection: effects of scale and time , 2005, Vision Research.

[14]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[15]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[16]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[18]  Xing Xie,et al.  Visual attention based image browsing on mobile devices , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Xing Xie,et al.  Automatic browsing of large pictures on mobile devices , 2003, MULTIMEDIA '03.

[21]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..