Video Retargeting Based on Spatiotemporal Saliency Model

This paper proposes a video retargeting method based on spatiotemporal saliency model. Global histograms and regional histograms are first calculated in both spatial domain and temporal domain, respectively, and then the spatiotemporal saliency model is built by evaluating the contrasts between the global histograms and each regional histogram. Based on the spatiotemporal saliency map, a salient object detection method is used to locate salient object regions in the video. Finally, cropping and uniform scaling operations are performed on the basis of salient object regions to generate the retargeted video. Experimental results on a variety of videos demonstrate that the proposed approach is simple and effective, and can preserve important objects well and achieve a better retargeting performance.

[1]  Hermann Ney,et al.  Pan, zoom, scan — Time-coherent, trained automatic video cropping , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Timo Kohlberger,et al.  Real-Time Optic Flow Computation with Variational Methods , 2003, CAIP.

[3]  Zhi Liu,et al.  Stretchability-aware block scaling for image retargeting , 2013, J. Vis. Commun. Image Represent..

[4]  Wen Gao,et al.  Video retargeting with multi-scale trajectory optimization , 2010, MIR '10.

[5]  Zhi Liu,et al.  Fast seam carving based on direction map , 2011 .

[6]  Deepu Rajan,et al.  Hybrid shift map for video retargeting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Qun Jin,et al.  Ranking Metrics and Search Guidance for Learning Object Repository , 2010, IEEE Transactions on Learning Technologies.

[8]  Jie Yu,et al.  Measuring semantic similarity between words by removing noise and redundancy in web snippets , 2011, Concurr. Comput. Pract. Exp..

[9]  Xiang Zhang,et al.  Region Diversity Maximization for Salient Object Detection , 2012, IEEE Signal Processing Letters.

[10]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[11]  H. Seidel,et al.  Motion-aware temporal coherence for video resizing , 2009, SIGGRAPH 2009.

[12]  Liquan Shen,et al.  Saliency detection using regional histograms. , 2013, Optics letters.

[13]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[14]  S. Avidan,et al.  Multi-operator media retargeting , 2009, SIGGRAPH 2009.