An Approach to Video Compression Using Saliency Based Foveation

This research aims to increase quality of experience for video consumers by introducing an approach with saliency-based video foveation coupled with compression algorithm. This approach uses eye tracking information to build the saliency map and allows multiple usage scenarios. The approach can be used in single or multiple viewer environments. We evaluate the approach and provide results based on subjective measurements. The results confirm that the proposed approach for video compression is competitive and can deliver better quality of experience than standard video compression algorithms.

[1]  Dmitriy Vatolin,et al.  A semiautomatic saliency model and its application to video compression , 2017, 2017 13th IEEE International Conference on Intelligent Computer Communication and Processing (ICCP).

[2]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[3]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[4]  Laurent Itti,et al.  Visual attention guided bit allocation in video compression , 2011, Image Vis. Comput..

[5]  Radoslav Vargic,et al.  Advanced Interactive Multimedia Delivery in 5G Networks , 2017, IMCL.

[6]  Joohwan Kim,et al.  Latency Requirements for Foveated Rendering in Virtual Reality , 2017, ACM Trans. Appl. Percept..

[7]  Yen-Wei Chen,et al.  A Robust Eye Detection and Tracking Technique Using Gabor Filters , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[8]  Frédo Durand,et al.  A Benchmark of Computational Models of Saliency to Predict Human Fixations , 2012 .

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .