Spatio-Temporal Measures Of Naturalness

Today, a wide variety of casual users of diverse videographic skills and styles capture a large portion of all videos, often equipped with uncertain hands and operating under difficult lighting conditions. These videos are taken with many types of camera devices having different characteristics, resulting in a wide range and diversity of video qualities. These are the kinds of videos shared on YouTube, Snapchat, and Face-book. Being able to predict the quality of these videos is an important goal for a variety of invested practitioners, including camera designers, cloud engineers, and users who could be directed to recapture videos of poor quality. In nearly every instance, a high quality reference video is not available, hence blind video quality predictors are of the greatest interest. Towards advancing this area, we have studied the spatiotemporal statistic of a wide variety of natural videos, constructed new directional temporal statistical models of videos, and studied whether measures of directional spatio-temporal naturalness can be developed that are predictive of quality.

[1]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[2]  Constantine Caramanis,et al.  Second Order Natural Scene Statistics Model of Blind Image Quality Assessment , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[4]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[5]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[6]  Gustavo de Veciana,et al.  Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[7]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Alan Conrad Bovik,et al.  Large-Scale Study of Perceptual Video Quality , 2018, IEEE Transactions on Image Processing.

[9]  Constantine Caramanis,et al.  Towards a Closed Form Second-Order Natural Scene Statistics Model , 2018, IEEE Transactions on Image Processing.

[10]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[11]  Christophe Charrier,et al.  Blind Prediction of Natural Video Quality , 2014, IEEE Transactions on Image Processing.

[12]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[13]  Alan C. Bovik,et al.  Large Scale Subjective Video Quality Study , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[14]  Ralf Engbert Microsaccades: A microcosm for research on oculomotor control, attention, and visual perception. , 2006, Progress in brain research.

[15]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[16]  Martina Poletti,et al.  A compact field guide to the study of microsaccades: Challenges and functions , 2016, Vision Research.

[17]  C.-C. Jay Kuo,et al.  MCL-V: A streaming video quality assessment database , 2015, J. Vis. Commun. Image Represent..

[18]  A. Bovik A VISUAL INFORMATION FIDELITY APPROACH TO VIDEO QUALITY ASSESSMENT , 2005 .

[19]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[20]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[21]  J. Victor,et al.  The unsteady eye: an information-processing stage, not a bug , 2015, Trends in Neurosciences.