Structured entropy of primitive: big data-based stereoscopic image quality assessment

The ultimate receiver of image and video is human visual system (HVS). It is an important problem in the domain of image and video processing that how to establish visual information representation model meeting the HVS perception property. In this study, authors give theory analysis and experiment results to prove that l_1 norm-based entropy of primitive (EoP) is superior to the l_0 norm-based EoP for the monocular cue in image quality assessment. By developing the concept of mutual information of primitive (MIP) as the binocular cue, an l_1 EoP-based stereoscopic image quality assessment metric is proposed. With EoP as monocular cue and MIP as binocular cue, the relative entropy between the original stereoscopic image and the distorted one is explored to predict the quality score with support vector regression. To avoid destroying image's structured information, the structured EoP (SEoP) is further explored to measure the stereoscopic image information. Extensive experimental results demonstrate that the stereoscopic image quality assessment algorithm with SEoP as monocular cue and MIP as binocular cue outperforms many state-of-the-art ones.

[1]  Weisi Lin,et al.  Perceptual Full-Reference Quality Assessment of Stereoscopic Images by Considering Binocular Visual Characteristics , 2013, IEEE Transactions on Image Processing.

[2]  Marcus Barkowsky,et al.  The influence of relative disparity and planar motion velocity on visual discomfort of stereoscopic videos , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[3]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[4]  Jhing-Fa Wang,et al.  Structuralized context-aware content and scalable resolution support for wireless VoD services , 2009, IEEE Transactions on Consumer Electronics.

[5]  Feng Jiang,et al.  Game theory based no-reference perceptual quality assessment for stereoscopic images , 2015, The Journal of Supercomputing.

[6]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[7]  Yang Gao,et al.  Discriminating features learning in hand gesture classification , 2015, IET Comput. Vis..

[8]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[9]  Guangming Shi,et al.  Perceptual Quality Metric With Internal Generative Mechanism , 2013, IEEE Transactions on Image Processing.

[10]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[11]  Chaminda T. E. R. Hewage,et al.  Reduced-reference quality assessment for 3D video compression and transmission , 2011, IEEE Transactions on Consumer Electronics.

[12]  Yuukou Horita,et al.  Stereoscopic image quality prediction , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[13]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[14]  Seungmin Rho,et al.  Optimal filter based on scale-invariance generation of natural images , 2015, The Journal of Supercomputing.

[15]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[16]  Min Liu,et al.  Using Structural degradation and Parallax for reduced-reference quality assessment of 3D images , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[17]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[18]  Jhing-Fa Wang,et al.  A Novel Video Summarization Based on Mining the Story-Structure and Semantic Relations Among Concept Entities , 2009, IEEE Transactions on Multimedia.

[19]  Mohamed-Chaker Larabi,et al.  A perceptual metric for stereoscopic image quality assessment based on the binocular energy , 2013, Multidimens. Syst. Signal Process..

[20]  Wen Gao,et al.  Image Primitive Coding and Visual Quality Assessment , 2012, PCM.

[21]  Joaquin Zepeda Salvatierra New sparse representation methods; application to image compression and indexing. (Nouvelles méthodes de représentations parcimonieuses ; application à la compression et l'indexation d'images) , 2010 .

[22]  Roushain Akhter,et al.  No-reference stereoscopic image quality assessment , 2010, Electronic Imaging.

[23]  Patrick Le Callet,et al.  Stereoscopic images quality assessment , 2007, 2007 15th European Signal Processing Conference.

[24]  Y. Horita,et al.  Spatio-temporal segmentation based continuous no-reference stereoscopic video quality prediction , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[25]  Wen Gao,et al.  Entropy of primitive: A top-down methodology for evaluating the perceptual visual information , 2013, 2013 Visual Communications and Image Processing (VCIP).

[26]  Jhing-Fa Wang,et al.  Smart Homecare Surveillance System: Behavior Identification Based on State-Transition Support Vector Machines and Sound Directivity Pattern Analysis , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[28]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[29]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[30]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[31]  Mei Yu,et al.  PMFS: A Perceptual Modulated Feature Similarity Metric for Stereoscopic Image Quality Assessment , 2014, IEEE Signal Processing Letters.

[32]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.