A Light Field Image Quality Assessment Model Based on Symmetry and Depth Features

This letter presents a new full-reference image quality assessment (IQA) method for conducting the perceptual quality evaluation of the light field (LF) images, called the symmetry and depth feature-based model (SDFM). Specifically, the radial symmetry transform is first employed on the luminance components of the reference and distorted LF images to extract their symmetry features for capturing the spatial quality of each view of an LF image. Second, the depth feature extraction scheme is designed to explore the geometry information inherited in an LF image for modeling its LF structural consistency across views. The similarity measurements are subsequently conducted on the comparison of their symmetry and depth features separately, which are further combined to achieve the quality score for the distorted LF image. Note that the proposed SDFM that explores the symmetry and depth features is conformable to the human vision system, which identifies the objects by sensing their structures and geometries. Extensive simulation results on the dense light fields dataset have clearly shown that the proposed SDFM outperforms multiple classical and recently developed IQA algorithms on quality evaluation of the LF images.

[1]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[2]  Noah Snavely,et al.  Image matching using local symmetry features , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Kai-Kuang Ma,et al.  Screen Content Image Quality Assessment Using Multi-Scale Difference of Gaussian , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Hans-Peter Seidel,et al.  Towards a Quality Metric for Dense Light Fields , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Zhibo Chen,et al.  No-Reference Light Field Image Quality Assessment Based on Spatial-Angular Measurement , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[7]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jie Chen,et al.  Light Field Image Compression Based on Bi-Level View Compensation With Rate-Distortion Optimization , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Federica Battisti,et al.  Reduced Reference Quality Assessment of Light Field Images , 2019, IEEE Transactions on Broadcasting.

[10]  Claudio M. Privitera,et al.  Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Liquan Shen,et al.  A No-Reference Image Quality Assessment Metric by Multiple Characteristics of Light Field Images , 2019, IEEE Access.

[12]  Kai-Kuang Ma,et al.  A multi-order derivative feature-based quality assessment model for light field image , 2018, J. Vis. Commun. Image Represent..

[13]  Minh N. Do,et al.  A Retina-Based Perceptually Lossless Limit and a Gaussian Foveation Scheme With Loss Control , 2014, IEEE Journal of Selected Topics in Signal Processing.

[14]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[16]  Junhui Hou,et al.  Light Filed Image Quality Assessment by Local and Global Features of Epipolar Plane Image , 2018, 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM).

[17]  Kai-Kuang Ma,et al.  A Gabor Feature-Based Quality Assessment Model for the Screen Content Images , 2018, IEEE Transactions on Image Processing.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[20]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[21]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[22]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[23]  Jie Chen,et al.  Accurate Light Field Depth Estimation With Superpixel Regularization Over Partially Occluded Regions , 2017, IEEE Transactions on Image Processing.

[24]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.