No-Reference Light Field Image Quality Assessment Based on Micro-Lens Image

Light field image quality assessment (LF-IQA) plays a significant role due to its guidance to Light Field (LF) contents acquisition, processing and application. The LF can be represented as 4-D signal, and its quality depends on both angular consistency and spatial quality. However, few existing LF-IQA methods concentrate on effects caused by angular inconsistency. Especially, no-reference methods lack effective utilization of 2D angular information. In this paper, we focus on measuring the 2-D angular consistency for LF-IQA. The Micro-Lens Image (MLI) refers to the angular domain of the LF image, which can simultaneously record the angular information in both horizontal and vertical directions. Since the MLI contains 2D angular information, we propose a No-Reference Light Field image Quality assessment model based on MLI (LF-QMLI). Specifically, we first utilize Global Entropy Distribution (GED) and Uniform Local Binary Pattern descriptor (ULBP) to extract features from the MLI, and then pool them together to measure angular consistency. In addition, the information entropy of SubAperture Image (SAI) is adopted to measure spatial quality. Extensive experimental results show that LF-QMLI achieves the state-of-the-art performance.

[1]  Touradj Ebrahimi,et al.  VALID: Visual quality Assessment for Light field Images Dataset , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[2]  Do-Kyoung Kwon,et al.  Full-reference quality assessment of stereopairs accounting for rivalry , 2013, Signal Process. Image Commun..

[3]  Junhui Hou,et al.  Light Filed Image Quality Assessment by Local and Global Features of Epipolar Plane Image , 2018, 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM).

[4]  Daniel Thalmann,et al.  Model-Based Referenceless Quality Metric of 3D Synthesized Images Using Local Image Description , 2018, IEEE Transactions on Image Processing.

[5]  Hans-Peter Seidel,et al.  Towards a Quality Metric for Dense Light Fields , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  M. Levoy,et al.  Recording and controlling the 4D light field in a microscope using microlens arrays , 2009, Journal of microscopy.

[7]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[8]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[9]  Qionghai Dai,et al.  Light Field Image Processing: An Overview , 2017, IEEE Journal of Selected Topics in Signal Processing.

[10]  Thomas Pock,et al.  Variational Shape from Light Field , 2013, EMMCVPR.

[11]  Federica Battisti,et al.  Reduced Reference Quality Assessment of Light Field Images , 2019, IEEE Transactions on Broadcasting.

[12]  Alan C. Bovik,et al.  Perceptual quality prediction on authentically distorted images using a bag of features approach , 2016, Journal of vision.

[13]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[14]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[15]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[16]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[17]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[18]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Zhibo Chen,et al.  Blind Stereoscopic Video Quality Assessment: From Depth Perception to Overall Experience. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[20]  Z.X. Xie,et al.  Constructing NR-IQA Function Based on Product of Information Entropy and Contrast , 2008, 2008 International Symposium on Information Science and Engineering.

[21]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[22]  Patrick Le Callet,et al.  DIBR synthesized image quality assessment based on morphological wavelets , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[23]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[24]  Wei Zhou,et al.  Perceptual Evaluation of Light Field Image , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[25]  Dragan D. Kukolj,et al.  Multi–Scale Synthesized View Assessment Based on Morphological Pyramids , 2016 .

[26]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[27]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[28]  J. Sponring.  The entropy of scale-space , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[29]  Alan Conrad Bovik,et al.  Binocular spatial activity and reverse saliency driven no-reference stereopair quality assessment , 2017, Signal Process. Image Commun..

[30]  Patrick Le Callet,et al.  Objective image quality assessment of 3D synthesized views , 2015, Signal Process. Image Commun..

[31]  Yu-Wing Tai,et al.  Modeling the Calibration Pipeline of the Lytro Camera for High Quality Light-Field Image Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[32]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[34]  Touradj Ebrahimi,et al.  Objective and subjective evaluation of light field image compression algorithms , 2016, 2016 Picture Coding Symposium (PCS).

[35]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[36]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[37]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[38]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[39]  Byeungwoo Jeon,et al.  Light Field Image Coding for Efficient Refocusing , 2018, 2018 IEEE 12th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC).

[40]  Wujie Zhou,et al.  Binocular Responses for No-Reference 3D Image Quality Assessment , 2016, IEEE Transactions on Multimedia.