A Mixture of Experts Approach to Multi-strategy Image Quality Assessment

The success of some recently proposed multi-strategy image quality metrics supports the hypothesis that the Human Visual System (HVS) uses multiple strategies when assessing image quality, where the effect from each strategy on the final quality prediction is conditioned on the quality level of the test image. To date, how to optimally combine multiple strategies into a final quality prediction remains an unsolved problem, especially when more than two strategies are involved. In this paper, we present a data-driven combination method based on a conditional Bayesian Mixture of Experts (BME) model. This method provides an effective way to model the interaction of a flexible number of strategies. Extensive evaluation on three publicly-available image quality databases demonstrates the potential of our method.

[1]  Cristian Sminchisescu,et al.  Fast algorithms for large scale conditional 3D prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[3]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[4]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[5]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  Nikolay N. Ponomarenko,et al.  METRICS PERFORMANCE COMPARISON FOR COLOR IMAGE DATABASE , 2008 .

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Alan C. Bovik,et al.  Visual quality assessment algorithms: what does the future hold? , 2010, Multimedia Tools and Applications.

[10]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[11]  W. Bastiaan Kleijn,et al.  A bayesian hierarchical mixture of experts approach to estimate speech quality , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[12]  Cristian Sminchisescu,et al.  BM³E : Discriminative Density Propagation for Visual Tracking , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[14]  Christopher M. Bishop,et al.  Bayesian Hierarchical Mixtures of Experts , 2002, UAI.