A multi-dimensional image quality prediction model for user-generated images in social networks

User-generated images (UGIs) are currently proliferating within social networks. These images contain multi-dimensional data, including the image itself, text and the social links of the owner. UGIs can be utilized for self-presentation, news dissemination and other purposes, and the quality of the image should be able to reveal these social functionalities. However, it is challenging to predict UGI quality utilizing existing models, such as image quality assessment, recommender systems or others, because these models have difficulties processing multi-dimensional data simultaneously. To address this problem, we propose a multi-dimensional image quality prediction model for UGIs in social networks. In this model, we build two sub-models for presentation measurement and distortion measurement. The text (i.e., tags and comments), social links and UGIs are processed by these two models separately, and the results of the models are pooled to obtain a final quality score. Both subjective and objective experiments are then arranged for ground truth data and performance assessment, respectively. Participants are asked to make judgments about 55 UGIs randomly selected from social networks, and the ground truth dataset is based on these subjective experiments. The objective experiments are performed to verify the performance of our model. The results indicate that the Pearson correlation parameter between the predicted score and the ground truth data is 0.5779, which suggests that the proposed model can be implemented to predict image quality in practical environments.

[1]  Liujuan Cao,et al.  Quality Assessment on User Generated Image for Mobile Search Application , 2013, MMM.

[2]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[3]  Diane M. Strong,et al.  AIMQ: a methodology for information quality assessment , 2002, Inf. Manag..

[4]  Alan C. Bovik,et al.  Visual quality assessment algorithms: what does the future hold? , 2010, Multimedia Tools and Applications.

[5]  Touradj Ebrahimi,et al.  Subjective Quality Evaluation via Paired Comparison: Application to Scalable Video Coding , 2011, IEEE Transactions on Multimedia.

[6]  Hsinchun Chen,et al.  AI and Opinion Mining , 2010, IEEE Intelligent Systems.

[7]  Richard Y. Wang,et al.  Data quality assessment , 2002, CACM.

[8]  Jenna M. King,et al.  A clinical image preference study comparing digital tomosynthesis with digital radiography for pediatric spinal imaging , 2011, Medical Imaging.

[9]  Reiner Eschbach,et al.  Comparing image preference in controlled and uncontrolled viewing conditions , 2010, J. Electronic Imaging.

[10]  Johannes M. Zanker,et al.  I like what I see: Using eye-movement statistics to detect image preference , 2010 .

[11]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[12]  Andrea Esuli,et al.  SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining , 2010, LREC.

[13]  Katarzyna Musial,et al.  Multidimensional Social Network in the Social Recommender System , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.

[15]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[16]  Weifeng Liu,et al.  Multiview Hessian Regularization for Image Annotation , 2013, IEEE Transactions on Image Processing.

[17]  Meng Wang,et al.  Multimedia Question Answering , 2010, IEEE MultiMedia.

[18]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[19]  Hung-Khoon Tan,et al.  Beyond search: Event-driven summarization for web videos , 2011, TOMCCAP.

[20]  Erkki Oja,et al.  A FastICA Algorithm for Non-negative Independent Component Analysis , 2004, ICA.

[21]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[22]  Lianwen Jin,et al.  Discriminative information preservation for face recognition , 2012, Neurocomputing.

[23]  Qi Tian,et al.  Mining flickr landmarks by modeling reconstruction sparsity , 2011, TOMCCAP.

[24]  Yong Tan,et al.  Social Networks and the Diffusion of User-Generated Content: Evidence from YouTube , 2012, Inf. Syst. Res..

[25]  Jiebo Luo,et al.  Aesthetics and Emotions in Images , 2011, IEEE Signal Processing Magazine.

[26]  Ralf Steinmetz,et al.  Multigranularity reuse of learning resources , 2011, TOMCCAP.

[27]  Mubarak Shah,et al.  A framework for photo-quality assessment and enhancement based on visual aesthetics , 2010, ACM Multimedia.

[28]  T. Daugherty,et al.  Exploring Consumer Motivations for Creating User-Generated Content , 2008 .

[29]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Meng Wang,et al.  Multimodal Graph-Based Reranking for Web Image Search , 2012, IEEE Transactions on Image Processing.

[31]  Yue Gao,et al.  Camera Constraint-Free View-Based 3-D Object Retrieval , 2012, IEEE Transactions on Image Processing.

[32]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[33]  Pablo Rodriguez,et al.  I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system , 2007, IMC '07.

[34]  Zhigang Luo,et al.  NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization , 2012, IEEE Transactions on Signal Processing.

[35]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[36]  M. Gilly,et al.  We Are What We Post? Self‐Presentation in Personal Web Space , 2003 .

[37]  Lei Xie,et al.  Minimizing the expected complete influence time of a social network , 2010, Inf. Sci..

[38]  Wen Gao,et al.  Location Discriminative Vocabulary Coding for Mobile Landmark Search , 2011, International Journal of Computer Vision.

[39]  Yue Gao,et al.  k-Partite graph reinforcement and its application in multimedia information retrieval , 2012, Inf. Sci..

[40]  Bing Liu,et al.  Opinion Mining and Sentiment Analysis , 2011 .

[41]  Xuelong Li,et al.  Hessian Regularized Support Vector Machines for Mobile Image Annotation on the Cloud , 2013, IEEE Transactions on Multimedia.

[42]  Danushka Bollegala,et al.  A preference learning approach to sentence ordering for multi-document summarization , 2012, Inf. Sci..

[43]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[44]  Carlo Batini,et al.  Methodologies for data quality assessment and improvement , 2009, CSUR.

[45]  Laura Sebastia,et al.  Preference elicitation techniques for group recommender systems , 2012, Inf. Sci..

[46]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[47]  Ahmad A. Kardan,et al.  A novel approach to hybrid recommendation systems based on association rules mining for content recommendation in asynchronous discussion groups , 2013, Inf. Sci..

[48]  Fuzhen Zhuang,et al.  Multi-view learning via probabilistic latent semantic analysis , 2012, Inf. Sci..

[49]  Luis M. de Campos,et al.  Using past-prediction accuracy in recommender systems , 2012, Inf. Sci..

[50]  Gwendolyn Seidman Self-presentation and belonging on Facebook: How personality influences social media use and motivations , 2013 .

[51]  Hyoseop Shin,et al.  Impact and degree of user sociability in social media , 2012, Inf. Sci..

[52]  Xindong Wu,et al.  3-D Object Retrieval With Hausdorff Distance Learning , 2014, IEEE Transactions on Industrial Electronics.

[53]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[54]  Yong Luo,et al.  Manifold Regularized Multitask Learning for Semi-Supervised Multilabel Image Classification , 2013, IEEE Transactions on Image Processing.

[55]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[56]  Lior Rokach,et al.  Introduction to Recommender Systems Handbook , 2011, Recommender Systems Handbook.

[57]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[58]  Yuan Yan Tang,et al.  Multiview Hessian discriminative sparse coding for image annotation , 2013, Comput. Vis. Image Underst..

[59]  Federica Cena,et al.  Anisotropic propagation of user interests in ontology-based user models , 2013, Inf. Sci..

[60]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[61]  Eleanor Wynn,et al.  Hyperbole over Cyberspace: Self-Presentation and Social Boundaries in Internet Home Pages and Discourse , 1997, Inf. Soc..

[62]  John Krumm,et al.  User-Generated Content , 2008, IEEE Pervasive Comput..

[63]  Felix Naumann,et al.  Data fusion , 2009, CSUR.