Relative learning from web images for content-adaptive enhancement

Personalized and content-adaptive image enhancement can find many applications in the age of social media and mobile computing. This paper presents a relative-learning-based approach, which, unlike previous methods, does not require matching original and enhanced images for training. This allows the use of massive online photo collections to train a ranking model for improved enhancement. We first propose a multi-level ranking model, which is learned from only relatively-labeled inputs that are automatically crawled. Then we design a novel parameter sampling scheme under this model to generate the desired enhancement parameters for a new image. For evaluation, we first verify the effectiveness and the generalization abilities of our approach, using images that have been enhanced/labeled by experts. Then we carry out subjective tests, which show that users prefer images enhanced by our approach over other existing methods.

[1]  Dani Lischinski,et al.  Collaborative Personalization of Image Enhancement , 2011, CVPR 2011.

[2]  Dani Lischinski,et al.  Content‐Aware Automatic Photo Enhancement , 2012, Comput. Graph. Forum.

[3]  Ashish Kapoor,et al.  Collaborative personalization of image enhancement , 2011, CVPR.

[4]  Erik Reinhard,et al.  Photographic tone reproduction for digital images , 2002, ACM Trans. Graph..

[5]  Ashish Kapoor,et al.  Context-Based Automatic Local Image Enhancement , 2012, ECCV.

[6]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[7]  Stephen Lin,et al.  A Learning-to-Rank Approach for Image Color Enhancement , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Dani Lischinski,et al.  Personalization of image enhancement , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Wencheng Wu,et al.  The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations , 2005 .

[10]  Mathias Lux,et al.  Content based image retrieval with LIRe , 2011, ACM Multimedia.

[11]  Edward H. Adelson,et al.  Personal photo enhancement using example images , 2010, TOGS.

[12]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[13]  References , 1971 .

[14]  James Ze Wang,et al.  Algorithmic inferencing of aesthetics and emotion in natural images: An exposition , 2008, 2008 15th IEEE International Conference on Image Processing.

[15]  Sylvain Paris,et al.  Learning photographic global tonal adjustment with a database of input / output image pairs , 2011, CVPR 2011.