Crowdsourced Learning to Photograph via Mobile Devices

Capturing a professional photo with high visual quality is always a challenging task for mobile users. This paper presents a crowd sourced learning to photograph approach to assist mobile users for composing high quality photos via their mobile devices. The proposed approach is able to leverage the camera and scene context to search related images with similar context and content from social media communities, and then mine composition knowledge to guide photographing on mobile devices. We develop a patch-based feature generation and selection process to discover salient patches and positions that dominate photo composition aesthetics in the input scene. We then build a regression model to map the composition of salient patches to photo-aesthetic scores. Finally, we develop an efficient hierarchical approach to search for the optimal view enclosure for photograph suggestion. We conducted extensive simulations and subjective evaluations to verify the proposed approach.

[1]  Bingbing Ni,et al.  Learning to photograph , 2010, ACM Multimedia.

[2]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[3]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[4]  Daniel Cohen-Or,et al.  Optimizing Photo Composition , 2010, Comput. Graph. Forum.

[5]  Mubarak Shah,et al.  A framework for photo-quality assessment and enhancement based on visual aesthetics , 2010, ACM Multimedia.

[6]  James Ze Wang,et al.  ACQUINE: aesthetic quality inference engine - real-time automatic rating of photo aesthetics , 2010, MIR '10.

[7]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[8]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[10]  Tao Mei,et al.  Knowledge discovery over community-sharing media: From signal to intelligence , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[11]  W. Chu Studying Aesthetics in Photographic Images Using a Computational Approach , 2013 .

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).