The impact of images on user clicks in product search

Product search engine faces unique challenges that differ from web page search. The goal of a product search engine is to rank relevant items that the user may be interested in purchasing. Clicks provide a strong signal of a user's interest in an item. Traditional click prediction models include many features such as document text, price, and user information. In this paper, we propose adding information extracted from the thumbnail image of the item as additional features for click prediction. Specifically, we use two types of image features -- photographic features and object features. Our experiments reveal that both types of features can be highly useful in click prediction. We measure our performance in both prediction accuracy and NDCG. Overall, our experiments show that augmenting with image features to a standard model in click prediction provides significant improvement in precision and recall and boosts NDCG.

[1]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Vidit Jain,et al.  Learning to re-rank: query-dependent image re-ranking using click data , 2011, WWW.

[3]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[4]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Zheng Chen,et al.  A novel click model and its applications to online advertising , 2010, WSDM '10.

[7]  Dawid Weiss,et al.  Predicting Ads' Click-Through Rate with Decision Rules , 2008 .

[8]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[9]  Wei Wu,et al.  Learning a Robust Relevance Model for Search Using Kernel Methods , 2011, J. Mach. Learn. Res..

[10]  Anjan Goswami,et al.  A study on the impact of product images on user clicks for online shopping , 2011, WWW.

[11]  Alfred O. Hero,et al.  Efficient learning of sparse, distributed, convolutional feature representations for object recognition , 2011, 2011 International Conference on Computer Vision.

[12]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[13]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[14]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[15]  Atiq Islam,et al.  Assessing product image quality for online shopping , 2012, Electronic Imaging.

[16]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[17]  Yong Yu,et al.  Click Prediction for Product Search on C2C Web Sites , 2010, ADMA.

[18]  Sabine Süsstrunk,et al.  Measuring colorfulness in natural images , 2003, IS&T/SPIE Electronic Imaging.

[19]  Xiaoyuan Wu,et al.  Predicting the conversion probability for items on C2C ecommerce sites , 2009, CIKM.

[20]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[21]  Evgeniy Gabrilovich,et al.  Translating relevance scores to probabilities for contextual advertising , 2009, CIKM.

[22]  Ahmed Hassan Awadallah,et al.  Beyond DCG: user behavior as a predictor of a successful search , 2010, WSDM '10.

[23]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[24]  Jim R. Parker,et al.  Algorithms for image processing and computer vision , 1996 .

[25]  Andrew Blake,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[26]  Ben Carterette,et al.  Evaluating Search Engines by Modeling the Relationship Between Relevance and Clicks , 2007, NIPS.

[27]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[28]  Nuno Vasconcelos,et al.  From Pixels to Semantic Spaces: Advances in Content-Based Image Retrieval , 2007, Computer.

[29]  Hema Raghavan,et al.  Improving ad relevance in sponsored search , 2010, WSDM '10.

[30]  Olivier Chapelle,et al.  A dynamic bayesian network click model for web search ranking , 2009, WWW '09.

[31]  Honglak Lee,et al.  Efficient L1 Regularized Logistic Regression , 2006, AAAI.

[32]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[33]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[34]  Marc'Aurelio Ranzato,et al.  Sparse Feature Learning for Deep Belief Networks , 2007, NIPS.

[35]  Benjamin Piwowarski,et al.  Predictive user click models based on click-through history , 2007, CIKM '07.

[36]  Qiang Wu,et al.  Click-through prediction for news queries , 2009, SIGIR.

[37]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[38]  L. Stoel,et al.  On-line product presentation: Effects on mood, perceived risk, and purchase intention , 2005 .

[39]  Shumeet Baluja,et al.  Pagerank for product image search , 2008, WWW.

[40]  Erick Cantú-Paz,et al.  Personalized click prediction in sponsored search , 2010, WSDM '10.