Psychological advertising: exploring user psychology for click prediction in sponsored search

Precise click prediction is one of the key components in the sponsored search system. Previous studies usually took advantage of two major kinds of information for click prediction, i.e., relevance information representing the similarity between ads and queries and historical click-through information representing users' previous preferences on the ads. These existing works mainly focused on interpreting ad clicks in terms of what users seek (i.e., relevance information) and how users choose to click (historically clicked-through information). However, few of them attempted to understand why users click the ads. In this paper, we aim at answering this ``why'' question. In our opinion, users click those ads that can convince them to take further actions, and the critical factor is if those ads can trigger users' desires in their hearts. Our data analysis on a commercial search engine reveals that specific text patterns, e.g., ``official site'', ``$x\%$ off'', and ``guaranteed return in $x$ days'', are very effective in triggering users' desires, and therefore lead to significant differences in terms of click-through rate (CTR). These observations motivate us to systematically model user psychological desire in order for a precise prediction on ad clicks. To this end, we propose modeling user psychological desire in sponsored search according to Maslow's desire theory, which categorizes psychological desire into five levels and each one is represented by a set of textual patterns automatically mined from ad texts. We then construct novel features for both ads and users based on our definition on psychological desire and incorporate them into the learning framework of click prediction. Large scale evaluations on the click-through logs from a commercial search engine demonstrate that this approach can result in significant improvement in terms of click prediction accuracy, for both the ads with rich historical data and those with rare one. Further analysis reveals that specific pattern combinations are especially effective in driving click-through rates, which provides a good guideline for advertisers to improve their ad textual descriptions.

[1]  Erick Cantú-Paz,et al.  Personalized click prediction in sponsored search , 2010, WSDM '10.

[2]  Charles L. A. Clarke,et al.  The influence of caption features on clickthrough patterns in web search , 2007, SIGIR.

[3]  Dawid Weiss,et al.  Predicting Ads' Click-Through Rate with Decision Rules , 2008 .

[4]  A. Maslow A Theory of Human Motivation , 1943 .

[5]  Xiaofei He,et al.  Query rewriting using active learning for sponsored search , 2007, SIGIR.

[6]  K. Dembczynski Predicting Ads’ Click-Through Rate with Decision Rules , 2008 .

[7]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[8]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[9]  Torsten Suel,et al.  Modeling and predicting user behavior in sponsored search , 2009, KDD.

[10]  Bernard J. Jansen,et al.  Sponsored search: an overview of the concept, history, and technology , 2008, Int. J. Electron. Bus..

[11]  Rukmini Iyer,et al.  The sum of its parts: reducing sparsity in click estimation with query segments , 2011, Information Retrieval.

[12]  Vibhanshu Abhishek,et al.  Keyword generation for search engine advertising using semantic similarity between terms , 2007, ICEC.

[13]  T. Minka A comparison of numerical optimizers for logistic regression , 2004 .

[14]  Rukmini Iyer,et al.  Data-driven text features for sponsored search click prediction , 2009, KDD Workshop on Data Mining and Audience Intelligence for Advertising.

[15]  Ye Chen,et al.  Position-normalized click prediction in search advertising , 2012, KDD.

[16]  Daniel C. Fain,et al.  Sponsored search: A brief history , 2006 .

[17]  Vassilis Plachouras,et al.  Online learning from click data for sponsored search , 2008, WWW.

[18]  Joaquin Quiñonero Candela,et al.  Web-Scale Bayesian Click-Through rate Prediction for Sponsored Search Advertising in Microsoft's Bing Search Engine , 2010, ICML.

[19]  Girish N. Punj,et al.  An Interaction Framework of Consumer Decision Making , 1983 .

[20]  Filip Radlinski,et al.  Optimizing relevance and revenue in ad search: a query substitution approach , 2008, SIGIR '08.

[21]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[22]  Tao Qin,et al.  Advertiser-centric approach to understand user click behavior in sponsored search , 2011, CIKM '11.