[POSTER] Enhanced Personalized Targeting Using Augmented Reality

Augmented Reality (AR) based applications have existed for some time; however, their true potential in digital marketing remains unexploited. To bridge this gap we create a novel consumer targeting system. First, we analyze consumer interactions on AR-based retail apps to identify her preferred purchase viewpoint during the session. We then target the consumer through a personalized catalog, created by embedding recommended products in her viewpoint visual. The color and style of the embedded product are matched with the viewpoint to create recommendations, and personalized text content is created using visual cues from the AR data. Evaluation with user studies show that our system is able to identify the viewpoint, our recommendations are better than tag-based recommendations, and targeting using the viewpoint is better than that of usual product catalogs.

[1]  Aaron Hertzmann,et al.  Color compatibility from large datasets , 2011, SIGGRAPH 2011.

[2]  Pan Hui,et al.  When Augmented Reality meets Big Data , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems Workshops (ICDCSW).

[3]  Altigran Soares da Silva,et al.  Finding Similar Products in E-commerce Sites Based on Attributes , 2015, AMW.

[4]  Leonidas J. Guibas,et al.  ShapeNet: An Information-Rich 3D Model Repository , 2015, ArXiv.

[5]  Stephan Steglich,et al.  A Generic Multipurpose recommender System for Contextual Recommendations , 2007, Eighth International Symposium on Autonomous Decentralized Systems (ISADS'07).

[6]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[7]  Xavier Bonaventura Brugués Perceptual information-theoretic measures for viewpoint selection and object recognition , 2015 .

[8]  Jiawei Han,et al.  Association Mining in Large Databases: A Re-examination of Its Measures , 2007, PKDD.

[9]  Rishiraj Saha Roy,et al.  Automated Linguistic Personalization of Targeted Marketing Messages Mining User-Generated Text on Social Media , 2015, CICLing.

[10]  Alan Charlesworth Key Concepts in e-Commerce , 2007 .

[11]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[12]  Hui Xiong,et al.  Point-of-Interest Recommendation in Location Based Social Networks with Topic and Location Awareness , 2013, SDM.

[13]  Lukasz Raczkowski,et al.  Visual Recommendation Use Case for an Online Marketplace Platform: allegro.pl , 2016, SIGIR.

[14]  Mateu Sbert,et al.  Automatic View Selection Using Viewpoint Entropy and its Application to Image‐Based Modelling , 2003, Comput. Graph. Forum.

[15]  Dameng Dai Stylized rendering for virtual furniture layout , 2011, 2011 International Conference on Multimedia Technology.

[16]  Andreas M. Kunz,et al.  Using Head Tracking Data for Robust Short Term Path Prediction of Human Locomotion , 2013, Trans. Comput. Sci..

[17]  Shimei Pan,et al.  Personalized Emphasis Framing for Persuasive Message Generation , 2016, EMNLP.

[18]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[19]  Christopher H Jackson,et al.  flexsurv: A Platform for Parametric Survival Modeling in R. , 2016, Journal of statistical software.

[20]  D. Cox,et al.  Analysis of Survival Data. , 1986 .

[21]  Alla Sheffer,et al.  Elements of style , 2015, ACM Trans. Graph..

[22]  Andy Cockburn,et al.  User-defined gestures for augmented reality , 2013, INTERACT.

[23]  Afzal Godil,et al.  A benchmark for best view selection of 3D objects , 2010, 3DOR '10.

[24]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Vaishnavi Subramanian,et al.  Summarizing Multimedia Content , 2016, WISE.

[26]  Bruce Krulwich,et al.  LIFESTYLE FINDER: Intelligent User Profiling Using Large-Scale Demographic Data , 1997, AI Mag..

[27]  Margaret C. Campbell,et al.  Goal Seeker and Persuasion Sentry: How Consumer Targets Respond to Interpersonal Marketing Persuasion , 2004 .

[28]  Roberto Pierdicca,et al.  Automatic Analysis of Eye-Tracking Data for Augmented Reality Applications: A Prospective Outlook , 2016, AVR.

[29]  Przemyslaw Kazienko,et al.  Integration of relational databases and Web site content for product and page recommendation , 2004, Proceedings. International Database Engineering and Applications Symposium, 2004. IDEAS '04..