Personalized Item-of-Interest Recommendation on Storage Constrained Smartphone Based on Word Embedding Quantization

In recent years, word embedding models receive tremendous research attentions due to their capability of capturing textual semantics. This study investigates the issue of employing word embedding models into resource-limited smartphones for personalized item recommendation. The challenge lies in that the existing embedding models are often too large to fit into a resource-limited smartphones. One naive idea is to incorporate a secondary storage by residing the model in the secondary storage and processing recommendation with the secondary storage. However, this idea suffers from the burden of additional traffics. To this end, we propose a framework called Word Embedding Quantization (WEQ) that constructs an index upon a given word embedding model and stores the index on the primary storage to enable the use of the word embedding model on smartphones. One challenge for using the index is that the exact user profile is no longer ensured. However, we find that there are opportunities for computing the correct recommendation results by knowing only inexact user profile. In this paper, we propose a series of techniques that leverage the opportunities for computing candidates with the goal of minimizing the accessing cost to a secondary storage. Experiments are made to verify the efficiency of the proposed techniques, which demonstrates the feasibility of the proposed framework.

[1]  Tao Mei,et al.  When recommendation meets mobile: contextual and personalized recommendation on the go , 2011, UbiComp '11.

[2]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[3]  Arbee L. P. Chen,et al.  A Framework for Enabling User Preference Profiling through Wi-Fi Logs , 2016, IEEE Trans. Knowl. Data Eng..

[4]  Rich Caruana,et al.  Model compression , 2006, KDD '06.

[5]  Matthew Richardson,et al.  Predictive client-side profiles for personalized advertising , 2011, KDD.

[6]  Kyriakos Mouratidis,et al.  Global immutable region computation , 2014, SIGMOD Conference.

[7]  Xing Xie,et al.  GeoLife: A Collaborative Social Networking Service among User, Location and Trajectory , 2010, IEEE Data Eng. Bull..

[8]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[9]  Yang Guo,et al.  On top-k recommendation using social networks , 2012, RecSys.

[10]  Andrew Zisserman,et al.  Speeding up Convolutional Neural Networks with Low Rank Expansions , 2014, BMVC.

[11]  Kian-Lee Tan,et al.  Efficient safe-region construction for moving top-K spatial keyword queries , 2012, CIKM.

[12]  Enhong Chen,et al.  Mining Mobile User Preferences for Personalized Context-Aware Recommendation , 2014, ACM Trans. Intell. Syst. Technol..

[13]  Kian-Lee Tan,et al.  Context-aware advertisement recommendation for high-speed social news feeding , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[14]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[15]  Raymond K. Wong,et al.  Framework for timely and accurate ads on mobile devices , 2009, CIKM.