Word Embedding Quantization for Personalized Recommendation on Storage-Constrained Edge Devices in a Smart Store

In recent years, word embedding models receive tremendous research attentions due to their capability of capturing textual semantics. This study investigates the issue of employing word embedding models into storage-constrained edge devices for personalized item-of-interest recommendation in a smart store. The challenge lies in that the existing embedding models are often too large to fit into a storage-constrained edge device. One naive idea is to reside the word embedding model in a secondary storage and process recommendation with that storage. However, this idea suffers from the burden of additional traffics. To this end, we propose a framework called Word Embedding Quantization (WEQ) which constructs an index upon a given word embedding model and stores the index in the primary storage to enable the use of the word embedding model by edge devices. One challenge for using the index is that the exact user profile is no longer ensured. However, we find that there are opportunities for computing the correct recommendation results by knowing only an inexact user profile. In this paper, we propose a series of techniques that leverage the opportunities for computing candidates with the goal of minimizing the accessing cost to a secondary storage in edge devices. Experiments are performed to verify the efficiency of the proposed techniques, demonstrating the feasibility of the proposed framework.

[1]  Xing Xie,et al.  GeoLife: A Collaborative Social Networking Service among User, Location and Trajectory , 2010, IEEE Data Eng. Bull..

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  Tao Mei,et al.  When recommendation meets mobile: contextual and personalized recommendation on the go , 2011, UbiComp '11.

[4]  Kian-Lee Tan,et al.  Efficient safe-region construction for moving top-K spatial keyword queries , 2012, CIKM.

[5]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[6]  Enhong Chen,et al.  Mining Mobile User Preferences for Personalized Context-Aware Recommendation , 2014, ACM Trans. Intell. Syst. Technol..

[7]  Kyriakos Mouratidis,et al.  Global immutable region computation , 2014, SIGMOD Conference.

[8]  Yang Guo,et al.  On top-k recommendation using social networks , 2012, RecSys.

[9]  Andrew Zisserman,et al.  Speeding up Convolutional Neural Networks with Low Rank Expansions , 2014, BMVC.

[10]  Kian-Lee Tan,et al.  Context-aware advertisement recommendation for high-speed social news feeding , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Matthew Richardson,et al.  Predictive client-side profiles for personalized advertising , 2011, KDD.

[13]  Arbee L. P. Chen,et al.  A Framework for Enabling User Preference Profiling through Wi-Fi Logs , 2016, IEEE Trans. Knowl. Data Eng..

[14]  Rich Caruana,et al.  Model compression , 2006, KDD '06.

[15]  Raymond K. Wong,et al.  Framework for timely and accurate ads on mobile devices , 2009, CIKM.