IoT and distributed machine learning powered optimal state recommender solution

Recommender systems add significant benefits to E-commerce in terms of sale conversion, revenues, customer experience, loyalty and lifetime value. But the recommendations from these systems do not change on inputs beyond user and item profile and transaction data. There have been some attempts in the past to optimize on more varied data in recommenders, example of which is the location based recommenders. But location is just one dimension of the state that a user could have shared with GPS/GLONASS/BaiDeu sensor available in most Smartphones. With an upcoming era of Smart-wears and pervasive IoTs, there are a lot many other dimensions of a user state which can be utilized to optimize upon the concept of Optimal State Recommender Solutions. This paper suggests upgrading from conventional recommendations that are based on user/ item preferences alone with systems that provide the best recommendation at the most optimal state when the user is most receptive to accept the recommendation, the “optimal state recommendation solution” and proposes solutions and architectures to overcome the challenges of dealing with real time, distributed machine learning on IoT scale data in implementing this solution. The paper leverages some of the advance distributed machine learning algorithms like variants of Distributed Kalman Filters, Distributed Alternating Least Square Recommenders, Distributed Mini-Batch Stochastic Gradient Descent(SGD) based Classifiers, and highly scalable distributed computation and machine learning platforms like Apache Spark, (Apache) Spark MLlib, Spark Streaming, Python/PySpark, R/SparkR, Apache Kafka in an high performance, distributed, fault tolerant architecture. The solution also aspires to be compliant with upcoming IoT standards and architectures like IEEE P2413 to provide a standard solution for such problems beyond the current scope of this paper.

[1]  Mohit Sewak,et al.  A Reference Architecture and Road map for Enabling E- commerce on Apache Spark , 2015 .

[2]  Reza Olfati-Saber,et al.  Distributed Kalman filtering and sensor fusion in sensor networks , 2006 .

[3]  R. Olfati-Saber,et al.  Distributed Kalman Filter with Embedded Consensus Filters , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[4]  David P. Woodruff,et al.  Low rank approximation and regression in input sparsity time , 2012, STOC '13.

[5]  Léon Bottou,et al.  The Tradeoffs of Large Scale Learning , 2007, NIPS.

[6]  Ivan Jeliazkov,et al.  Information Processing Pattern and Propensity to Buy: An Investigation of Online Point-of-Purchase Behavior , 2013, Mark. Sci..

[7]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[8]  Feng Yang,et al.  Towards building and evaluating a personalized location-based recommender system , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[9]  Bin Wu,et al.  Budgeted mini-batch parallel gradient descent for support vector machines on Spark , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[10]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[11]  Huan Liu,et al.  Social recommendation: a review , 2013, Social Network Analysis and Mining.

[12]  Mohamed F. Mokbel,et al.  Location-based and preference-aware recommendation using sparse geo-social networking data , 2012, SIGSPATIAL/GIS.

[13]  Peter J. Haas,et al.  Large-scale matrix factorization with distributed stochastic gradient descent , 2011, KDD.

[14]  Magdy A. Bayoumi,et al.  Low-Power Distributed Kalman Filter for Wireless Sensor Networks , 2011, EURASIP J. Embed. Syst..

[15]  Nishant Garg Apache Kafka , 2013 .