A Big Data Recommendation Engine Framework Based on Local Pattern Analytics Strategy for Mining Multi-Sourced Big Data

Organisations that perform business operations in a multi-sourced big data environment are in imperative need to discover meaningful patterns of interest from their diversified data sources. With the advent of big data technologies such as Hadoop and Spark, commodity hardwares play vital role in the task of data analytics and process the multi-sourced and multi-formatted big data in a reasonable cost and time. Though various data analytic techniques exist in the context of big data, recommendation system is more popular in web-based business applications to suggest suitable products, services, and items to potential customers. In this paper, we put forth a big data recommendation engine framework based on local pattern analytics strategy to explore user preferences and taste for both branch level and central level decisions. The framework encourages the practice of moving computing environment towards the data source location and avoids forceful integration of data. Further it assists decision makers to reap hidden preferences and taste of users from branch data sources for an effective customer campaign. The novelty of the framework has been evaluated in the benchmark dataset, MovieLens100k and results clearly confirm the advantages of the proposal.

[1]  Rengaramanujam Srinivasan,et al.  Multi-Level Synthesis of Frequent Rules from Different Data-Sources , 2010 .

[2]  Jinjun Chen,et al.  KASR: A Keyword-Aware Service Recommendation Method on MapReduce for Big Data Applications , 2014, IEEE Transactions on Parallel and Distributed Systems.

[3]  Chunming Rong,et al.  Fast algorithms to evaluate collaborative filtering recommender systems , 2016, Knowl. Based Syst..

[4]  Witold Pedrycz,et al.  Study of select items in different data sources by grouping , 2010, Knowledge and Information Systems.

[5]  Zhiwei Gao,et al.  Gene-based Collaborative Filtering using recommender system , 2017, Comput. Electr. Eng..

[6]  Ramzi A. Haraty,et al.  Avoiding Traffic Analysis and Assuring Data Integrity using a Quorum-Based Approach , 2014, Int. Arab J. Inf. Technol..

[7]  Young U. Ryu,et al.  Collaborative filtering with facial expressions for online video recommendation , 2016, Int. J. Inf. Manag..

[8]  Shanmugasundaram Hariharan,et al.  Synthesizing Global Negative Association Rules in Multi-Database Mining , 2014 .

[9]  T. Ramkumar,et al.  An intelligent web search framework for performing efficient retrieval of data , 2016, Comput. Electr. Eng..

[10]  Parham Moradi,et al.  TCARS: Time- and Community-Aware Recommendation System , 2018, Future Gener. Comput. Syst..

[11]  F. O. Isinkaye,et al.  Recommendation systems: Principles, methods and evaluation , 2015 .

[12]  P Pawan,et al.  Data Mining with Big Data Using HACE Theorem , 2015 .

[13]  Hélio Lopes,et al.  Cloud based real-time collaborative filtering for item-item recommendations , 2014, Comput. Ind..

[14]  Ramkumar Thirunavukarasu,et al.  Implications of big data analytics in developing healthcare frameworks - A review , 2017, J. King Saud Univ. Comput. Inf. Sci..

[15]  Xindong Wu,et al.  Multi-Database Mining , 2003, IEEE Intell. Informatics Bull..

[16]  Athanasios V. Vasilakos,et al.  Machine learning on big data: Opportunities and challenges , 2017, Neurocomputing.

[17]  Animesh Adhikari,et al.  Synthesizing heavy association rules from different real data sources , 2008, Pattern Recognit. Lett..

[18]  Arlo Faria,et al.  MapReduce : Distributed Computing for Machine Learning , 2006 .

[19]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[20]  Chengqi Zhang,et al.  Identifying Global Exceptional Patterns in Multi-database Mining , 2004, IEEE Intell. Informatics Bull..

[21]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[22]  Animesh Adhikari,et al.  Clustering local frequency items in multiple databases , 2013, Inf. Sci..

[23]  Christoforos E. Kozyrakis,et al.  Evaluating MapReduce for Multi-core and Multiprocessor Systems , 2007, 2007 IEEE 13th International Symposium on High Performance Computer Architecture.

[24]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[25]  Francesco Ricci,et al.  A survey of active learning in collaborative filtering recommender systems , 2016, Comput. Sci. Rev..

[26]  Chun Chen,et al.  Improving Collaborative Recommendation via User-Item Subgroups , 2016, IEEE Transactions on Knowledge and Data Engineering.

[27]  Jhimli Adhikari,et al.  Clustering items in different data sources induced by stability , 2009, Int. Arab J. Inf. Technol..

[28]  R. Nedunchezhian,et al.  Post Mining- Discovering Valid Rules from Different Sized Data Sources , 2007 .

[29]  Athanasios V. Vasilakos,et al.  Big data analytics: a survey , 2015, Journal of Big Data.

[30]  Rengaramanujam Srinivasan,et al.  Modified algorithms for synthesizing high-frequency rules from different data sources , 2008, Knowledge and Information Systems.

[31]  Xindong Wu,et al.  Synthesizing High-Frequency Rules from Different Data Sources , 2003, IEEE Trans. Knowl. Data Eng..

[32]  Chris H. Q. Ding,et al.  Parallelization with Multiplicative Algorithms for Big Data Mining , 2012, 2012 IEEE 12th International Conference on Data Mining.

[33]  Shanmugasundaram Hariharan,et al.  A survey on mining multiple data sources , 2013, WIREs Data Mining Knowl. Discov..

[34]  Yang Sok Kim,et al.  Recommendation system development for fashion retail e-commerce , 2018, Electron. Commer. Res. Appl..

[35]  Shanmugasundaram Hariharan,et al.  Synthesizing Global Association Rules from Different Data Sources Based on Desired Interestingness Metrics , 2014, Int. J. Inf. Technol. Decis. Mak..

[36]  Shichao Zhang,et al.  Mining Multiple Data Sources: Local Pattern Analysis , 2006, Data Mining and Knowledge Discovery.

[37]  Xindong Wu,et al.  Rule Synthesizing from Multiple Related Databases , 2010, PAKDD.

[38]  Kristof Coussement,et al.  A framework for configuring collaborative filtering-based recommendations derived from purchase data , 2018, Eur. J. Oper. Res..

[39]  Saman Haratizadeh,et al.  Reliable graph-based collaborative ranking , 2018, Inf. Sci..

[40]  Xindong Wu,et al.  Mining globally interesting patterns from multiple databases using kernel estimation , 2009, Expert Syst. Appl..