Enhancing recommendation stability of collaborative filtering recommender system through bio-inspired clustering ensemble method

In recent years, internet technologies and its rapid growth have created a paradigm of digital services. In this new digital world, users suffer due to the information overload problem and the recommender systems are widely used as a decision support tool to address this issue. Though recommender systems are proven personalization tool available, the need for the improvement of its recommendation ability and efficiency is high. Among various recommendation generation mechanisms available, collaborative filtering-based approaches are widely utilized to produce similarity-based recommendations. To improve the recommendation generation process of collaborative filtering approaches, clustering techniques are incorporated for grouping users. Though many traditional clustering mechanisms are employed for the users clustering in the existing works, utilization of bio-inspired clustering techniques needs to be explored for the generation of optimal recommendations. This article presents a new bio-inspired clustering ensemble through aggregating swarm intelligence and fuzzy clustering models for user-based collaborative filtering. The presented recommendation approaches have been evaluated on the real-world large-scale datasets of Yelp and TripAdvisor for recommendation accuracy and stability through standard evaluation metrics. The obtained results illustrate the advantageous performance of the proposed approach over its peer works of recent times.

[1]  Liang Zhao,et al.  Time series clustering via community detection in networks , 2015, Inf. Sci..

[2]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[3]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[4]  MengChu Zhou,et al.  A weight-incorporated similarity-based clustering ensemble method based on swarm intelligence , 2016, Knowl. Based Syst..

[5]  B. K. Tripathy,et al.  A generic hybrid recommender system based on neural networks , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[6]  Anthony F. Norcio,et al.  Representation, similarity measures and aggregation methods using fuzzy sets for content-based recommender systems , 2009, Fuzzy Sets Syst..

[7]  Logesh Ravi,et al.  Data mining‐based tag recommendation system: an overview , 2015, WIREs Data Mining Knowl. Discov..

[8]  Xiuzhen Huang,et al.  K-Means Clustering Algorithms: Implementation and Comparison , 2007, Second International Multi-Symposiums on Computer and Computational Sciences (IMSCCS 2007).

[9]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[10]  Yanchun Liang,et al.  Optimal partition algorithm of the RBF neural network and its application to financial time series forecasting , 2005, Neural Computing & Applications.

[11]  Charu C. Aggarwal,et al.  An Introduction to Recommender Systems , 2016 .

[12]  William W. Cohen,et al.  Recommendation as Classification: Using Social and Content-Based Information in Recommendation , 1998, AAAI/IAAI.

[13]  Yunming Ye,et al.  TW-k-means: Automated two-level variable weighting clustering algorithm for multiview data , 2013, IEEE Transactions on Knowledge and Data Engineering.

[14]  José Francisco Martínez Trinidad,et al.  Mining patterns for clustering on numerical datasets using unsupervised decision trees , 2015, Knowl. Based Syst..

[15]  Zhenhua Wang,et al.  An improved collaborative movie recommendation system using computational intelligence , 2014, J. Vis. Lang. Comput..

[16]  Mohsen Ramezani,et al.  A pattern mining approach to enhance the accuracy of collaborative filtering in sparse data domains , 2014 .

[17]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[18]  Luís Paulo Reis,et al.  Using model-based collaborative filtering techniques to recommend the expected best strategy to defeat a simulated soccer opponent , 2014, Intell. Data Anal..

[19]  Dingcheng Li,et al.  Spectral co-clustering ensemble , 2015, Knowl. Based Syst..

[20]  Hyunbo Cho,et al.  User credit-based collaborative filtering , 2009, Expert Syst. Appl..

[21]  Yo-Sub Han,et al.  A movie recommendation algorithm based on genre correlations , 2012, Expert Syst. Appl..

[22]  Khalid Benabdeslem,et al.  Bi-clustering continuous data with self-organizing map , 2012, Neural Computing and Applications.

[23]  Zhengwu Zhang,et al.  Bayesian Clustering of Shapes of Curves , 2015, ArXiv.

[24]  Sebastián Ventura,et al.  Swarm‐based metaheuristics in automatic programming: a survey , 2014, Wiley Interdiscip. Rev. Data Min. Knowl. Discov..

[25]  Logesh Ravi,et al.  A Collaborative Location Based Travel Recommendation System through Enhanced Rating Prediction for the Group of Users , 2016, Comput. Intell. Neurosci..

[26]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[27]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[28]  Gillian Dobbie,et al.  Research on particle swarm optimization based clustering: A systematic review of literature and techniques , 2014, Swarm Evol. Comput..

[29]  Chih-Fong Tsai,et al.  Cluster ensembles in collaborative filtering recommendation , 2012, Appl. Soft Comput..

[30]  Sam Gabrielsson,et al.  The use of Self-Organizing Maps in Recommender Systems : A survey of the Recommender Systems field and a presentation of a State of the Art Highly Interactive Visual Movie Recommender System , 2006 .

[31]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[32]  Che Wun Chiou,et al.  A novel fuzzy c-means method for classifying heartbeat cases from ECG signals , 2010 .

[33]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Fernando Ortega,et al.  A collaborative filtering similarity measure based on singularities , 2012, Inf. Process. Manag..

[35]  Juha Leino,et al.  User Factors in Recommender Systems: Case Studies in e-Commerce, News Recommending, and e-Learning ; Käyttäjänäkökulmia suosittelujärjestelmiin: Tapaustutkimuksia e-kaupasta, uutisten suosittelusta ja e-oppimisesta , 2014 .

[36]  Hui-lan Luo,et al.  Combining Multiple Clusterings using Information Theory based Genetic Algorithm , 2006, 2006 International Conference on Computational Intelligence and Security.

[37]  William Nzoukou,et al.  A Survey Paper on Recommender Systems , 2010, ArXiv.

[38]  Carlotta Domeniconi,et al.  Weighted cluster ensembles: Methods and analysis , 2009, TKDD.

[39]  Xiong Xiong,et al.  An Improved Self-Adaptive PSO Algorithm with Detection Function for Multimodal Function Optimization Problems , 2013 .

[40]  Yehuda Koren,et al.  The BellKor Solution to the Netflix Grand Prize , 2009 .

[41]  Kourosh Kiani,et al.  User based Collaborative Filtering using fuzzy C-means , 2016 .

[42]  Juan M. Fernández-Luna,et al.  Top-N news recommendations in digital newspapers , 2012, Knowl. Based Syst..

[43]  Ujjwal Maulik,et al.  Ensemble based rough fuzzy clustering for categorical data , 2015, Knowl. Based Syst..

[44]  Logesh Ravi,et al.  A hybrid quantum-induced swarm intelligence clustering for the urban trip recommendation in smart city , 2017, Future Gener. Comput. Syst..

[45]  Junfeng Zhao,et al.  Personalized QoS Prediction forWeb Services via Collaborative Filtering , 2007, IEEE International Conference on Web Services (ICWS 2007).

[46]  Joydeep Ghosh,et al.  Data Clustering Algorithms And Applications , 2013 .

[47]  Jean Dezert,et al.  Credal c-means clustering method based on belief functions , 2015, Knowl. Based Syst..

[48]  Sung-Hyon Myaeng,et al.  A probabilistic music recommender considering user opinions and audio features , 2007, Inf. Process. Manag..

[49]  Gediminas Adomavicius,et al.  On the stability of recommendation algorithms , 2010, RecSys '10.

[50]  Rong Yang,et al.  Machine Learning and Data Mining in Pattern Recognition , 2012, Lecture Notes in Computer Science.

[51]  Li-min Liu,et al.  A Weighted Cluster Ensemble Algorithm Based on Graph , 2011, 2011IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications.

[52]  Farzad Eskandari,et al.  Calculating the required cash in bank branches: a Bayesian-data mining approach , 2017, Neural Computing and Applications.

[53]  Korris Fu-Lai Chung,et al.  Linear combination of densities and its direct estimation framework with applications , 2015, Neural Computing and Applications.

[54]  Mohammad Yahya H. Al-Shamri,et al.  Power coefficient as a similarity measure for memory-based collaborative recommender systems , 2014, Expert Syst. Appl..

[55]  Abdelhamid Bouchachia,et al.  Learning with partly labeled data , 2007, Neural Computing and Applications.

[56]  Chhavi Rana,et al.  An extended evolutionary clustering algorithm for an adaptive recommender system , 2014, Social Network Analysis and Mining.

[57]  Daniel Castro Silva,et al.  Improving a simulated soccer team's performance through a Memory-Based Collaborative Filtering approach , 2014, Appl. Soft Comput..

[58]  Tommy W. S. Chow,et al.  Tree2Vector: Learning a Vectorial Representation for Tree-Structured Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[59]  Tommy W. S. Chow,et al.  Organizing Books and Authors by Multilayer SOM , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[60]  Jesús Bobadilla,et al.  A new collaborative filtering metric that improves the behavior of recommender systems , 2010, Knowl. Based Syst..

[61]  Andries Petrus Engelbrecht,et al.  Data clustering using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[62]  Lu Lu,et al.  A tree-structured representation for book author and its recommendation using multilayer SOM , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[63]  Zhuoming Xu,et al.  A Hybrid Clustering Algorithm Based on Fuzzy c-Means and Improved Particle Swarm Optimization , 2014 .

[64]  Jae Kyeong Kim,et al.  A literature review and classification of recommender systems research , 2012, Expert Syst. Appl..

[65]  Abdulmotaleb El-Saddik,et al.  Collaborative error-reflected models for cold-start recommender systems , 2011, Decis. Support Syst..

[66]  Xuan Xiao,et al.  Similarity-based spectral clustering ensemble selection , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[67]  Tossapon Boongoen,et al.  A Link-Based Cluster Ensemble Approach for Categorical Data Clustering , 2012, IEEE Transactions on Knowledge and Data Engineering.

[68]  Rafael Valencia-García,et al.  Solving the cold-start problem in recommender systems with social tags , 2010, Expert Syst. Appl..

[69]  John Riedl,et al.  Recommender Systems for Large-scale E-Commerce : Scalable Neighborhood Formation Using Clustering , 2002 .

[70]  Jinguo Liu,et al.  An Interactive Astronaut-Robot System with Gesture Control , 2016, Comput. Intell. Neurosci..

[71]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[72]  José de Jesús Rubio,et al.  An stable online clustering fuzzy neural network for nonlinear system identification , 2009, Neural Computing and Applications.

[73]  Qidi Wu,et al.  Mussels Wandering Optimization: An Ecologically Inspired Algorithm for Global Optimization , 2012, Cognitive Computation.

[74]  Byeong Man Kim,et al.  Clustering approach for hybrid recommender system , 2003, Proceedings IEEE/WIC International Conference on Web Intelligence (WI 2003).

[75]  Cosimo Birtolo,et al.  Improving accuracy of recommendation system by means of Item-based Fuzzy Clustering Collaborative Filtering , 2011, 2011 11th International Conference on Intelligent Systems Design and Applications.

[76]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[77]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[78]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[79]  Shengrui Wang,et al.  Mining Projected Clusters in High-Dimensional Spaces , 2009, IEEE Transactions on Knowledge and Data Engineering.

[80]  Domonkos Tikk,et al.  Recommending new movies: even a few ratings are more valuable than metadata , 2009, RecSys '09.

[81]  Chang-Dong Wang,et al.  Combining multiple clusterings via crowd agreement estimation and multi-granularity link analysis , 2014, Neurocomputing.

[82]  Fernando Ortega,et al.  A framework for collaborative filtering recommender systems , 2011, Expert Syst. Appl..

[83]  Xinquan Chen,et al.  A new clustering algorithm based on near neighbor influence , 2014, Expert Syst. Appl..

[84]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[85]  Adriano Lorena Inácio de Oliveira,et al.  Hybrid methods for fuzzy clustering based on fuzzy c-means and improved particle swarm optimization , 2015, Expert Syst. Appl..

[86]  Lei Zhu,et al.  Unsupervised neighborhood component analysis for clustering , 2015, Neurocomputing.

[87]  Athena Vakali,et al.  Time-Aware Web Users' Clustering , 2008, IEEE Transactions on Knowledge and Data Engineering.

[88]  Ana L. N. Fred,et al.  Analysis of consensus partition in cluster ensemble , 2004, Fourth IEEE International Conference on Data Mining (ICDM'04).

[89]  Cong Liu,et al.  Matrix Factorization Meets Cosine Similarity: Addressing Sparsity Problem in Collaborative Filtering Recommender System , 2014, APWeb.

[90]  Dirk Van,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[91]  Jian Xiao,et al.  A novel chaotic particle swarm optimization based fuzzy clustering algorithm , 2012, Neurocomputing.

[92]  Shrideep Pallickara,et al.  On the performance of high dimensional data clustering and classification algorithms , 2013, Future Gener. Comput. Syst..

[93]  Daniel Barbará,et al.  Random Subspace Ensembles for Clustering Categorical Data , 2008 .

[94]  Ana L. N. Fred,et al.  Data clustering using evidence accumulation , 2002, Object recognition supported by user interaction for service robots.

[95]  Li-Chen Cheng,et al.  Applied Soft Computing , 2014 .

[96]  L OlmoJuan,et al.  Swarm-based metaheuristics in automatic programming , 2014 .

[97]  Rajesh Kumar,et al.  A boundary restricted adaptive particle swarm optimization for data clustering , 2013, Int. J. Mach. Learn. Cybern..

[98]  Jinfeng Han,et al.  The Clustering Algorithm Based on Particle Swarm Optimization Algorithm , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[99]  Marc Boullé,et al.  Comparing State-of-the-Art Collaborative Filtering Systems , 2007, MLDM.

[100]  Cosimo Birtolo,et al.  Advances in Clustering Collaborative Filtering by means of Fuzzy C-means and trust , 2013, Expert Syst. Appl..

[101]  Robert Jenssen Mean Vector Component Analysis for Visualization and Clustering of Nonnegative Data , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[102]  Witold Pedrycz,et al.  An interval weighed fuzzy c-means clustering by genetically guided alternating optimization , 2014, Expert Syst. Appl..

[103]  Sheng Zhong,et al.  Privacy preserving Back-propagation neural network learning over arbitrarily partitioned data , 2011, Neural Computing and Applications.

[104]  Huseyin Polat,et al.  A comparison of clustering-based privacy-preserving collaborative filtering schemes , 2013, Appl. Soft Comput..

[105]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[106]  Shashi Shekhar,et al.  Multilevel hypergraph partitioning: applications in VLSI domain , 1999, IEEE Trans. Very Large Scale Integr. Syst..

[107]  Weiling Cai A manifold learning framework for both clustering and classification , 2015, Knowl. Based Syst..

[108]  A. Ahmadyfard,et al.  Combining PSO and k-means to enhance data clustering , 2008, 2008 International Symposium on Telecommunications.

[109]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[110]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[111]  VairavasundaramSubramaniyaswamy,et al.  Data mining-based tag recommendation system , 2015 .

[112]  Ajith Abraham,et al.  Fuzzy C-means and fuzzy swarm for fuzzy clustering problem , 2011, Expert Syst. Appl..

[113]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[114]  Yongsheng Ding,et al.  Low-Rank Kernel Matrix Factorization for Large-Scale Evolutionary Clustering , 2012, IEEE Transactions on Knowledge and Data Engineering.

[115]  Joshua Zhexue Huang,et al.  Stratified feature sampling method for ensemble clustering of high dimensional data , 2015, Pattern Recognit..

[116]  Gediminas Adomavicius,et al.  Improving Stability of Recommender Systems: A Meta-Algorithmic Approach , 2015, IEEE Transactions on Knowledge and Data Engineering.

[117]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[118]  Joseph A. Konstan,et al.  Introduction to recommender systems , 2008, SIGMOD Conference.