On Addressing the Low Rating Prediction Coverage in Sparse Datasets Using Virtual Ratings

Collaborative filtering-based recommendation systems consider users’ likings and interests, articulated as ratings within a database to offer personalized recommendations. Unfortunately, many collaborative filtering datasets exhibit the “grey sheep” phenomenon, a state where no near neighbours can be found for certain users. This phenomenon is extremely frequent in datasets where users, on average, have rated only a small percentage of the available items, which are termed as sparse datasets. This paper addresses the “grey sheep” problem by proposing the virtual ratings concept and introduces an algorithm for virtual rating creation on the basis of actual ratings. The novelty behind this concept is that the introduction of the virtual ratings effectively reduces the user–item rating matrix sparsity, thus alleviating the aforementioned problem. The proposed algorithm, which is termed as CFVR, has been extensively evaluated and the results show that it achieves to considerably improve the capability of a collaborative filtering system to formulate tailored recommendations for each user, when operating on sparse datasets, while at the same time improves rating prediction quality.

[1]  David Carmel,et al.  Social recommender systems , 2011, Recommender Systems Handbook.

[2]  Neil J. Hurley,et al.  Detecting noise in recommender system databases , 2006, IUI '06.

[3]  Dietmar Jannach,et al.  Comparing Recommendation Strategies in a Commercial Context , 2007, IEEE Intelligent Systems.

[4]  Manoj Kumar Tiwari,et al.  A noise correction-based approach to support a recommender system in a highly sparse rating environment , 2019, Decis. Support Syst..

[5]  Hossein Tahmasebi,et al.  Social movie recommender system based on deep autoencoder network using Twitter data , 2020, Neural Computing and Applications.

[6]  Mohammad Reza Moosavi,et al.  A Memory-Based Collaborative Filtering Recommender System Using Social Ties , 2019, 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA).

[7]  Sotiris Ioannidis,et al.  A fine-grained social network recommender system , 2019, Social Network Analysis and Mining.

[8]  Mehrbakhsh Nilashi,et al.  Collaborative filtering recommender systems , 2013 .

[9]  Lina Yao,et al.  AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders , 2017, SIGIR.

[10]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[11]  Bogdan Walek,et al.  A hybrid recommender system for recommending relevant movies using an expert system , 2020, Expert Syst. Appl..

[12]  Bo Yang,et al.  Coupled Low Rank Approximation for Collaborative Filtering in Social Networks , 2018, IEEE Access.

[13]  Cong Liu,et al.  Matrix Factorization Meets Cosine Similarity: Addressing Sparsity Problem in Collaborative Filtering Recommender System , 2014, APWeb.

[14]  Matthias Jarke,et al.  A Clustering Approach for Collaborative Filtering Recommendation Using Social Network Analysis , 2011, J. Univers. Comput. Sci..

[15]  Costas Vassilakis,et al.  Improving Collaborative Filtering’s Rating Prediction Coverage in Sparse Datasets through the Introduction of Virtual Near Neighbors , 2019, 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA).

[16]  Jianshan Sun,et al.  Leveraging friend and group information to improve social recommender system , 2020, Electron. Commer. Res..

[17]  Ido Guy,et al.  Social Recommender Systems , 2015, Recommender Systems Handbook.

[18]  Dionisis Margaris,et al.  Improving collaborative filtering's rating prediction coverage in sparse datasets by exploiting the 'friend of a friend' concept , 2020 .

[19]  Andysah Putera Utama Siahaan,et al.  Prim and Floyd-Warshall Comparative Algorithms in Shortest Path Problem , 2018 .

[20]  Dionisis Margaris,et al.  Improving Collaborative Filtering's Rating Prediction Coverage in Sparse Datasets by Exploiting User Dissimilarity , 2018, 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[21]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[22]  Guangquan Zhang,et al.  Data-driven decision support under concept drift in streamed big data , 2019, Complex & Intelligent Systems.

[23]  Panagiotis Adamopoulos Beyond rating prediction accuracy: on new perspectives in recommender systems , 2013, RecSys.

[24]  Dionisis Margaris,et al.  Improving collaborative filtering's rating prediction quality in dense datasets, by pruning old ratings , 2017, 2017 IEEE Symposium on Computers and Communications (ISCC).

[25]  Soroush Ojagh,et al.  A location-based orientation-aware recommender system using IoT smart devices and Social Networks , 2020, Future Gener. Comput. Syst..

[26]  Chang-Tsun Li,et al.  Matrix Factorization With Rating Completion: An Enhanced SVD Model for Collaborative Filtering Recommender Systems , 2017, IEEE Access.

[27]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[28]  Naveen K. Chilamkurti,et al.  An ontology-driven personalized food recommendation in IoT-based healthcare system , 2018, The Journal of Supercomputing.

[29]  Min Cao,et al.  An Approach to Alleviate the Sparsity Problem of Hybrid Collaborative Filtering Based Recommendations: The Product-Attribute Perspective from User Reviews , 2019, Mobile Networks and Applications.

[30]  Tao Li,et al.  Collaborative Filtering with Topic and Social Latent Factors Incorporating Implicit Feedback , 2018, ACM Trans. Knowl. Discov. Data.

[31]  Dionisis Margaris,et al.  Enhancing User Rating Database Consistency Through Pruning , 2017, Trans. Large Scale Data Knowl. Centered Syst..

[32]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[33]  Jong-Seok Lee,et al.  Shilling Attack Detection - A New Approach for a Trustworthy Recommender System , 2012, INFORMS J. Comput..

[34]  Songjie Gong A Collaborative Filtering Recommendation Algorithm Based on User Clustering and Item Clustering , 2010, J. Softw..

[35]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[36]  Shih-Hsiang Huang,et al.  βPβP: A novel approach to filter out malicious rating profiles from recommender systems , 2013, Decis. Support Syst..

[37]  Konstantinos G. Margaritis,et al.  A Hybrid Approach for Improving Prediction Coverage of Collaborative Filtering , 2009, AIAI.

[38]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[39]  Joemon M. Jose,et al.  Handling data sparsity in collaborative filtering using emotion and semantic based features , 2011, SIGIR.

[40]  Florence Sèdes,et al.  Social collaborative service recommendation approach based on user's trust and domain-specific expertise , 2018, Future Gener. Comput. Syst..

[41]  Costas Vassilakis,et al.  An Adaptive Social Network-Aware Collaborative Filtering Algorithm for Improved Rating Prediction Accuracy , 2020, IEEE Access.

[42]  Luis Martínez-López,et al.  A fuzzy model for managing natural noise in recommender systems , 2016, Appl. Soft Comput..

[43]  Costas Vassilakis,et al.  Social Relations versus Near Neighbours: Reliable Recommenders in Limited Information Social Network Collaborative Filtering for Online Advertising , 2019, 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM).

[44]  Di Wu,et al.  Recommender system for mobile users , 2017, Multimedia Tools and Applications.

[45]  Isabelle Tellier,et al.  Reducing the Cold-Start Problem in Content Recommendation through Opinion Classification , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[46]  Dionisis Margaris,et al.  Handling uncertainty in social media textual information for improving venue recommendation formulation quality in social networks , 2019, Social Network Analysis and Mining.

[47]  Ville Ollikainen,et al.  A new similarity measure using Bhattacharyya coefficient for collaborative filtering in sparse data , 2015, Knowl. Based Syst..

[48]  Jure Leskovec,et al.  Inferring Networks of Substitutable and Complementary Products , 2015, KDD.

[49]  Luis Martínez-López,et al.  Correcting noisy ratings in collaborative recommender systems , 2015, Knowl. Based Syst..

[50]  William Eberle,et al.  An Approach For Concept Drift Detection in a Graph Stream Using Discriminative Subgraphs , 2020, ACM Trans. Knowl. Discov. Data.

[51]  Jianrui Chen,et al.  Collaborative filtering recommendation algorithm based on user correlation and evolutionary clustering , 2019, Complex & Intelligent Systems.

[52]  John Riedl,et al.  Collaborative Filtering Recommender Systems , 2011, Found. Trends Hum. Comput. Interact..

[53]  Costas Vassilakis,et al.  An Algorithm for Density Enrichment of Sparse Collaborative Filtering Datasets Using Robust Predictions as Derived Ratings , 2020, Algorithms.

[54]  Peng Wang,et al.  A Trust-Based Prediction Approach for Recommendation System , 2018, SERVICES.