Evaluating Reputation of Web Services under Rating Scarcity

With the proliferation of Web services, more and more functionally equivalent services are being published by service providers on the Web. Although more services mean more flexibility for consumers, it also increases the burden of choosing as consumers may have little or no past experience with the service they will interact with. Therefore, reputation systems have been proposed and are playing a crucial role in the service-oriented environment. Current reputation systems are mainly built upon the explicit feedback or rating given by consumers after experiencing the service. Unfortunately, services at the cold-start stage, prior to being rated, face the rating scarcity problem. In this paper, we focus on this problem and address it through a novel reputation model that uses the Elo algorithm to consider consumer-implicit information in a graph analysis approach. A theoretical analysis is conducted to identify the sufficient and necessary condition for the model to converge to a stable state. Furthermore, experiments confirm our model outperforms the widely adopted reputation algorithm in both accuracy and convergence in the situation of rating scarcity.

[1]  Audun Jøsang,et al.  Advanced Features in Bayesian Reputation Systems , 2009, TrustBus.

[2]  M. Glickman The Glicko system , 2011 .

[3]  Nathaniel Good,et al.  Naïve filterbots for robust cold-start recommendations , 2006, KDD '06.

[4]  Ofer Arazy,et al.  Improving Social Recommender Systems , 2009, IT Professional.

[5]  Xin Zhou,et al.  Dynamic Sliding Window Model for Service Reputation , 2015, 2015 IEEE International Conference on Services Computing.

[6]  A. Elo The rating of chessplayers, past and present , 1978 .

[7]  Toru Ishida The Language Grid - Service-Oriented Collective Intelligence for Language Resource Interoperability , 2011, The Language Grid.

[8]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[9]  Qiang He,et al.  QoS-Aware Service Recommendation for Multi-tenant SaaS on the Cloud , 2015, 2015 IEEE International Conference on Services Computing.

[10]  Paul A. Pavlou,et al.  Overcoming the J-shaped distribution of product reviews , 2009, CACM.

[11]  Xin Zhou,et al.  Towards Robust Reputation System Based on Clustering Approach , 2015, 2015 IEEE International Conference on Services Computing.

[12]  Luís M. B. Cabral,et al.  The Dynamics of Seller Reputation: Evidence from Ebay , 2006 .

[13]  Ling Liu,et al.  RLM: A General Model for Trust Representation and Aggregation , 2012, IEEE Transactions on Services Computing.

[14]  Munindar P. Singh,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence Macau: A Basis for Evaluating Reputation Systems , 2022 .

[15]  Ramón Hermoso,et al.  From blurry numbers to clear preferences: A mechanism to extract reputation in social networks , 2014, Expert Syst. Appl..

[16]  Qiangfu Zhao,et al.  IEEE Ninth International Conference on Computer and Information Technology , 2009 .

[17]  Toru Ishida,et al.  User-Centered QoS Computation for Web Service Selection , 2012, 2012 IEEE 19th International Conference on Web Services.

[18]  Luca de Alfaro,et al.  WorkerRank: Using Employer Implicit Judgements to Infer Worker Reputation , 2015, WSDM.

[19]  Toru Ishida,et al.  Dynamic Service Selection Based on Context-Aware QoS , 2012, 2012 IEEE Ninth International Conference on Services Computing.

[20]  Eyhab Al-Masri,et al.  QoS-based Discovery and Ranking of Web Services , 2007, 2007 16th International Conference on Computer Communications and Networks.

[21]  Thomas Risse,et al.  Combining global optimization with local selection for efficient QoS-aware service composition , 2009, WWW '09.

[22]  Athman Bouguettaya,et al.  Web Services Reputation Assessment Using a Hidden Markov Model , 2009, ICSOC/ServiceWave.

[23]  Jaswinder Pal Singh,et al.  Computing and using reputations for internet ratings , 2001, EC '01.

[24]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.