One-to-Many Negotiation QoE Management Mechanism for End-User Satisfaction

Quality of Experience (QoE) is defined as the measure of end-user satisfaction with the service. Most of the existing works addressing QoE-management rely on a binary vision of end-user satisfaction. This vision has been criticized by the growing empirical evidence showing that QoE is rather a degree. This article aims to go beyond the binary vision and propose a QoE management mechanism. We propose a one-to-many negotiation mechanism allowing the provider to undertake satisfaction management: to meet fine-grained user QoE goals, while still minimizing the costs. This problem is formulated as an optimization problem, for which a linear model is proposed. For reference, a generic linear program solver is used to find the optimal solution, and an alternative heuristic algorithm is devised to improve the responsiveness when the system has to scale up with a fast-growing number of users. Both are implemented and experimentally evaluated against state-of-the-art one-to-many negotiation frameworks.

[1]  Takayuki Ito,et al.  Novel Insights in Agent-based Complex Automated Negotiation , 2014, Novel Insights in Agent-based Complex Automated Negotiation.

[2]  Gauthier Picard,et al.  AQUAMan: An Adaptive QoE-Aware Negotiation Mechanism for SaaS Elasticity Management , 2017, AAMAS.

[3]  Ryszard Kowalczyk,et al.  Establishing composite SLAs through concurrent QoS negotiation with surplus redistribution , 2012, Concurr. Comput. Pract. Exp..

[4]  Gauthier Picard,et al.  AQUAMan: QoE-driven cost-aware mechanism for SaaS acceptability rate adaptation , 2017, WI.

[5]  Nicholas R. Jennings,et al.  Coordinating multiple concurrent negotiations , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[6]  Bo An,et al.  Automated negotiation with decommitment for dynamic resource allocation in cloud computing , 2010, AAMAS.

[7]  Tobias Hoßfeld,et al.  SOS: The MOS is not enough! , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[8]  Mohamed Shaheen Elgamel,et al.  Agent-Based Cloud Computing: A Survey , 2016, 2016 IEEE 4th International Conference on Future Internet of Things and Cloud (FiCloud).

[9]  Muhammad Younas,et al.  Analysis and Representation of QoS Attributes in Cloud Service Selection , 2018, 2018 IEEE 32nd International Conference on Advanced Information Networking and Applications (AINA).

[10]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[11]  Khalid Mansour,et al.  A Hybrid Concession Mechanism for Negotiating Software Agents in Competitive Environments , 2020, Int. J. Artif. Intell. Tools.

[12]  Stéphane Galland,et al.  Organizational and Holonic Modelling of a Simulated and Synthetic Spatial Environment , 2014, E4MAS.

[13]  Khalid Mansour,et al.  A Meta-Strategy for Coordinating of One-to-Many Negotiation over Multiple Issues , 2011 .

[14]  Matthias Hirth,et al.  In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE? , 2020, Quality and User Experience.

[15]  Christophe Gravier,et al.  Multi-agent Systems for Personalized QoE-Management , 2016, 2016 28th International Teletraffic Congress (ITC 28).

[16]  Tobias Hoßfeld,et al.  Don't Stop the Music: Crowdsourced QoE Assessment of Music Streaming with Stalling , 2020, 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX).

[17]  Christophe Nicolle,et al.  Agent-based simulation of unmanned aerial vehicles in civilian applications: A systematic literature review and research directions , 2019, Future Gener. Comput. Syst..

[18]  Rafidah Md Noor,et al.  A Generic Quantitative Relationship to Assess Interdependency of QoE and QoS , 2013, KSII Trans. Internet Inf. Syst..

[19]  Koen V. Hindriks,et al.  The Benefits of Opponent Models in Negotiation , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[20]  Pinar Yolum,et al.  Learning opponent’s preferences for effective negotiation: an approach based on concept learning , 2010, Autonomous Agents and Multi-Agent Systems.

[21]  Kurosh Madani,et al.  An adaptive approach for decision making tactics in automated negotiation , 2013, Applied Intelligence.

[22]  Monica M. C. Schraefel,et al.  An Automated Negotiation Agent for Permission Management , 2017, AAMAS.

[23]  Peter Reichl,et al.  The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment , 2010, 2010 IEEE International Conference on Communications.

[24]  Sandip Sen,et al.  Modeling opponent decision in repeated one-shot negotiations , 2005, AAMAS '05.

[25]  Stéphane Galland,et al.  Holonic Multi-Agent Systems , 2011, Self-organising Software.

[26]  Amir Masoud Rahmani,et al.  Automated negotiation for ensuring composite service requirements in cloud computing , 2019, J. Syst. Archit..

[27]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[28]  Ho-fung Leung,et al.  ABiNeS: An Adaptive Bilateral Negotiating Strategy over Multiple Items , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[29]  Raimund Schatz,et al.  Evaluating the impact of expectations on end-user quality perception , 2017 .

[30]  Sebastian Möller,et al.  QoE beyond the MOS: an in-depth look at QoE via better metrics and their relation to MOS , 2016, Quality and User Experience.

[31]  Gerhard Weiss,et al.  OMAC: A Discrete Wavelet Transformation Based Negotiation Agent , 2014, Novel Insights in Agent-based Complex Automated Negotiation.

[32]  Markus Fiedler,et al.  QoE-Based Network and Application Management , 2014, Quality of Experience.

[33]  Tobias Hoßfeld,et al.  From Packets to People: Quality of Experience as a New Measurement Challenge , 2013, Data Traffic Monitoring and Analysis.

[34]  Michael Seufert,et al.  White Paper on Crowdsourced Network and QoE Measurements - Definitions, Use Cases and Challenges , 2020, ArXiv.

[35]  Koen V. Hindriks,et al.  Learning about the opponent in automated bilateral negotiation: a comprehensive survey of opponent modeling techniques , 2016, Autonomous Agents and Multi-Agent Systems.

[36]  Kwang Mong Sim,et al.  A Price- and-Time-Slot-Negotiation Mechanism for Cloud Service Reservations , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Niels van Galen Last.  Agent Smith: Opponent Model Estimation in Bilateral Multi-issue Negotiation , 2012, New Trends in Agent-Based Complex Automated Negotiations.

[38]  Klaus Fischer,et al.  Holonic transport scheduling with teletruck , 2000, Appl. Artif. Intell..

[39]  Sarit Kraus,et al.  Facing the challenge of human-agent negotiations via effective general opponent modeling , 2009, AAMAS.

[40]  Mohammad Kazem Akbari,et al.  Impact of service quality on user satisfaction: Modeling and estimating distribution of quality of experience using Bayesian data analysis , 2016, Electron. Commer. Res. Appl..

[41]  Alexander Raake,et al.  Quality of Experience: Advanced Concepts, Applications and Methods , 2014 .

[42]  Stéphane Galland,et al.  Comparison of Agent-based Simulation Frameworks for Unmanned Aerial Transportation Applications , 2018, ANT/SEIT.

[43]  Lea Skorin-Kapov,et al.  The Interplay between QoE, User Behavior and System Blocking in QoE Management , 2019, 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN).

[44]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[45]  Minjie Zhang,et al.  An Adaptive Bilateral Negotiation Model Based on Bayesian Learning , 2013, Complex Automated Negotiations.

[46]  Christophe Gravier,et al.  Modeling User Expectations & Satisfaction for SaaS Applications Using Multi-agent Negotiation , 2016, 2016 IEEE/WIC/ACM International Conference on Web Intelligence (WI).

[47]  Thar Baker,et al.  ControCity: An Autonomous Approach for Controlling Elasticity Using Buffer Management in Cloud Computing Environment , 2019, IEEE Access.

[48]  Nicola Paoletti,et al.  A Deep Reinforcement Learning Approach to Concurrent Bilateral Negotiation , 2020, IJCAI.

[49]  Koen V. Hindriks,et al.  A Tit for Tat Negotiation Strategy for Real-Time Bilateral Negotiations , 2013, Complex Automated Negotiations.

[50]  Peter Reichl,et al.  “Time is bandwidth”? Narrowing the gap between subjective time perception and Quality of Experience , 2012, 2012 IEEE International Conference on Communications (ICC).

[51]  A. Parasuraman,et al.  The nature and determinants of customer expectations of service , 1993 .

[52]  Kostas Stathis,et al.  Concurrent bilateral negotiation for open e-markets: the Conan strategy , 2017, Knowledge and Information Systems.

[53]  Khalid Mansour,et al.  On Dynamic Negotiation Strategy for Concurrent Negotiation over Distinct Objects , 2014, Novel Insights in Agent-based Complex Automated Negotiation.