With the popularity of cloud computing services and the endorsement from the video game industry, cloud gaming services have emerged promisingly. In a cloud gaming service, the contents of games can be delivered to the clients through either video streaming or file streaming. Due to the strict constraint on the end-to-end latency for real-time interaction in a game, there are still challenges in designing a successful cloud gaming system, which needs to deliver satisfying quality of experience to the customers. In this paper, the methodology for subjective and objective evaluation as well as the analysis of cloud gaming services was developed. The methodology is based on a nonintrusive approach, and therefore, it can be used on different kinds of cloud gaming systems. There are challenges in such objective measurements of important QoS factors, due to the fact that most of the commercial cloud gaming systems are proprietary and closed. In addition, satisfactory QoE is one of the crucial ingredients in the success of cloud gaming services. By combining subjective and objective evaluation results, cloud gaming system developers can infer possible results of QoE levels based on the measured QoS factors. It can also be used in an expert system for choosing the list of games that customers can appreciate at a given environment, as well as for deciding the upper bound of the number of users in a system.
[1]
Tobias Hoßfeld,et al.
An Evaluation of QoE in Cloud Gaming Based on Subjective Tests
,
2011,
2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.
[2]
José Alberto Hernández,et al.
An empirical study of Cloud Gaming
,
2012,
2012 11th Annual Workshop on Network and Systems Support for Games (NetGames).
[3]
Ryan Shea,et al.
Cloud gaming: architecture and performance
,
2013,
IEEE Network.
[4]
Jason Nieh,et al.
Measuring thin-client performance using slow-motion benchmarking
,
2001,
TOCS.
[5]
Cheng-Hsin Hsu,et al.
GamingAnywhere: an open cloud gaming system
,
2013,
MMSys.
[6]
Chris Rose,et al.
A Break in the Clouds: Towards a Cloud Definition
,
2011
.
[7]
Cheng-Hsin Hsu,et al.
On the Quality of Service of Cloud Gaming Systems
,
2014,
IEEE Transactions on Multimedia.
[8]
Victor A. Clincy,et al.
Subjective Evaluation of Latency and Packet Loss in a Cloud-Based Game
,
2013,
2013 10th International Conference on Information Technology: New Generations.