User-Centered Study on Quality of Mobile Video Services

Mobile video, as an emerging market and a promising research field, has attracted much attention from both industry and researchers. Considering the quality of user-experience as the crux of mobile video services, this chapter aims to provide a guide to user-centered studies of mobile video quality. This will benefit future research in better understanding user needs and experiences, designing effective research, and providing solid solutions to improve the quality of mobile video. This chapter is organized in three main parts: (1) a review of recent user studies from the perspectives of research focuses, user study methods, and data analysis methods; (2) an example of conducting a user study of mobile video research, together with the discussion on a series of relative issues, such as participants, materials and devices, study procedure, and analysis results, and; (3) a conclusion with an open discussion about challenges and opportunities in mobile video related research, and associated potential future improvements.

[1]  Antonio Liotta,et al.  The Value of Relative Quality in Video Delivery , 2011, J. Mobile Multimedia.

[2]  H. O Knoche,et al.  Breaking the news on mobile TV: user requirements of a popular mobile content , 2006, Electronic Imaging.

[3]  Luc Martens,et al.  Performing QoE-measurements in an actual 3G network , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[4]  Manfred Tscheligi,et al.  User Experience Evaluation in the Mobile Context , 2010, Mobile TV: Customizing Content and Experience.

[5]  Raimund Schatz,et al.  Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services , 2011, 2011 IEEE International Conference on Communications (ICC).

[6]  Leena Eronen,et al.  Five qualitative research methods to make iTV applications universally accessible , 2006, Universal Access in the Information Society.

[7]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.

[8]  Göte Nyman,et al.  Experienced quality factors: qualitative evaluation approach to audiovisual quality , 2007, Electronic Imaging.

[9]  R. Schatz,et al.  Social interaction features for mobile TV services , 2008, 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[10]  Hendrik Knoche,et al.  Design requirements for mobile TV , 2005, Mobile HCI.

[11]  M. Angela Sasse,et al.  How low can you go? The effect of low resolutions on shot types in mobile TV , 2006, Multimedia Tools and Applications.

[12]  Miska M. Hannuksela,et al.  Acceptance Threshold: A Bidimensional Research Method for User-Oriented Quality Evaluation Studies , 2008, Int. J. Digit. Multim. Broadcast..

[13]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[14]  Taro Sugahara,et al.  Relax or Study?: A Qualitative User Study on the Usage of Mobile TV and Video , 2008, EuroITV.

[15]  M. Angela Sasse,et al.  The sweet spot: how people trade off size and definition on mobile devices , 2008, ACM Multimedia.

[16]  M. Angela Sasse,et al.  Sharp or smooth?: comparing the effects of quantization vs. frame rate for streamed video , 2004, CHI '04.

[17]  Antonio Liotta,et al.  User Centric Assessment of Mobile Contents Delivery , 2006, MoMM.

[18]  Wei Song,et al.  A survey on usage of mobile video in Australia , 2010, OZCHI '10.

[19]  Kenton O'Hara,et al.  Everyday practices with mobile video telephony , 2006, CHI.

[20]  Wei Song,et al.  Quality delivery of mobile video: in-depth understanding of user requirements , 2011, OZCHI.

[21]  Max Mühlhäuser,et al.  Toward more efficient user interfaces for mobile video browsing: an in-depth exploration of the design space , 2010, ACM Multimedia.

[22]  Miska M. Hannuksela,et al.  Does context matter in quality evaluation of mobile television? , 2008, Mobile HCI.

[23]  M. Angela Sasse,et al.  Can small be beautiful?: assessing image resolution requirements for mobile TV , 2005, MULTIMEDIA '05.

[24]  Antonio Liotta,et al.  Adaptive psychometric scaling for video quality assessment , 2012, Signal Process. Image Commun..

[25]  Jan Schilling.  On the Pragmatics of Qualitative Assessment , 2006 .

[26]  T. Tominaga,et al.  Performance comparisons of subjective quality assessment methods for mobile video , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[27]  Kenton O'Hara,et al.  Consuming video on mobile devices , 2007, CHI.

[28]  Helmut Hlavacs,et al.  A comprehensive view on user studies: survey and open issues for mobile TV , 2009, EuroITV '09.

[29]  Satu Jumisko-Pyykkö,et al.  Descriptive quality of experience for mobile 3D video , 2010, NordiCHI.

[30]  Jo Pierson,et al.  Does Mobile Television Challenge the Dimension of Viewing Television? An Explorative Research on Time, Place and Social Context of the Use of Mobile Television Content , 2008, EuroITV.

[31]  M. Rupp,et al.  On the Willingness to Pay in Relation to Delivered Quality of Mobile Video Streaming , 2008, 2008 Digest of Technical Papers - International Conference on Consumer Electronics.

[32]  Shuji Tasaka,et al.  The effectiveness of a QoE-based video output scheme for audio-video ip transmission , 2008, ACM Multimedia.

[33]  Christer Carlsson,et al.  Mobile TV - To Live or Die by Content , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[34]  Helmut Hlavacs,et al.  A survey on user studies and technical aspects of mobile multimedia applications , 2011, Entertain. Comput..

[35]  H. Hlavacs,et al.  Acceptance of mobile TV channel switching delays , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[36]  Wei Song,et al.  Exploration and Optimization of User Experience in Viewing Videos on a Mobile Phone , 2010, Int. J. Softw. Eng. Knowl. Eng..

[37]  Antonio Liotta,et al.  Quality of experience management in mobile content delivery systems , 2009, Telecommun. Syst..

[38]  Antonio Liotta,et al.  Addressing user expectations in mobile content delivery , 2007, Mob. Inf. Syst..

[39]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[40]  Wei Song,et al.  Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality? , 2011, MM '11.

[41]  Satu Jumisko-Pyykkö,et al.  Evaluation of subjective video quality of mobile devices , 2005, MULTIMEDIA '05.

[42]  Shani Orgad.  This box was made for walking: how will mobile television transform viewers' experience and change advertising? , 2006 .

[43]  Luc Martens,et al.  Proposed Framework for Evaluating Quality of Experience in a Mobile, Testbed-oriented Living Lab Setting , 2010, Mob. Networks Appl..