Understanding User Experience of Mobile Video: Framework, Measurement, and Optimization

Since users have become the focus of product/service design in last decade, the term User eXperience (UX) has been frequently used in the field of Human-Computer-Interaction (HCI). Research on UX facilitates a better understanding of the various aspects of the user’s interaction with the product or service. Mobile video, as a new and promising service and research field, has attracted great attention. Due to the significance of UX in the success of mobile video (Jordan, 2002), many researchers have centered on this area, examining users’ expectations, motivations, requirements, and usage context. As a result, many influencing factors have been explored (Buchinger, Kriglstein, Brandt & Hlavacs, 2011; Buchinger, Kriglstein & Hlavacs, 2009). However, a general framework for specific mobile video service is lacking for structuring such a great number of factors. To measure user experience of multimedia services such as mobile video, quality of experience (QoE) has recently become a prominent concept. In contrast to the traditionally used concept quality of service (QoS), QoE not only involves objectively measuring the delivered service but also takes into account user’s needs and desires when using the service, emphasizing the user’s overall acceptability on the service. Many QoE metrics are able to estimate the user perceived quality or acceptability of mobile video, but may be not enough accurate for the overall UX prediction due to the complexity of UX. Only a few frameworks of QoE have addressed more aspects of UX for mobile multimedia applications but need be transformed into practical measures. The challenge of optimizing UX remains adaptations to the resource constrains (e.g., network conditions, mobile device capabilities, and heterogeneous usage contexts) as well as meeting complicated user requirements (e.g., usage purposes and personal preferences). In this chapter, we investigate the existing important UX frameworks, compare their similarities and discuss some important features that fit in the mobile video service. Based on the previous research, we propose a simple UX framework for mobile video application by mapping a variety of influencing factors of UX upon a typical mobile video delivery system. Each component and its factors are explored with comprehensive literature reviews. The proposed framework may benefit in user-centred design of mobile video through taking a complete consideration of UX influences and in improvement of mobile videoservice quality by adjusting the values of certain factors to produce a positive user experience. It may also facilitate relative research in the way of locating important issues to study, clarifying research scopes, and setting up proper study procedures. We then review a great deal of research on UX measurement, including QoE metrics and QoE frameworks of mobile multimedia. Finally, we discuss how to achieve an optimal quality of user experience by focusing on the issues of various aspects of UX of mobile video. In the conclusion, we suggest some open issues for future study.

[1]  Lauralee Alben,et al.  Quality of experience: defining the criteria for effective interaction design , 1996, INTR.

[2]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  P. Jordan Designing Pleasurable Products: An Introduction to the New Human Factors , 2000 .

[4]  H. R. Wu,et al.  Human visual system based objective digital video quality metrics , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[5]  Jodi Forlizzi,et al.  The building blocks of experience: an early framework for interaction designers , 2000, DIS '00.

[6]  Leena Eronen Combining Quantitative and Qualitative Data in User Research on Digital Television , 2001 .

[7]  Kun Tan,et al.  Content-sensitive video streaming over low bitrate and lossy wireless network , 2001, MULTIMEDIA '01.

[8]  Sheila S. Hemami,et al.  Perceived quality metrics for low bit rate compressed video , 2002, Proceedings. International Conference on Image Processing.

[9]  Mark Claypool,et al.  Improving Multimedia Streaming with Content-Aware Video Scaling , 2002, JCIS.

[10]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[11]  Bernd Girod,et al.  Advances in channel-adaptive video streaming , 2002, Proceedings. International Conference on Image Processing.

[12]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[13]  Caj Södergård,et al.  Mobile television - technology and user experiences: Report on the Mobile-TV project , 2003 .

[14]  Alan C. Bovik,et al.  41 OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[15]  Leena Arhippainen,et al.  Empirical Evaluation of User Experience in two Adaptive Mobile Application Prototypes , 2003 .

[16]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[17]  Shan Liu,et al.  Joint temporal-spatial rate control for adaptive video transcoding , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[18]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  R. Jain Quality of experience , 2004, IEEE MultiMedia.

[20]  Mobile users' needs and expectations of future multimedia services , 2004 .

[21]  M. Angela Sasse,et al.  Sharp or smooth?: comparing the effects of quantization vs. frame rate for streamed video , 2004, CHI '04.

[22]  Mark Claypool,et al.  Adaptive Video Streaming using Content-Aware Media Scaling , 2004 .

[23]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[24]  D. Norman Emotional design : why we love (or hate) everyday things , 2004 .

[25]  Sei-Wang Chen,et al.  A non-parametric blur measure based on edge analysis for image processing applications , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[26]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[27]  Liam Murphy,et al.  Content-Based Adaptation of Streamed Multimedia , 2004, MMNS.

[28]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[29]  Athanasios Leontaris,et al.  Comparison of blocking and blurring metrics for video compression , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[30]  Satu Jumisko-Pyykkö,et al.  Evaluation of subjective video quality of mobile devices , 2005, MULTIMEDIA '05.

[31]  M. Angela Sasse,et al.  Can small be beautiful?: assessing image resolution requirements for mobile TV , 2005, MULTIMEDIA '05.

[32]  Satu H. Jumisko,et al.  Effect of TV content in subjective assessment of video quality on mobile devices , 2005, IS&T/SPIE Electronic Imaging.

[33]  Jian Wang,et al.  Error-resilient region-of-interest video coding , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Qian Zhang,et al.  Proceedings of 2005 International Symposium on Intelligent Signal Processing and Communication Systems Video Delivery over Wireless Multi-hop Networks , 2022 .

[35]  Christof Faller,et al.  MAXIMIZING AUDIOVISUAL QUALITY AT LOW BITRATES , 2005 .

[36]  Yu Sun,et al.  Region-based rate control and bit allocation for wireless video transmission , 2006, IEEE Transactions on Multimedia.

[37]  O. Bradeanu,et al.  Mobile Multimedia End-User Quality of Experience Modeling , 2006, International Conference on Digital Telecommunications (ICDT'06).

[38]  Christer Carlsson,et al.  Nice Mobile Services do not Fly. Observations of Mobile Services and the Finnish Consumers , 2006, Bled eConference.

[39]  Wesley De Neve,et al.  A Real-Time Content Adaptation Framework for Exploiting ROI Scalability in H.264/AVC , 2006, ACIVS.

[40]  Wesley De Neve,et al.  A real-time content adaptation framework for exploiting ROI scalability in H.264/AVC , 2006 .

[41]  Ashraf M. A. Ahmad Content-Based Video Streaming Approaches and Challenges , 2006 .

[42]  H. Knoche,et al.  Quality in Context-an ecological approach to assessing QoS for mobile TV , 2006 .

[43]  Virpi Roto User Experience Building Blocks , 2006 .

[44]  Amy L. Parsons,et al.  Emotional Design: Why We Love (or Hate) Everyday Things , 2006 .

[45]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[46]  Changick Kim,et al.  A context-aware video display scheme for mobile devices , 2006, Electronic Imaging.

[47]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[48]  Virpi Roto,et al.  Web browsing on mobile phones : characteristics of user experience ; Internet-selailu kännykällä - käyttäjäkokemuksen piirteitä , 2009 .

[49]  M. Angela Sasse,et al.  The kindest cut: enhancing the user experience of mobile tv through adequate zooming , 2007, ACM Multimedia.

[50]  Christer Carlsson,et al.  Mobile TV - To Live or Die by Content , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[51]  Amitabh Kumar Chapter 1 – About Mobile TV , 2007 .

[52]  Mohammed Ghazal,et al.  A Real-Time Technique for Spatio–Temporal Video Noise Estimation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[53]  Göte Nyman,et al.  Experienced quality factors: qualitative evaluation approach to audiovisual quality , 2007, Electronic Imaging.

[54]  Qian Chen,et al.  Robust Region-of-Interest Scalable Coding with Leaky Prediction in H.264/AVC , 2007, 2007 IEEE Workshop on Signal Processing Systems.

[55]  Antonio Liotta,et al.  Addressing user expectations in mobile content delivery , 2007, Mob. Inf. Syst..

[56]  R. E. Kooij,et al.  Of MOS and men: bridging the gap between objective and subjective quality measurements in mobile TV , 2007, Electronic Imaging.

[57]  Liam Murphy,et al.  Dynamic content-based adaptation of streamed multimedia , 2007, J. Netw. Comput. Appl..

[58]  Zhengguo Li,et al.  Region-of-Interest Based Resource Allocation for Conversational Video Communication of H.264/AVC , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[59]  F.E. Prats,et al.  Delivery of H264 SVC/MDC streams over wimax and DVB-T networks , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[60]  Wolfgang Slany,et al.  User Interface Design for a Mobile Multimedia Application: An Iterative Approach , 2008, First International Conference on Advances in Computer-Human Interaction.

[61]  Suh-Yin Lee,et al.  Fast and robust object-extraction framework for object-based streaming system , 2008 .

[62]  Markus Rupp,et al.  Video Quality Estimation for Mobile H.264/AVC Video Streaming , 2008, J. Commun..

[63]  R. Schatz,et al.  Social interaction features for mobile TV services , 2008, 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[64]  Ashraf M. A. Ahmad Content and Resources based Mobile and Wireless Video Transcoding , 2008 .

[65]  Taro Sugahara,et al.  Relax or Study?: A Qualitative User Study on the Usage of Mobile TV and Video , 2008, EuroITV.

[66]  Jo Pierson,et al.  Does Mobile Television Challenge the Dimension of Viewing Television? An Explorative Research on Time, Place and Social Context of the Use of Mobile Television Content , 2008, EuroITV.

[67]  Baocai Yin,et al.  A novel rate control scheme with Region-of-Interest concern , 2008 .

[68]  David Taniar,et al.  Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia , 2008 .

[69]  Dominik Strohmeier,et al.  Designing for user experience: what to expect from mobile 3d tv and video? , 2008, UXTV '08.

[70]  Shuji Tasaka,et al.  The effectiveness of a QoE-based video output scheme for audio-video ip transmission , 2008, ACM Multimedia.

[71]  Shibao Zheng,et al.  A two-stage ρ-domain rate control scheme for H.264 encoder , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[72]  Hendrik Knoche,et al.  Getting the Big Picture on Small Screens: Quality of Experience in Mobile TV , 2008 .

[73]  K. Maclean Using Haptics for Mobile Information Display , 2008 .

[74]  Miska M. Hannuksela,et al.  Does context matter in quality evaluation of mobile television? , 2008, Mobile HCI.

[75]  Antonio Liotta,et al.  QoE-aware QoS management , 2008, MoMM.

[76]  Glen P. Abousleman,et al.  A no-reference perceptual image sharpness metric based on saliency-weighted foveal pooling , 2008, 2008 15th IEEE International Conference on Image Processing.

[77]  Gabriel-Miro Muntean,et al.  Region of Interest-Based Adaptive Multimedia Streaming Scheme , 2008, IEEE Transactions on Broadcasting.

[78]  Miska M. Hannuksela,et al.  Acceptance Threshold: A Bidimensional Research Method for User-Oriented Quality Evaluation Studies , 2008, Int. J. Digit. Multim. Broadcast..

[79]  Debin Zhao,et al.  A ROI quality adjustable rate control scheme for low bitrate video coding , 2009, 2009 Picture Coding Symposium.

[80]  Alexander Eichhorn,et al.  Pick Your Layers Wisely - A Quality Assessment of H.264 Scalable Video Coding for Mobile Devices , 2009, 2009 IEEE International Conference on Communications.

[81]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[82]  Jae-Won Suh,et al.  An Efficient MB Layer Rate Control for H.264/AVC Based on Adaptive QP Decision , 2009, PCM.

[83]  Antonio Liotta,et al.  Predicting quality of experience in multimedia streaming , 2009, MoMM.

[84]  Virpi Oksman,et al.  User acceptance of mobile TV services , 2009, Mobile HCI.

[85]  Antonio Liotta,et al.  Quality of experience management in mobile content delivery systems , 2009, Telecommun. Syst..

[86]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[87]  H. Hlavacs,et al.  Mobile TV coding , 2009, 2009 10th International Conference on Telecommunications.

[88]  Klaus-Peter Engelbrecht,et al.  A taxonomy of quality of service and Quality of Experience of multimodal human-machine interaction , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[89]  Klara Nahrstedt,et al.  Quality of experience in distributed interactive multimedia environments: toward a theoretical framework , 2009, ACM Multimedia.

[90]  Hans-Jürgen Zepernick,et al.  Optimal region-of-interest based visual quality assessment , 2009, Electronic Imaging.

[91]  Helmut Hlavacs,et al.  A comprehensive view on user studies: survey and open issues for mobile TV , 2009, EuroITV '09.

[92]  Oliver Hohlfeld,et al.  Impact of frame rate and resolution on objective QoE metrics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[93]  Max Mühlhäuser,et al.  Toward more efficient user interfaces for mobile video browsing: an in-depth exploration of the design space , 2010, ACM Multimedia.

[94]  T. Tominaga,et al.  Performance comparisons of subjective quality assessment methods for mobile video , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[95]  Christophe Charrier,et al.  A DCT Statistics-Based Blind Image Quality Index , 2010, IEEE Signal Processing Letters.

[96]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[97]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[98]  Manfred Tscheligi,et al.  User Experience Evaluation in the Mobile Context , 2010, Mobile TV: Customizing Content and Experience.

[99]  Wei Song,et al.  A survey on usage of mobile video in Australia , 2010, OZCHI '10.

[100]  Luc Martens,et al.  Performing QoE-measurements in an actual 3G network , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[101]  Yufu Jia,et al.  Content aware retargeting of soccer video , 2010, The 2nd International Conference on Information Science and Engineering.

[102]  Luc Martens,et al.  Proposed Framework for Evaluating Quality of Experience in a Mobile, Testbed-oriented Living Lab Setting , 2010, Mob. Networks Appl..

[103]  Wei Song,et al.  Exploration and Optimization of User Experience in Viewing Videos on a Mobile Phone , 2010, Int. J. Softw. Eng. Knowl. Eng..

[104]  Wei Song,et al.  Impact of zooming and enhancing region of interests for optimizing user experience on mobile sports video , 2010, ACM Multimedia.

[105]  Luc Martens,et al.  Linking an integrated framework with appropriate methods for measuring QoE , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[106]  Lingfen Sun,et al.  Quality of experience-driven adaptation scheme for video applications over wireless networks , 2010, IET Commun..

[107]  H. Hlavacs,et al.  Acceptance of mobile TV channel switching delays , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[108]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[109]  Yo-Sung Ho,et al.  Efficient entropy coding scheme for H.264/AVC lossless video coding , 2010, Signal Process. Image Commun..

[110]  Wei Song,et al.  User-Centered Video Quality Assessment for Scalable Video Coding of H.264/AVC Standard , 2010, MMM.

[111]  Sheila S. Hemami,et al.  No-reference image and video quality estimation: Applications and human-motivated design , 2010, Signal Process. Image Commun..

[112]  Jordi Ortiz Murillo,et al.  Towards User-driven Adaptation of H . 264 / SVC Streams , 2010 .

[113]  Wei Song,et al.  Saving bitrate vs. pleasing users: where is the break-even point in mobile video quality? , 2011, MM '11.

[114]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[115]  Raimund Schatz,et al.  Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services , 2011, 2011 IEEE International Conference on Communications (ICC).

[116]  Helmut Hlavacs,et al.  A survey on user studies and technical aspects of mobile multimedia applications , 2011, Entertain. Comput..