Investigating the Influence of Subtitles Synchronization in the Viewer's Quality of Experience

Watching a movie in which audio and video are out of sync is certainly an unpleasant experience, even with a big bucket of fresh popcorn. In a similar way, viewers can experience a negative experience when subtitles are not well synchronized with the media content. The point is that subtitles synchronization (or the lack thereof) plays a key role, positively or negatively, in the perception of quality that viewers have about the content. In this context, this work focuses on investigating how slightly more "relaxed" synchronization directives may affect significantly the perception of Quality of Experience (QoE) that users have when watching audiovisual content in English with subtitles in Brazilian Portuguese. Our observations are based on the analysis of data collected in an experiment with 24 users and the results suggest that subtitles beginning with delay have most influence in the viewers' QoE.

[1]  Elaine Alves Trindade.  A legendagem da televisão por assinatura do Brasil , 2012 .

[2]  Maria Cecília Calani Baranauskas,et al.  Exploring new formats of the Self-Assessment Manikin in the design with children , 2016, IHC.

[3]  Celso A. S. Santos,et al.  Investigating the Collaborative Process of Subtitles Creation and Sharing for Videos on the Web , 2017, WebMedia.

[4]  Tiago Maritan Ugulino de Araújo,et al.  Accessibility in Digital Cinema: A Proposal for Generation and Distribution of Audio Description , 2016, WebMedia.

[5]  Pablo César,et al.  Just-in-time personalized video presentations , 2012, DocEng '12.

[6]  Luiz Fernando Gomes Soares,et al.  A visual approach for modeling spatiotemporal relations , 2008, DocEng '08.

[7]  Jacob Cohen,et al.  The statistical power of abnormal-social psychological research: a review. , 1962, Journal of abnormal and social psychology.

[8]  Tiago Maritan Ugulino de Araújo,et al.  Incorporation of Syntactic-Semantic Aspects in a LIBRAS Machine Translation Service to Multimedia Platforms , 2015, WebMedia.

[9]  Vagner Figuerêdo de Santana,et al.  Unsupervised annotation of usability test videos , 2014, IHC.

[10]  Camila Loiola Brito Maia,et al.  A study about psychophysiological measures in user experience monitoring and evaluation , 2016, IHC.

[11]  Fons Kuijk,et al.  Adding dynamic visual manipulations to declarative multimedia documents , 2009, DocEng '09.

[12]  Tayana Conte,et al.  A Systematic Mapping Study on Research Contributions on UX Evaluation Technologies , 2017, IHC.

[13]  Duncan P. Brumby,et al.  Watching movies on netflix: investigating the effect of screen size on viewer immersion , 2016, MobileHCI Adjunct.

[14]  Jörg Tiedemann.  Synchronizing Translated Movie Subtitles , 2008, LREC.

[15]  Blake Hallinan,et al.  Recommended for you: The Netflix Prize and the production of algorithmic culture , 2016, New Media Soc..

[16]  Maria da Graça Campos Pimentel,et al.  A heuristic evaluation of a mobile annotation tool , 2013, WebMedia.

[17]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[18]  Pablo César,et al.  "Let me comment on your video": supporting personalized end-user comments within third-party online videos , 2012, WebMedia.

[19]  Pablo César,et al.  Socially-aware multimedia authoring: Past, present, and future , 2013, TOMCCAP.

[20]  Chen Wang,et al.  Sensing a live audience , 2014, CHI.

[21]  Thomas K. Landauer,et al.  Research Methods in Human-Computer Interaction , 1988 .

[22]  Priscilla Avegliano,et al.  Dynamic Adjustment of Subtitles Using Audio Fingerprints , 2015, ACM Multimedia.

[23]  Fons Kuijk,et al.  From Photos to Memories: A User-Centric Authoring Tool for Telling Stories with Your Photos , 2009, UCMedia.

[24]  Jo Ueyama,et al.  Emoções na interação humano-computador: um estudo considerando sensores , 2013, IHC.

[25]  Carlos André Guimarães Ferraz,et al.  A Model-driven Approach for MulSeMedia Application Domain , 2016, WebMedia.

[26]  Ticianne G. R. Darin,et al.  Recommendations for the Design of Urban Mobility Applications Based on the Study of the User Experience , 2017, IHC.

[27]  Randolph G. Bias,et al.  Research Methods for Human-Computer Interaction , 2010, J. Assoc. Inf. Sci. Technol..

[28]  Pablo César,et al.  Creating and sharing personalized time-based annotations of videos on the web , 2010, DocEng '10.

[29]  Priscilla Avegliano,et al.  A Lightweight and Efficient Mechanism for Fixing the Synchronization of Misaligned Subtitle Documents , 2016, DocEng.

[30]  Vanessa Mendes Moreira de Sa.  Piracy & Social Change| From Orkut to Facebook: How Brazilian Pirate Audiences Utilize Social Media to Create Sharing Subcultures , 2015 .

[31]  Vivian Genaro Motti,et al.  A social approach to authoring media annotations , 2010, DocEng '10.

[32]  Soraia Silva Prietch,et al.  Emotion-Libras: Instrument for use in Human-Computer Interaction Researches considering People who are Deaf as Potential Users of Technology , 2016, IHC.

[33]  Stefan Winkler,et al.  Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives , 2016, Multimedia Systems.

[34]  Artur Henrique Kronbauer,et al.  Sherlock: uma plataforma para avaliar a experiência dos usuários com dispositivos móveis , 2014, IHC.