Disruptive Approaches for Subtitling in Immersive Environments

The Immersive Accessibility Project (ImAc) explores how accessibility services can be integrated with 360o video as well as new methods for enabling universal access to immersive content. ImAc is focused on inclusivity and addresses the needs of all users, including those with sensory or learning disabilities, of all ages and considers language and user preferences. The project focuses on moving away from the constraints of existing technologies and explores new methods for creating a personal experience for each consumer. It is not good enough to simply retrofit subtitles into immersive content: this paper attempts to disrupt the industry with new and often controversial methods. This paper provides an overview of the ImAc project and proposes guiding methods for subtitling in immersive environments. We discuss the current state-of-the-art for subtitling in immersive environments and the rendering of subtitles in the user interface within the ImAc project. We then discuss new experimental rendering modes that have been implemented including a responsive subtitle approach, which dynamically re-blocks subtitles to fit the available space and explore alternative rendering techniques where the subtitles are attached to the scene.

[1]  Rhianne Jones,et al.  Online News Videos: The UX of Subtitle Position , 2015, ASSETS.

[2]  Gerd Bruder,et al.  Foreword to the Special Section on the International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE 2018) , 2019, Computers & graphics.

[3]  Andy Brown,et al.  Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape , 2016 .

[4]  Inter-Parliamentary Union,et al.  Convention on the Rights of Persons with Disabilities , 2009, European journal of health law.

[5]  Rhianne Jones,et al.  Responsive design for personalised subtitles , 2015, W4A.

[6]  Heinrich Hußmann,et al.  Positioning of Subtitles in Cinematic Virtual Reality , 2018, ICAT-EGVE.

[7]  Nick Bryan-Kinns,et al.  The impact of transitions on user experience in virtual reality , 2017, 2017 IEEE Virtual Reality (VR).

[8]  Abdolmajid Hayati,et al.  The effect of films with and without subtitles on listening comprehension of EFL learners , 2011, Br. J. Educ. Technol..

[9]  Ali Mobalegh,et al.  Movie Subtitles and the Improvement of Listening Comprehension Ability: Does it help? , 2011 .

[10]  Min Sun,et al.  Tell Me Where to Look: Investigating Ways for Assisting Focus in 360° Video , 2017, CHI.

[11]  Andy Brown,et al.  Subtitles in 360-degree Video , 2017, TVX.

[12]  Pilar Orero,et al.  HBB4ALL: Deployment of HbbTV services for all , 2015, 2015 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.