Towards a better video comparison: comparison as a way of browsing the video contents

Comparison between videos is a basic task used in a wide variety of activities and domains. With ever-increasing social media contents that allow the mass consumption of video medium, our needs and uses for video comparison will only increase in the coming years. However, the interaction to support the task of comparing between videos is not well understood today, and there is very little theoretical foundation to guide future design for supporting video comparison. In this paper, we take the comparison as the primary angle to look at video-related interaction such as watching, browsing, and editing. By reinterpreting those interaction and synthesising available knowledge from HCI, visualisation and multimedia fields, we construct a theoretical structure that embeds essential conceptual components for supporting video comparison. These concepts not only help explain the existing user-interfaces of video applications as a comparison interaction, but also generate discussion and implications for novel interactive features to enhance our everyday consumption of video contents.

[1]  Camilla Forsell,et al.  Interaction Support for Visual Comparison Inspired by Natural Behavior , 2012, IEEE Transactions on Visualization and Computer Graphics.

[2]  Michael Gleicher,et al.  Considerations for Visualizing Comparison , 2018, IEEE Transactions on Visualization and Computer Graphics.

[3]  Jean Charles Bazin,et al.  ActionSnapping: Motion-Based Video Synchronization , 2016, ECCV.

[4]  Celso A. S. Santos,et al.  CrowdSync: User generated videos synchronization using crowdsourcing , 2017, 2017 International Conference on Systems, Signals and Image Processing (IWSSIP).

[5]  Cees Snoek,et al.  Size Matters! How Thumbnail Number, Size, and Motion Influence Mobile Video Retrieval , 2011, MMM.

[6]  Werner Bailer,et al.  Browsing Linked Video Collections for Media Production , 2014, MMM.

[7]  Max Mühlhäuser,et al.  PaperVideo: interacting with videos on multiple paper-like displays , 2012, ACM Multimedia.

[8]  Vu Lam,et al.  NII-UIT-VBS: A Video Browsing Tool for Known Item Search , 2013, MMM.

[9]  Pierfrancesco Bellini,et al.  MyStoryPlayer: experiencing multiple audiovisual content for education and training , 2014, Multimedia Tools and Applications.

[10]  Hyowon Lee,et al.  Supporting the comparison of alternative stories , 2016, OZCHI.

[11]  Klaus Schöffmann,et al.  Collaborative Video Search Combining Video Retrieval with Human-Based Visual Inspection , 2016, MMM.

[12]  Duy-Dinh Le,et al.  The Video Browser Showdown: a live evaluation of interactive video search tools , 2013, International Journal of Multimedia Information Retrieval.

[13]  Klaus Schöffmann,et al.  A Multi-Video Browser for Endoscopic Videos on Tablets , 2016, ACM Multimedia.

[14]  Frédo Durand,et al.  Video diff , 2015, ACM Trans. Graph..

[15]  Tatiana von Landesberger,et al.  Insights by Visual Comparison: The State and Challenges , 2018, IEEE Computer Graphics and Applications.

[16]  Mrinal K. Mandal,et al.  A Robust Technique for Motion-Based Video Sequences Temporal Alignment , 2013, IEEE Transactions on Multimedia.

[17]  Frank Hopfgartner,et al.  Video browsing interfaces and applications: a review , 2010 .

[18]  Jonathan C. Roberts,et al.  Visual comparison for information visualization , 2011, Inf. Vis..

[19]  Bongshin Lee,et al.  Timelines Revisited: A Design Space and Considerations for Expressive Storytelling , 2017, IEEE Transactions on Visualization and Computer Graphics.

[20]  Angus Graeme Forbes,et al.  Riverwalk: Incorporating Historical Photographs in Public Outdoor Augmented Reality Experiences , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[21]  Peter C. Wright,et al.  Bootlegger: Turning Fans into Film Crew , 2015, CHI.

[22]  Markus H. Gross,et al.  VideoSnapping , 2014 .

[23]  Florian Heimerl,et al.  Visual Movie Analytics , 2016, IEEE Transactions on Multimedia.

[24]  Mark J. Perry,et al.  Amateur vision and recreational orientation:: creating live video together , 2012, CSCW '12.

[25]  Colin Ware,et al.  Zooming versus multiple window interfaces: Cognitive costs of visual comparisons , 2006, TCHI.

[26]  Daniel F. Keefe,et al.  Comparison techniques utilized in spatial 3D and 4D data visualizations: A survey and future directions , 2017, Comput. Graph..

[27]  Heiko Schuldt,et al.  Enhanced Retrieval and Browsing in the IMOTION System , 2017, MMM.

[28]  Pierre Dragicevic,et al.  Time Curves: Folding Time to Visualize Patterns of Temporal Evolution in Data , 2016, IEEE Transactions on Visualization and Computer Graphics.

[29]  Klaus Schöffmann,et al.  Video Interaction Tools , 2015, ACM Comput. Surv..

[30]  Shin'ichi Satoh,et al.  Image Flows Visualization for Inter-media Comparison , 2014, 2014 IEEE Pacific Visualization Symposium.

[31]  Peter C. Wright,et al.  TryFilm: Situated Support for Interactive Media Productions , 2016, CSCW.

[32]  Luca Rossetto,et al.  Interactive video search tools: a detailed analysis of the video browser showdown 2015 , 2016, Multimedia Tools and Applications.

[33]  John T. Stasko,et al.  Toward a Deeper Understanding of the Role of Interaction in Information Visualization , 2007, IEEE Transactions on Visualization and Computer Graphics.