Quantity versus quality: the role of layout and interaction complexity in thumbnail-based video retrieval interfaces

In this paper we present our findings from an experiment designed to test the effectiveness of complex, thumbnail based layouts and the interaction methods required, in video retrieval scenarios for handheld devices such as smartphones. Our evaluation explores the relationship between the number of thumbnails (Quantity) visible on screen and their discernible detail (Quality) with regards to the related necessary amount of interaction. The results indicate that such layouts achieve a very high rate of accuracy and speed but that the nature of the interaction is of critical importance for the success of the system.

[1]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[2]  Marcel Worring,et al.  A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval , 2007, IEEE Transactions on Multimedia.

[3]  Shingo Uchihashi,et al.  An interactive comic book presentation for exploring video , 2000, CHI.

[4]  Cees Snoek,et al.  Keep moving!: revisiting thumbnails for mobile video retrieval , 2010, ACM Multimedia.

[5]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[6]  Alexander G. Hauptmann,et al.  Adjustable filmstrips and skims as abstractions for a digital video library , 1999, Proceedings IEEE Forum on Research and Technology Advances in Digital Libraries.

[7]  Cees Snoek,et al.  Size Matters! How Thumbnail Number, Size, and Motion Influence Mobile Video Retrieval , 2011, MMM.

[8]  John Adcock,et al.  Interactive Video Search Using Multilevel Indexing , 2005, CIVR.

[9]  Rong Yan,et al.  Merging storyboard strategies and automatic retrieval for improving interactive video search , 2007, CIVR '07.

[10]  Frank Hopfgartner,et al.  Video browsing interfaces and applications: a review , 2010 .

[11]  Michael G. Christel Evaluation and user studies with respect to video summarization and browsing , 2006, Electronic Imaging.

[12]  Klaus Schöffmann,et al.  Video Browsing with a 3D Thumbnail Ring Arranged by Color Similarity , 2012, MMM.

[13]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[14]  Marcel Worring,et al.  Navigating on hand held displays: Dynamic versus Static Keyhole Navigation , 2006 .

[15]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .