Twist and touch - investigating the benefit of using tilt for 3D interfaces in mobile image and video browsing

3D visualizations suggest high potential for video and image browsing interfaces on smartphones and tablets because the third dimension enables us to represent more information at a time - thus coping with the limiting screen size of these handheld devices. Interactively changing the representation of such 3D interfaces by tilting the device gives us further opportunities for innovative and engaging visualizations. However, it is unclear if such visual representations of image and video data achieve a good search performance and are accepted and appreciated by users. We present experiments investigating different 3D designs for video browsing interfaces that take the tilt angle of the device into account. Our evaluations show a rather limited benefit with respect to performance (measured via search time and accuracy) but high potential with respect to entertainment and engagement (measured via qualitative user statements).

[1]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[2]  Frank Hopfgartner,et al.  Video browsing interfaces and applications: a review , 2010 .

[3]  Touradj Ebrahimi,et al.  Gesture and touch controlled video player interface for mobile devices , 2010, ACM Multimedia.

[4]  Alexander G. Hauptmann,et al.  Adjustable filmstrips and skims as abstractions for a digital video library , 1999, Proceedings IEEE Forum on Research and Technology Advances in Digital Libraries.

[5]  Gerald Schaefer,et al.  Mobile image browsing on a 3D globe: demo paper , 2012, ICMR '12.

[6]  Cees Snoek,et al.  Size Matters! How Thumbnail Number, Size, and Motion Influence Mobile Video Retrieval , 2011, MMM.

[7]  Klaus Schöffmann,et al.  Using a 3D cylindrical interface for image browsing to improve visual search performance , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[8]  Dimitrios Paris Darzentas,et al.  HiStory: a hierarchical storyboard interface design for video browsing on mobile devices , 2012, MUM.

[9]  Gerald Schaefer,et al.  Visualisation and Browsing of Image Databases , 2011, Multimedia Analysis, Processing and Communications.

[10]  Klaus Schöffmann,et al.  3D Image Browsing on Mobile Devices , 2011, 2011 IEEE International Symposium on Multimedia.

[11]  Cees Snoek,et al.  Keep moving!: revisiting thumbnails for mobile video retrieval , 2010, ACM Multimedia.

[12]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[13]  Dimitrios Paris Darzentas,et al.  Quantity versus quality: the role of layout and interaction complexity in thumbnail-based video retrieval interfaces , 2012, ICMR.

[14]  Wolfgang Hürst,et al.  Mobile 3D graphics and virtual reality interaction , 2011, Advances in Computer Entertainment Technology.

[15]  Qibin Sun,et al.  Video Browsing on Handheld Devices—Interface Designs for the Next Generation of Mobile Video Players , 2008, IEEE MultiMedia.

[16]  Max Mühlhäuser,et al.  Toward more efficient user interfaces for mobile video browsing: an in-depth exploration of the design space , 2010, ACM Multimedia.

[17]  George W. Fitzmaurice,et al.  HMDs, caves & chameleon: a human-centric analysis of interaction in virtual space , 1998, COMG.

[18]  Laurence Nigay,et al.  Using the user's point of view for interaction on mobile devices , 2011, IHM.

[19]  Klaus Schöffmann,et al.  A User Study of Visual Search Performance with Interactive 2D and 3D Storyboards , 2011, Adaptive Multimedia Retrieval.

[20]  Roman Ganhör ProPane: fast and precise video browsing on mobile phones , 2012, MUM.