Pinch-drag-flick vs. spatial input: rethinking zoom & pan on mobile displays

The multi-touch-based pinch to zoom, drag and flick to pan metaphor has gained wide popularity on mobile displays, where it is the paradigm of choice for navigating 2D documents. But is finger-based navigation really the gold standard' In this paper, we present a comprehensive user study with 40 participants, in which we systematically compared the Pinch-Drag-Flick approach with a technique that relies on spatial manipulation, such as lifting a display up/down to zoom. While we solely considered known techniques, we put considerable effort in implementing both input strategies on popular consumer hardware (iPhone, iPad). Our results show that spatial manipulation can significantly outperform traditional Pinch-Drag-Flick. Given the carefully optimized prototypes, we are confident to have found strong arguments that future generations of mobile devices could rely much more on spatial interaction principles.

[1]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[2]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[3]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[4]  Emmanuel Pietriga,et al.  Side pressure for bidirectional navigation on small devices , 2013, MobileHCI '13.

[5]  George W. Furnas,et al.  Critical zones in desert fog: aids to multiscale navigation , 1998, UIST '98.

[6]  William Buxton,et al.  Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display , 2002, UIST '02.

[7]  Raimund Dachselt,et al.  PaperLens: advanced magic lens interaction above the tabletop , 2009, ITS '09.

[8]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[9]  David A. Forsyth,et al.  Around device interaction for multiscale navigation , 2012, Mobile HCI.

[10]  Abigail Sellen,et al.  Toward compound navigation tasks on mobiles via spatial manipulation , 2013, MobileHCI '13.

[11]  Ka-Ping Yee,et al.  Peephole displays: pen interaction on spatially aware handheld computers , 2003, CHI '03.

[12]  George Buchanan,et al.  Improving Web Interaction on Small Displays , 1999, Comput. Networks.

[13]  Eric Lecolinet,et al.  Clutch-free panning and integrated pan-zoom control on touch-sensitive surfaces: the cyclostar approach , 2010, CHI.

[14]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[15]  Roel Vertegaal,et al.  FlexView: an evaluation of depth navigation on deformable mobile devices , 2013, TEI '13.

[16]  Roman Rädle,et al.  The effect of egocentric body movements on users' navigation performance and spatial memory in zoomable user interfaces , 2013, ITS.

[17]  Bonifaz Kaufmann,et al.  Studying spatial memory and map navigation performance on projector phones with peephole interaction , 2013, CHI.

[18]  W. Buxton,et al.  Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display , 2002, UIST '02.

[19]  Jinwoo Kim,et al.  Do size and structure matter to mobile users? An empirical study of the effects of screen size, information structure, and task complexity on user activities with standard web phones , 2004, Behav. Inf. Technol..

[20]  Shumin Zhai,et al.  Virtual reality for palmtop computers , 1993, TOIS.

[21]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[22]  Raimund Dachselt,et al.  Going beyond the surface: studying multi-layer interaction above the tabletop , 2012, CHI.

[23]  TIM R.H. CUTMORE,et al.  Cognitive and gender factors influencing navigation in a virtual environment , 2000, Int. J. Hum. Comput. Stud..

[24]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[25]  Byron Reeves,et al.  The effects of screen size and message content on attention and arousal Media Psychology , 1999 .

[26]  J. M. Dabbs,et al.  Spatial Ability, Navigation Strategy, and Geographic Knowledge Among Men and Women , 1998 .

[27]  Hong Hua,et al.  User evaluations on form factors of tangible magic lenses , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[28]  Raimund Dachselt,et al.  PaperLens: advanced magic lens interaction above the tabletop , 2009, ITS '09.

[29]  Benjamin B. Bederson,et al.  Space-scale diagrams: understanding multiscale interfaces , 1995, CHI '95.

[30]  Michael F. Cohen,et al.  Looking at you: fused gyro and face tracking for viewing large imagery on mobile devices , 2012, CHI.

[31]  Carl Gutwin,et al.  Interacting with Big Interfaces on Small Screens: a Comparison of Fisheye, Zoom, and Panning Techniques , 2004, Graphics Interface.

[32]  Eva Eriksson,et al.  Mixed Interaction Space - Expanding the Interaction Space with Mobile Devices , 2005, BCS HCI.