Analyzing Midair Object Pointing Mappings for Smart Display Input

One common task when controlling smart displays is the manipulation of menu items. Given current examples of smart displays that support distant bare hand control, in this paper we explore menu item selection tasks with three different mappings of barehand movement to target selection. Through a series of experiments, we demonstrate that Positional mapping is faster than other mappings when the target is visible but requires many clutches in large targeting spaces. Rate-based mapping is, in contrast, preferred by participants due to its perceived lower effort, despite being slightly harder to learn initially. Tradeoffs in the design of target selection in smart tv displays are discussed.

[1]  Edward Lank,et al.  Watchcasting: Freehand 3D interaction with off-the-shelf smartwatch , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[2]  Ehud Sharlin,et al.  Predictive interaction using the delphian desktop , 2005, UIST.

[3]  Edward Lank,et al.  Watchpoint: Freehand Pointing with a Smartwatch in a Ubiquitous Display Environment , 2016, AVI.

[4]  Daniel Vogel,et al.  HybridPointing: fluid switching between absolute and relative pointing with a direct input device , 2006, UIST.

[5]  Daniel Vogel,et al.  Distant freehand pointing and clicking on very large, high resolution displays , 2005, UIST.

[6]  Renaud Blanch,et al.  Object Pointing: A Complement to Bitmap Pointing in GUIs , 2004, Graphics Interface.

[7]  Ian Mackenzie,et al.  Fitts' law as a performance model in human-computer interaction , 1992 .

[8]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  Olivier Bau,et al.  OctoPocus: a dynamic guide for learning gesture-based command sets , 2008, UIST '08.

[10]  Edward Lank,et al.  Pointing at a Distance with Everyday Smart Devices , 2018, CHI.

[11]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[12]  Ravin Balakrishnan,et al.  Acquisition of expanding targets , 2002, CHI.

[13]  Pourang Irani,et al.  Elbow-Anchored Interaction: Designing Restful Mid-Air Input , 2021, CHI.

[14]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[15]  Ravin Balakrishnan,et al.  "Beating" Fitts' law: virtual enhancements for pointing facilitation , 2004, Int. J. Hum. Comput. Stud..

[16]  Panayiotis Koutsabasis,et al.  Empirical Research in Mid-Air Interaction: A Systematic Review , 2019, Int. J. Hum. Comput. Interact..

[17]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[18]  Niels Henze,et al.  The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments , 2018, CHI.

[19]  I. Scott MacKenzie,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[20]  Edward Lank,et al.  Leveraging CD Gain for Precise Barehand Video Timeline Browsing on Smart Displays , 2021, INTERACT.

[21]  Andy Cockburn,et al.  Comparing speed-dependent automatic zooming with traditional scroll, pan and zoom methods , 2004 .

[22]  Takeo Igarashi,et al.  Speed-dependent automatic zooming for browsing large documents , 2000, UIST '00.

[23]  Olivier Chapuis,et al.  Mid-Air Pointing on Ultra-Walls , 2015, TCHI.

[24]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.