Color-in-fist: a metaphor for color selection with mid-air interaction

Abstract Color picker is a necessary interactive component in visualization system. Current color pickers are based on the WIMP paradigm and are mainly designed for mouse, touch and ray interactions. In the context of immersive and remote interaction, mid-air interaction is an important method. However, common solution of color selection using hands is simulating cursors or rays with fingers, which does not take full advantage of mid-air interaction—intuition, naturalness and remote interaction. This results in fatigue and long selection time. In this paper, we proposed a mid-air interaction metaphor for color selection which enabled users to select hue, saturation and lightness simultaneously using mutually independent and intuitive hand motions. We conducted a user study to evaluate the performance of the interaction technique. Results showed that the metaphor improved the efficiency of color selection with mid-air interaction. Questionnaire results showed that the metaphor enhanced users’ perception of color space; the semantics of hand motions were consistent with users’ intention of color selection; the metaphor was easy to learn and memorize. Graphic Abstract

[1]  Wendy E. Mackay,et al.  Color Portraits: From Color Picking to Interacting with Color , 2015, CHI.

[2]  Daniel Vogel,et al.  Distant freehand pointing and clicking on very large, high resolution displays , 2005, UIST.

[3]  B. Rajesh Kanna,et al.  ColorFingers: improved multi-touch color picker , 2014, SIGGRAPH ASIA Technical Briefs.

[4]  Peng Song,et al.  A handle bar metaphor for virtual object manipulation with mid-air interaction , 2012, CHI.

[5]  Sriram Subramanian,et al.  Tilt techniques: investigating the dexterity of wrist-based input , 2009, CHI.

[6]  Alexei Sourin,et al.  Mid-air interaction with optical tracking for 3D modeling , 2018, Comput. Graph..

[7]  Karin Coninx,et al.  Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[8]  Mark Green,et al.  JDCAD: A highly interactive 3D modeling system , 1994, Comput. Graph..

[9]  Hrvoje Benko,et al.  Multi-point interactions with immersive omnidirectional visualizations in a dome , 2010, ITS '10.

[10]  Tovi Grossman,et al.  The design and evaluation of selection techniques for 3D volumetric displays , 2006, UIST.

[11]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[12]  Celine Latulipe,et al.  BiCEP: bimanual color exploration plugin , 2011, CHI EA '11.

[13]  Barbara J. Meier.  ACE: a color expert system for user interface design , 1988, UIST '88.

[14]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3d volumetric displays , 2004, UIST '04.

[15]  Ken Hinckley,et al.  Haptic issues for virtual manipulation , 1997 .

[16]  J. Pula,et al.  Eyes and stroke: the visual aspects of cerebrovascular disease , 2017, Stroke and Vascular Neurology.

[17]  Gang Ren,et al.  3D selection with freehand gesture , 2013, Comput. Graph..

[18]  Sarah A. Douglas,et al.  Model and representation: the effect of visual feedback on human performance in a color picker interface , 1999, TOGS.

[19]  Hrvoje Benko,et al.  Beyond flat surface computing: challenges of depth-aware and curved interfaces , 2009, ACM Multimedia.

[20]  Tovi Grossman,et al.  Multi-finger gestural interaction with 3D volumetric displays , 2005, SIGGRAPH 2005.