Direct manipulation through surrogate objects

Direct manipulation has had major influence on interface design since it was proposed by Shneiderman in 1982. Although directness generally benefits users, direct manipulation also has weaknesses. In some cases, such as when a user needs to manipulate small, attribute-rich objects or multiple objects simultaneously, indirect manipulation may be more efficient at the cost of directness or intuitiveness of the interaction. Several techniques have been developed over the years to address these issues, but these are all isolated and limited efforts with no coherent underlying principle. We propose the notion of Surrogate Interaction that ties together a large subset of these techniques through the use of a surrogate object that allow users to interact with the surrogate instead of the domain object. We believe that formalizing this family of interaction techniques will provide an additional and powerful interface design alternative for interaction designers, as well as uncover opportunities for future research.

[1]  Ben Shneiderman,et al.  The future of interactive systems and the emergence of direct manipulation , 1982 .

[2]  Ken Perlin,et al.  Pad: an alternative approach to the computer interface , 1993, SIGGRAPH.

[3]  H. P. Friedman,et al.  The surgical implications of physiologic patterns in myocardial infarction shock. , 1972, Surgery.

[4]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[5]  B. Shneiderman,et al.  The dynamic HomeFinder: evaluating dynamic queries in a real-estate information exploration system , 1992, SIGIR '92.

[6]  Gennady L. Andrienko,et al.  Exploratory analysis of spatial and temporal data - a systematic approach , 2005 .

[7]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[8]  Bill Buxton HCI and the inadequacies of direct manipulation systems , 1993, SGCH.

[9]  Daniel Vogel,et al.  HybridPointing: fluid switching between absolute and relative pointing with a direct input device , 2006, UIST.

[10]  David Frohlich,et al.  Direct manipulation and other lessons , 1997 .

[11]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[12]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[13]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[14]  Jeffrey Heer,et al.  Scented Widgets: Improving Navigation Cues with Embedded Visualizations , 2007, IEEE Transactions on Visualization and Computer Graphics.

[15]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[16]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[17]  David M. Frohlich,et al.  The history and future of direct manipulation , 1993, Behav. Inf. Technol..

[18]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[19]  Delbert Hart,et al.  Interactive legends , 2004, ACM-SE 42.

[20]  M. E. McGill,et al.  Dynamic Graphics for Statistics. , 1990 .

[21]  Michael P. Peterson,et al.  Active legends for interactive cartographic animation , 1999, Int. J. Geogr. Inf. Sci..

[22]  Ben Shneiderman,et al.  Direct manipulation vs. interface agents , 1997, INTR.

[23]  Edward R. Tufte,et al.  The Visual Display of Quantitative Information , 1986 .

[24]  E. Tufte Beautiful Evidence , 2006 .

[25]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[26]  Michel Beaudouin-Lafon,et al.  Designing interaction, not interfaces , 2004, AVI.

[27]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[28]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[29]  Mark Pruett,et al.  Yahoo! pipes , 2007 .

[30]  Paul Dourish,et al.  Where the action is , 2001 .

[31]  B. Marx The Visual Display of Quantitative Information , 1985 .

[32]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[33]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[34]  Clemens Nylandsted Klokmose,et al.  VIGO: instrumental interaction in multi-surface environments , 2009, CHI.

[35]  Philip R. Cohen,et al.  Synergistic use of direct manipulation and natural language , 1989, CHI '89.

[36]  Chris Esposito,et al.  Of mice and monkeys: a specialized input device for virtual body animation , 1995, I3D '95.

[37]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[38]  Pattie Maes,et al.  Interface agents , 1996, CHI Conference Companion.