D-Macs: building multi-device user interfaces by demonstrating, sharing and replaying design actions

Multi-device user interface design mostly implies creating suitable interface for each targeted device, using a diverse set of design tools and toolkits. This is a time consuming activity, concerning a lot of repetitive design actions without support for reusing this effort in later designs. In this paper, we propose D-Macs: a design tool that allows designers to record their design actions across devices, to share these actions with other designers and to replay their own design actions and those of others. D-Macs lowers the burden in multi-device user interface design and can reduce the necessity for manually repeating design actions.

[1]  Dan R. Olsen,et al.  Evaluating user interface systems research , 2007, UIST.

[2]  Dan R. Olsen,et al.  Cross-modal interaction using XWeb , 2000, UIST '00.

[3]  Tovi Grossman,et al.  CommunityCommands: command recommendations for software applications , 2009, UIST '09.

[4]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[5]  Eben M. Haber,et al.  CoScripter: automating & sharing how-to knowledge in the enterprise , 2008, CHI.

[6]  Brad A. Myers,et al.  Automatic, look-and-feel independent dialog creation for graphical user interfaces , 1990, CHI '90.

[7]  Jean Vanderdonckt,et al.  An intelligent editor for multi-presentation user interfaces , 2008, SAC '08.

[8]  David Wolber,et al.  A demonstrational technique for developing interfaces with dynamically created objects , 1991, UIST '91.

[9]  Jan Meskens,et al.  Gummy for multi-platform user interface designs: shape me, multiply me, fix me, use me , 2008, AVI '08.

[10]  Krzysztof Z. Gajos,et al.  Automatically generating personalized user interfaces with Supple , 2010, Artif. Intell..

[11]  Scott R. Klemmer,et al.  What would other programmers do: suggesting solutions to error messages , 2010, CHI.

[12]  Brad A. Myers,et al.  Pursuit: graphically representing programs in a demonstrational visual shell , 1994, CHI Conference Companion.

[13]  Susan M. Harrison.  A comparison of still, animated, or nonillustrated on-line help with written or spoken instructions in a graphical user interface , 1995, CHI '95.

[14]  James A. Landay,et al.  Employing patterns and layers for early-stage design and prototyping of cross-device user interfaces , 2008, CHI.

[15]  Tovi Grossman,et al.  ToolClips: an investigation of contextual video assistance for functionality understanding , 2010, CHI.

[16]  Yang Li,et al.  Informal prototyping of continuous graphical interactions by demonstration , 2005, SIGGRAPH '06.

[17]  Krzysztof Z. Gajos,et al.  Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces , 2008, CHI.

[18]  Xiaoyang Mao,et al.  Visualizing histories for selective undo and redo , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[19]  Jean Vanderdonckt,et al.  Multi-fidelity Prototyping of User Interfaces , 2007, INTERACT.

[20]  Jeffrey Nichols,et al.  Mobilization by demonstration: using traces to re-author existing web sites , 2008, IUI '08.

[21]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[22]  Tessa A. Lau,et al.  DocWizards: a system for authoring follow-me documentation wizards , 2005, UIST.

[23]  Kori Inkpen Quinn,et al.  What designers want: Needs of interactive application designers , 2009, 2009 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[24]  Martin Wattenberg,et al.  Your place or mine?: visualization as a community component , 2008, CHI.

[25]  Jan Meskens,et al.  Jelly: a multi-device design environment for managing consistency across devices , 2010, AVI.

[26]  Steven K. Feiner,et al.  A history-based macro by example system , 1992, UIST '92.

[27]  Thomas Berlage,et al.  A selective undo mechanism for graphical user interfaces based on command objects , 1994, TCHI.

[28]  Brad A. Myers.  Past, Present and Future of User Interface Software Tools , 2000 .

[29]  Jeffrey Nichols,et al.  Demonstrating the viability of automatically generated user interfaces , 2007, CHI.

[30]  Takeo Igarashi,et al.  Generating photo manipulation tutorials by demonstration , 2009, ACM Trans. Graph..

[31]  Brad A. Myers,et al.  Getting more out of programming-by-demonstration , 1999, CHI '99.