Sketchplore: Sketch and Explore with a Layout Optimiser

This paper studies a novel concept for integrating real-time design optimisation to a sketching tool. Although optimisation methods can attack very complex design problems, their insistence on precise objectives and a point optimum is a poor fit with sketching practices. Sketchplorer is a multitouch sketching tool that uses a real-time layout optimiser. It automatically infers the designer's task to search for both local improvements to the current design and global (radical) alternatives. Using predictive models of sensorimotor performance and perception, these suggestions steer the designer toward more usable and aesthetic layouts without overriding the designer or demanding extensive input.

[1]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[2]  Mark D. Dunlop,et al.  Enhancing KLM (keystroke-level model) to fit touch screen mobile devices , 2014, MobileHCI '14.

[3]  Rainer E. Burkard,et al.  Entwurf von Schreibmaschinentastaturen mittels quadratischer Zuordnungsprobleme , 1977, Math. Methods Oper. Res..

[4]  Antti Oulasvirta,et al.  MenuOptimizer: interactive optimization of menu systems , 2013, UIST.

[5]  Ranjitha Kumar,et al.  Webzeitgeist: design mining the web , 2013, CHI.

[6]  Shumin Zhai,et al.  Performance Optimization of Virtual Keyboards , 2002, Hum. Comput. Interact..

[7]  Yuanzhen Li,et al.  Measuring visual clutter. , 2007, Journal of vision.

[8]  Anne Morgan Spalter,et al.  Interactive color palette tools , 2004, IEEE Computer Graphics and Applications.

[9]  Scott R. Klemmer,et al.  Aesthetics matter: leveraging design heuristics to synthesize visually satisfying handheld interfaces , 2009, CHI Extended Abstracts.

[10]  Nigel Cross,et al.  Expertise in Design: an overview , 2004 .

[11]  Henri Pierreval,et al.  Facility layout problems: A survey , 2007, Annu. Rev. Control..

[12]  Elizabeth D. Mynatt,et al.  Variation in element and action: supporting simultaneous development of alternative solutions , 2004, CHI.

[13]  Steven K. Feiner,et al.  Evaluation of visual balance for automated layout , 2004, IUI '04.

[14]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[15]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[16]  Rubaiat Habib Kazi,et al.  Kitty: sketching dynamic and interactive illustrations , 2014, UIST.

[17]  Helen Balinsky,et al.  Aesthetic measure of alignment and regularity , 2009, DocEng '09.

[18]  Levent Burak Kara,et al.  Pen-based styling design of 3D geometry using concept sketches and template models , 2006, SPM '06.

[19]  Peter G. Anderson,et al.  Designing better keyboards via simulated annealing , 2016 .

[20]  Jason Hong,et al.  Computational Support for Sketching in Design: A Review , 2009, Found. Trends Hum. Comput. Interact..

[21]  Steven K. Feiner,et al.  A grid-based approach to automating display layout , 1998 .

[22]  William David Shontz,et al.  A STUDY OF VISUAL SEARCH USING EYE MOVEMENT RECORDINGS: COLOR CODING FOR INFORMATION LOCATION. , 1968 .

[23]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[24]  Aaron Hertzmann,et al.  Learning Layouts for Single-PageGraphic Designs , 2014, IEEE Transactions on Visualization and Computer Graphics.

[25]  Ravin Balakrishnan,et al.  ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models , 2008, UIST '08.

[26]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[27]  Mark W. Newman,et al.  Sitemaps, storyboards, and specifications: a sketch of Web site design practice , 2000, DIS '00.

[28]  Pierre Hansen,et al.  Variable neighborhood search: Principles and applications , 1998, Eur. J. Oper. Res..

[29]  Clayton Shepard,et al.  LiveLab: measuring wireless networks and smartphone users in the field , 2011, SIGMETRICS Perform. Evaluation Rev..

[30]  Rrk Sharma,et al.  A review of different approaches to the facility layout problems , 2006 .

[31]  Yin Yin Wong.  Rough and ready prototypes: lessons from graphic design , 1992, CHI '92.

[32]  Per Ola Kristensson,et al.  Improving two-thumb text entry on touchscreen devices , 2013, CHI.

[33]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[34]  Mark D. Gross,et al.  Computational Support for Sketching in Design , 2009 .

[35]  Xin Yao,et al.  Population-Based Incremental Learning With Associative Memory for Dynamic Environments , 2008, IEEE Transactions on Evolutionary Computation.

[36]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[37]  Helen Balinsky.  Evaluating interface aesthetics: measure of symmetry , 2006, Electronic Imaging.

[38]  Mark W. Newman,et al.  DENIM: finding a tighter fit between tools and practice for Web site design , 2000, CHI.

[39]  Ellen Yi-Luen Do,et al.  Ambiguous intentions: a paper-like interface for creative design , 1996, UIST '96.

[40]  Marc Van Droogenbroeck,et al.  Object Descriptors Based on a List of Rectangles: Method and Algorithm , 2011, ISMM.

[41]  Daniel Cohen-Or,et al.  Color harmonization , 2006, ACM Trans. Graph..

[42]  Anthony J. Hornof,et al.  Towards accurate and practical predictive models of active-vision-based visual search , 2014, CHI.

[43]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[44]  Steven K. Feiner,et al.  A Survey of Automated Layout Techniques for Information Presentations , 2005 .

[45]  Aaron Hertzmann,et al.  DesignScape: Design with Interactive Layout Suggestions , 2015, CHI.