Familiarisation: Restructuring Layouts with Visual Learning Models

In domains where users are exposed to large variations in visuo-spatial features among designs, they often spend excess time searching for common elements (features) in familiar locations. This paper contributes computational approaches to restructuring layouts such that features on a new, unvisited interface can be found quicker. We explore four concepts of familiarisation, inspired by the human visual system (HVS), to automatically generate a familiar design for each user.

[1]  Andrew Sears,et al.  The role of visual search in the design of effective soft keyboards , 2001, Behav. Inf. Technol..

[2]  Krzysztof Z. Gajos,et al.  Automatically generating custom user interfaces for users with physical disabilities , 2006, Assets '06.

[3]  P. Frensch,et al.  Composition during serial learning: a serial position effect. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[4]  Jeffrey Nichols,et al.  UNIFORM: automatically generating consistent remote control user interfaces , 2006, CHI.

[5]  Antti Oulasvirta,et al.  Sketchplore: Sketch and Explore with a Layout Optimiser , 2016, Conference on Designing Interactive Systems.

[6]  Jeffrey Nichols,et al.  Generating remote control interfaces for complex appliances , 2002, UIST '02.

[7]  Ranjitha Kumar,et al.  Bricolage: example-based retargeting for web design , 2011, CHI.

[8]  Antti Oulasvirta,et al.  MenuOptimizer: interactive optimization of menu systems , 2013, UIST.

[9]  Ranjitha Kumar,et al.  Webzeitgeist: design mining the web , 2013, CHI.

[10]  J R Anderson,et al.  Practice and retention: a unifying analysis. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Antti Oulasvirta,et al.  Modelling Learning of New Keyboard Layouts , 2017, CHI.

[12]  Stuart C. Shapiro,et al.  Automatic Construction of User-Interface Displays , 1988, AAAI.

[13]  Steven K. Feiner,et al.  Scope: automated generation of graphical interfaces , 1989, UIST '89.

[14]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[15]  Morgan Dixon,et al.  Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure , 2010, CHI.

[16]  Aaron Hertzmann,et al.  DesignScape: Design with Interactive Layout Suggestions , 2015, CHI.

[17]  Joachim Meyer,et al.  Benefits and costs of adaptive user interfaces , 2010, Int. J. Hum. Comput. Stud..

[18]  Dan R. Olsen,et al.  A programming language basis for user interface , 1989, CHI '89.

[19]  Ian H. Witten,et al.  Adaptive personalized interfaces—A question of viability , 1985 .

[20]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[21]  Krzysztof Z. Gajos,et al.  Ability-Based Design: Concept, Principles and Examples , 2011, TACC.

[22]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[23]  Jean Vanderdonckt,et al.  Towards a Dynamic Strategy for Computer-Aided Visual Placement , 1994, Advanced Visual Interfaces.

[24]  Jeffrey Nichols,et al.  Mobilization by demonstration: using traces to re-author existing web sites , 2008, IUI '08.

[25]  Andrew Sears,et al.  Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout , 1993, IEEE Trans. Software Eng..

[26]  Jürgen Ziegler,et al.  Generating user interfaces from data models and dialogue net specifications , 1993, INTERCHI.

[27]  Dario D. Salvucci An integrated model of eye movements and visual encoding , 2001, Cognitive Systems Research.

[28]  Gerrit C. van der Veer,et al.  Pattern Languages in Interaction Design: Structure and Organization , 2003 .

[29]  Antti Oulasvirta,et al.  Ability-Based Optimization: Designing Smartphone Text Entry Interface for Older Adults , 2017, INTERACT.

[30]  Rob Miller,et al.  Sikuli: using GUI screenshots for search and automation , 2009, UIST '09.

[31]  C. Lebiere,et al.  An integrated theory of list memory. , 1998 .

[32]  Henrik Eriksson,et al.  Model-Based Automated Generation of User Interfaces , 1994, AAAI.

[33]  Aaron Hertzmann,et al.  Learning Layouts for Single-PageGraphic Designs , 2014, IEEE Transactions on Visualization and Computer Graphics.

[34]  Frédo Durand,et al.  Learning Visual Importance for Graphic Designs and Data Visualizations , 2017, UIST.

[35]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[36]  Krzysztof Z. Gajos,et al.  Automatically generating user interfaces adapted to users' motor and vision capabilities , 2007, UIST.

[37]  Andruid Kerne,et al.  Culturally based design: embodying trans-surface interaction in rummy , 2012, CSCW.

[38]  David L. Barton Design Languages , 1999, The VLSI Handbook.