Towards Enhanced Creativity in Interface Design through Automated Usability Evaluation

With an increase in the number of mobile apps making their way to users, there is a growing need for tools to support the app design process. While many tools focus on increasing the pace of development, few attempt to aide the designer in generating more creative solutions. In this work, we take creativity as the combination of novelty and utility. Particularly during development of user interfaces, assessment of utility (primarily usability) is iterative, rigorous, and time-consuming. The objective of the proposed work is to explore and evaluate the use of machine learning to predict usability measures for mobile app interfaces as a means to automate usability evaluations. Specifically, a convolutional neural network (CNN) is used to accurately (nearly 90%) predict three usability measures: regularity, complexity, and touchability. This tool automates the assessment of utility in app design, freeing up the designer to seek designs that are novel and thus creative.

[1]  Antonella De Angeli,et al.  Towards a theory of user judgment of aesthetics and user interface quality , 2008, TCHI.

[2]  Benjamin B. Bederson,et al.  Target size study for one-handed thumb use on small touchscreen devices , 2006, Mobile HCI.

[3]  Masaaki Kurosu,et al.  Apparent usability vs. inherent usability: experimental analysis on the determinants of the apparent usability , 1995, CHI 95 Conference Companion.

[4]  Marco Iansiti,et al.  Innovation and Design in the Age of Artificial Intelligence , 2020, Journal of Product Innovation Management.

[5]  Simon Colton,et al.  The HR3 System for Automatic Code Generation in Creative Settings , 2019, ICCC.

[6]  Yang Li,et al.  Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning , 2019, CHI.

[7]  Mohamed Wiem Mkaouer,et al.  PLAIN: PLugin for predicting the usAbility of Mobile User INterface , 2017, VISIGRAPP.

[8]  Christopher McComb,et al.  Learning to design from humans: Imitating human designers through deep learning , 2019, Journal of Mechanical Design.

[9]  Donald A. Norman,et al.  Emotion & design: attractive things work better , 2002, INTR.

[10]  John Zimmerman,et al.  Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation , 2018, CHI.

[11]  Mohamed Wiem Mkaouer,et al.  Assessing the quality of mobile graphical user interfaces using multi-objective optimization , 2019, Soft Comput..

[12]  Jeffrey Nichols,et al.  Rico: A Mobile App Dataset for Building Data-Driven Design Applications , 2017, UIST.

[13]  Christopher McComb,et al.  Design Repository Effectiveness for 3D Convolutional Neural Networks: Application to Additive Manufacturing , 2019, Journal of Mechanical Design.

[14]  Pegah Karimi,et al.  Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System , 2019, ICCC.

[15]  Simon Colton,et al.  Investigating and Automating the Creative Act of Software Engineering: A Position Paper , 2018, ICCC.

[16]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[17]  Rosni Abdullah,et al.  Aesthetic Measures for Assessing Graphic Screens , 2000, J. Inf. Sci. Eng..

[18]  Jeffrey Nichols,et al.  ZIPT: Zero-Integration Performance Testing of Mobile App Designs , 2017, UIST.

[19]  David Chek Ling Ngo,et al.  Formalising guidelines for the design of screen layouts , 2000 .