A Tiered Evaluation Framework for Reality-Based Creativity Support Environments

Reality-based interfaces (RBIs) such as tabletop and tangible user interfaces offer unique opportunities for supporting creativity. In this paper, we present a multi- tiered evaluation framework for reality-based creativity support environments and describe its application in the context of college-level science education. The proposed framework consists of three layers that examine the usability, usefulness, and impact of an environment on creative problem solving processes. Drawing upon the existing body of work in the area, our framework documents a mixed-method approach and provides guidance for the evaluation of reality-based creativity support environments. Author Keywords Reality-based interaction; creativity support; tabletop interaction; collaborative learning.

[1]  Yvonne Rogers,et al.  Around the table: are multiple-touch surfaces better than single-touch for children's collaborative interactions? , 2009, CSCL.

[2]  Orit Shaer,et al.  Enhancing genomic learning through tabletop interaction , 2011, CHI.

[3]  R. Dehaan.  Teaching creativity and inventive problem solving in science. , 2009, CBE life sciences education.

[4]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[5]  Kenton O'Hara,et al.  Social Impact , 2019, Encyclopedia of Food and Agricultural Ethics.

[6]  Orit Shaer,et al.  A collaborative environment for engaging novices in scientific inquiry , 2012, ITS '12.

[7]  Bertrand Schneider,et al.  Phylo-Genie: engaging students in collaborative 'tree-thinking' through tabletop techniques , 2012, CHI.

[8]  Orit Shaer,et al.  G-nome surfer: a tabletop interface for collaborative exploration of genomic data , 2010, CHI.

[9]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[10]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[11]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[12]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[13]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[14]  Orit Shaer,et al.  MoClo planner: supporting innovation in bio-design through multi-touch interaction , 2012, ITS '12.

[15]  Orit Shaer,et al.  The design, development, and deployment of a tabletop interface for collaborative exploration of genomic data , 2012, Int. J. Hum. Comput. Stud..