Sketching with Conceptual Metaphors to Explain Computational Processes

To explore how people conceptualize a complex system, 232 university students were asked to sketch how a search engine works. While the sketches reveal a diverse range of visual and conceptual approaches, a subset of the sketches exhibit an underlying regularity for describing algorithmic processes. To explain this regularity, the author proposes the conceptual metaphor: a search engine is a series of text transformations and describe a set of mappings from sketchable graphic markings to abstractions in the search engine domain. The author believes that this metaphor can be applied to enable people to more effectively conceptualize, describe, and explore complex systems

[1]  Pourang Irani,et al.  The effect of a perceptual syntax on the learnability of novel concepts , 2004, Proceedings. Eighth International Conference on Information Visualisation, 2004. IV 2004..

[2]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[3]  Mark W. Newman,et al.  DENIM: An Informal Web Site Design Tool Inspired by Observations of Practice , 2003, Hum. Comput. Interact..

[4]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[5]  Marian Petre,et al.  Issues Governing the Suitability of Programming Languages for Programming Tasks , 1988, BCS HCI.

[6]  Cesare Pautasso,et al.  Visual composition of Web services , 2003, IEEE Symposium on Human Centric Computing Languages and Environments, 2003. Proceedings. 2003.

[7]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[8]  Kathryn Henderson,et al.  Flexible Sketches and Inflexible Data Bases: Visual Communication, Conscription Devices, and Boundary Objects in Design Engineering , 1991 .

[9]  Paul Thompson,et al.  Finding Out About: A Cognitive Perspective on Search Engine Technology and the WWW , 2002, Information Retrieval.

[10]  Ellen Yi-Luen Do,et al.  Thinking with Diagrams in Architectural Design , 2001, Artificial Intelligence Review.

[11]  G. Lakoff,et al.  Where mathematics comes from : how the embodied mind brings mathematics into being , 2002 .

[12]  Mark D. Gross,et al.  The Electronic Cocktail Napkin—a computational environment for working with design diagrams , 1996 .

[13]  Christopher D. Hundhausen,et al.  Toward empirically-based software visualization languages , 1995, Proceedings of Symposium on Visual Languages.

[14]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[15]  Rachel K. E. Bellamy.  What Does Pseudo-Code Do? A Psychological Analysis of the use of Pseudo-Code by Experienced Programmers , 1994, Hum. Comput. Interact..

[16]  Judith Good,et al.  Cognitive Factors in Programming with Diagrams , 2001, Artificial Intelligence Review.

[17]  Beryl Plimmer,et al.  Computer-Aided Sketching to Capture Preliminary Design , 2002, AUIC.

[18]  John C. Grundy,et al.  An e-whiteboard application to support early design-stage sketching of UML diagrams , 2003, IEEE Symposium on Human Centric Computing Languages and Environments, 2003. Proceedings. 2003.

[19]  Efthimis N. Efthimiadis,et al.  Search engines and how students think they work , 2005, SIGIR '05.

[20]  Donald A. Schön.  The reflective practitioner : how professionals think in action , 1986 .

[21]  L. Suchman.  Representing practice in cognitive science , 1988 .

[22]  Alan F. Blackwell,et al.  Does metaphor increase visual language usability? , 1999, Proceedings 1999 IEEE Symposium on Visual Languages.

[23]  Elizabeth D. Liddy,et al.  How a Search Engine Works. , 2001 .

[24]  J. Brown,et al.  Bridging epistemologies: The generative dance between organizational knowledge and organizational knowing , 1999, STUDI ORGANIZZATIVI.

[25]  Brad A. Myers,et al.  Studying the language and structure in non-programmers' solutions to programming problems , 2001, Int. J. Hum. Comput. Stud..

[26]  Brad A. Myers,et al.  Six Learning Barriers in End-User Programming Systems , 2004, 2004 IEEE Symposium on Visual Languages - Human Centric Computing.