The reification of metaphor as a design tool

Despite causing many debates in human-computer interaction (HCI), the term “metaphor” remains a central element of design practice. This article investigates the history of ideas behind user-interface (UI) metaphor, not only technical developments, but also less familiar perspectives from education, philosophy, and the sociology of science. The historical analysis is complemented by a study of attitudes toward metaphor among HCI researchers 30 years later. Working from these two streams of evidence, we find new insights into the way that theories in HCI are related to interface design, and offer recommendations regarding approaches to future UI design research.

[1]  Kentaro Go,et al.  The blind men and the elephant: views of scenario-based system design , 2004, INTR.

[2]  Lucy Anne Wozny,et al.  The Application of Metaphor, Analogy, and Conceptual Models in Computer Systems , 1989, Interact. Comput..

[3]  Stuart Card,et al.  User technology—from pointing to pondering , 1986, HPW '86.

[4]  David Benyon,et al.  Designing with Blends , 2007 .

[5]  William L. Bewley,et al.  Human factors testing in the design of Xerox's 8010 “Star” office workstation , 1983, CHI '83.

[6]  D. Holland,et al.  Cultural models in language and thought: An appraisal , 1987 .

[7]  Peter P. Chen,et al.  Entity-Relationship Modeling : Historical Events , Future Trends , and Lessons Learned , 2002 .

[8]  Mark J. Conversino.  The Spectacle of Flight: Aviation and the Western Imagination, 1920-1950 , 2007 .

[9]  D. Davidson.  Inquiries Into Truth and Interpretation , 1984 .

[10]  Theo Mandel,et al.  The Elements of User Interface Design , 1997 .

[11]  Dag Svanæs,et al.  In search of metaphors for tangible user intefaces , 2000, DARE '00.

[12]  S. L. Star,et al.  Regions of the Mind: Brain Research and the Quest for Scientific Certainty , 1989 .

[13]  J. Durant,et al.  The public understanding of science , 1989, Nature.

[14]  Susan Weinschenk,et al.  GUI Design Essentials , 1997 .

[15]  Atsushi Shimojima,et al.  Thinking with Diagrams , 2001, Springer Netherlands.

[16]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1899, Outstanding Dissertations in the Computer Sciences.

[17]  R. Coyne.  Designing Information Technology in the Postmodern Age , 1995 .

[18]  John M. Carroll,et al.  Interface metaphors and user interface design , 1988 .

[19]  G. Fauconnier.  Mappings in thought and language , 1997 .

[20]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[21]  Wilbert O. Galitz,et al.  The Essential Guide to User Interface Design , 2002 .

[22]  Steven Levy.  Insanely Great: The Life and Times of Macintosh, the Computer that Changed Everything , 1994 .

[23]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[24]  Mary Beth Rosson,et al.  Reducing manual labor: An experimental analysis of learning aids for a text editor , 1982, CHI '82.

[25]  J. Rassmusen,et al.  Information Processing and Human - Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[26]  Richard M. Young,et al.  The Machine Inside the Machine: Users' Models of Pocket Calculators , 1981, Int. J. Man Mach. Stud..

[27]  Richard E. Mayer,et al.  A psychology of learning BASIC , 1979, CACM.

[28]  Alan Cooper,et al.  About Face: The Essentials of User Interface Design , 1995 .

[29]  Yu-chen Hsu,et al.  The effects of metaphors on novice and expert learners' performance and mental-model development , 2006, Interact. Comput..

[30]  Eric Harslem,et al.  The star user interface: an overview , 1899, AFIPS '82.

[31]  Peggy Aldrich Kidwell.  Insanely Great, The Life and Times of Macintosh, the Computer that Changed Everything [Reviews] , 1995, IEEE Annals of the History of Computing.

[32]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[33]  Gerald J. Johnson,et al.  Of metaphor and the difficulty of computer discourse , 1994, CACM.

[34]  R. Hayward.  Metaphors in the history of psychology , 1996, Medical History.

[35]  R. Grice.  Minimalism Beyond the Nurnberg Funnel , 1998 .

[36]  Marcia Hill EdD.  We Can't Afford It: , 1996 .

[37]  E. Roks.  Building a Better Mousetrap , .

[38]  Simone Diniz Junqueira Barbosa,et al.  A Semiotic Framing for End-User Development , 2006, End User Development.

[39]  Jon Oberlander,et al.  A Cognitive Theory of Graphical and Linguistic Reasoning: Logic and Implementation , 1995, Cogn. Sci..

[40]  C. Van Dyke.  Binary jargon: the metaphoric language of computing , 1988, SGCS.

[41]  David Canfield Smith,et al.  Xerox Star live demonstration , 1998, CHI Conference Summary.

[42]  Wilbert O. Galitz,et al.  The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques , 1996 .

[43]  Alan F. Blackwell,et al.  Thinking with Diagrams , 2001 .

[44]  J. Markoff.  What the Dormouse Said: How the 60s Counterculture Shaped the Personal Computer , 2005 .

[45]  Harold Maurice Collins,et al.  The Shape of Actions: What Humans and Machines Can Do , 1998 .

[46]  David Benyon,et al.  Designing with blends - conceptual foundations of human-computer interaction and software engineering , 2006 .

[47]  Frank Ludolph,et al.  Inventing the Lisa user interface , 1997, INTR.

[48]  Harold Maurice Collins,et al.  Science studies and machine intelligence , 1995 .

[49]  D. M. Hutton,et al.  The Essence of Human Computer Interaction , 2000 .

[50]  Robert F. Sproull,et al.  Principles of interactive computer graphics (2nd ed.) , 1979 .

[51]  R. Mayer.  Different problem-solving competencies established in learning computer programming with and without meaningful models. , 1975 .

[52]  Brad A. Myers,et al.  A brief history of human-computer interaction technology , 1998, INTR.

[53]  Mary Czerwinski,et al.  The Task Gallery: a 3D window manager , 2000, CHI.

[54]  S. Joy Mountford,et al.  The Art of Human-Computer Interface Design , 1990 .

[55]  A. Kirman.  User interface: a personal view , 1990 .

[56]  Joanna McGrenere,et al.  Affordances: Clarifying and Evolving a Concep , 2000, Graphics Interface.

[57]  Michael Smyth,et al.  Minimising Conceptual Baggage: Making Choices about Metaphor , 1994, BCS HCI.

[58]  Gregory D. Abowd,et al.  Human-computer interaction (2nd ed.) , 1998 .

[59]  T. Brown.  Metaphor and Thought , 1981 .

[60]  Juliet Sprake.  Death of the designer , 2002 .

[61]  S. Joy Mountford,et al.  Tools and techniques for creative design , 1995 .

[62]  Andy Cockburn,et al.  Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments , 2002, CHI.

[63]  J. C. R. Licklider,et al.  The Computer as a Communication Device , 1968 .

[64]  E. Yalow.  On Educational psychology: A cognitive view. , 1979 .

[65]  Adele Goldberg,et al.  Personal Dynamic Media , 1977, Computer.

[66]  A. A. Bielskis,et al.  Macintosh human interface guidelines , 1992 .

[67]  Joanna McGrenere,et al.  Affordances: Clarifying and Evolving a Concep , 2000, Graphics Interface.

[68]  Walter Guido Vincenti,et al.  What Engineers Know and How They Know It: Analytical Studies from Aeronautical History by Walter G. Vincenti , 1992, Technology and Culture.

[69]  Mark Weiser,et al.  The world is not a desktop , 1994, INTR.

[70]  Dorothy Holland,et al.  Cultural models in language and thought: Reasoning and problem solving from presupposed worlds , 1987 .

[71]  Jakob Nielsen,et al.  The Anti-Mac interface , 1996, CACM.

[72]  M. Black.  More about metaphor , 1977 .

[73]  Kim Halskov,et al.  A guide to metaphorical design , 1994, CACM.

[74]  Michael Smyth,et al.  Metaphor Reflections and a Tool for Thought , 1996, BCS HCI.

[75]  Michael B. Usher,et al.  Science in action , 1993, Nature.

[76]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[77]  Janice Redish,et al.  User and task analysis for interface design , 1998 .

[78]  Pamela Jordan.  Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[79]  S. Ivie,et al.  Models and Metaphors. , 2007 .

[80]  Robert H. McKim,et al.  Experiences in Visual Thinking , 1972 .

[81]  Marcia Hill.  We Can't Afford It: , 1996 .

[82]  Thomas P. Moran,et al.  A methodology for user interface design , 1977 .

[83]  Walter G. Vincenti,et al.  What Engineers Know and How They Know It: Analytical Studies from Aeronautical History. , 1992 .

[84]  S. Turkle,et al.  Epistemological Pluralism and the Revaluation of the Concrete. , 1992 .

[85]  Douglas K. Smith,et al.  Fumbling the Future: How Xerox Invented, Then Ignored, the First Personal Computer , 1988 .

[86]  Mark Treglown,et al.  The role of metaphor in user interface design , 2002 .

[87]  Muna Khalil Yousef.  Assessment of metaphor efficacy in user interfaces for the elderly: a tentative model for enhancing accessibility , 2001, WUAUC'01.

[88]  R. K. Lindsay.  Images and inference , 1988, Cognition.

[89]  D. Krebs.  Computer communication. , 1984, Physical therapy.

[90]  Alan Kay,et al.  The reactive engine , 1969 .

[91]  Ivan E. Sutherland,et al.  Sketchpad a Man-Machine Graphical Communication System , 1964 .

[92]  J. Greeno,et al.  Structural differences between outcomes produced by different instructional methods. , 1972 .

[93]  Christine Faulkner,et al.  The Essence of Human-Computer Interaction , 1997 .

[94]  Ken Mohnkern,et al.  Beyond the interface metaphor , 1997, SGCH.

[95]  J. Grudin,et al.  Design Models for Computer-Human Interfaces , 1996, Computer.

[96]  Nathan Crilly.  Product aesthetics: representing designer intent and consumer response , 2005 .

[97]  Richard Coyne,et al.  Designing Information Technology in the Postmodern Age: From Method to Metaphor , 1995 .

[98]  Thomas P. Moran,et al.  Analogy considered harmful , 1982, CHI '82.

[99]  G. Lakoff.  The Contemporary Theory of Metaphor , 1993 .

[100]  R. S. Woolhouse,et al.  Revolutions and Reconstructions in the Philosophy of Science. , 1981 .

[101]  A letter from Vannevar Bush. , 1971, Bulletin of the New York Academy of Medicine.

[102]  Steven Johnson,et al.  Interface Culture: How New Technology Transforms the Way We Create and Communicate , 1997 .

[103]  D. Gentner,et al.  Flowing waters or teeming crowds: Mental models of electricity , 1982 .

[104]  Dennis Shasha,et al.  Out of Their Minds: The Lives and Discoveries of 15 Great Computer Scientists , 1995 .

[105]  Austin Henderson,et al.  Interaction at Lincoln laboratory in the 1960's: looking forward -- looking back , 2005, CHI EA '05.

[106]  Jonathan Grudin,et al.  Three faces of human-computer interaction , 2005, IEEE Annals of the History of Computing.

[107]  Yuval Shahar,et al.  AsbruView: Capturing Complex, Time-Oriented Plans - Beyond Flow Charts , 2002, Diagrammatic Representation and Reasoning.

[108]  B. Latour.  Science in Action , 1987 .

[109]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[110]  Donald MacKenzie,et al.  Mechanizing Proof: Computing, Risk, and Trust , 2001 .

[111]  Alan F. Blackwell,et al.  Metacognitive theories of visual programming: what do we think we are doing? , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[112]  L. Winner.  The Whale and the Reactor , 2020 .

[113]  Jeff A. Johnson,et al.  The desktop metaphor as an approach to user interface design (panel discussion) , 1985, ACM '85.

[114]  William C. Donelson.  Spatial management of information , 1978, SIGGRAPH.

[115]  William K. Horton,et al.  The Icon Book: Visual Symbols for Computer Systems and Documentation , 1994 .

[116]  Alan F. Blackwell,et al.  Pictorial Representation and Metaphor in Visual Language Design , 2001, J. Vis. Lang. Comput..

[117]  Clarisse Sieckenius de Souza,et al.  The Semiotic Engineering of Human-Computer Interaction , 2005 .

[118]  John Markoff,et al.  What the Dormouse Said: How the Sixties Counterculture Shaped the Personal Computer Industry , 2005 .

[119]  Kim Halskov Madsen,et al.  A guide to metaphorical design , 1994 .

[120]  Gerard Torenvliet.  We can't afford it!: the devaluation of a usability term , 2003, INTR.

[121]  Loren G. Terveen,et al.  Let's Stop Pushing the Envelope and Start Addressing It: A Reference Task Agenda for HCI , 2000, Hum. Comput. Interact..

[122]  Howard Rheingold,et al.  Tools for Thought: The History and Future of Mind-Expanding Technology , 1985 .

[123]  Robert F. Sproull,et al.  Principles in interactive computer graphics , 1973 .

[124]  Donald A. Schön.  Metaphor and Thought: Generative metaphor: A perspective on problem-setting in social policy , 1993 .

[125]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[126]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[127]  R. Rorty.  Contingency, irony, and solidarity: Contents , 1989 .

[128]  Eric Harslem,et al.  Designing the STAR User Interface , 1987, ECICS.

[129]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[130]  Matthias Müller-Prove,et al.  Vision and Reality of Hypertext and Graphical User Interfaces , 2002 .

[131]  Ewan D. Tempero,et al.  Metaphor and Metonymy in Object-Oriented Design Patterns , 2002, ACSC.

[132]  MPhil PhD Linda Candy BA,et al.  Explorations in Art and Technology , 2002, Springer London.

[133]  Klaus B. Bærentsen,et al.  An activity theory approach to affordance , 2002, NordiCHI '02.

[134]  Thomas Erickson,et al.  Working with interface metaphors , 1995 .

[135]  N. Hari Narayanan,et al.  Diagrammatic Reasoning: Cognitive and Computational Perspectives , 1995 .

[136]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[137]  F BlackwellAlan.  The reification of metaphor as a design tool , 2006 .

[138]  Christopher F. Herot,et al.  A prototype Spatial Data Management System , 1980, SIGGRAPH '80.

[139]  Roger M. Keesing.  Models, “folk” and “cultural”: Paradigms regained? , 1987 .

[140]  Rénald Fortier.  Wohl, Robert — The Spectacle of Flight: Aviation and the Western Imagination, 1920–1950 , 2006 .

[141]  Jef Raskin.  Holes in history: a personal perspective on how and why the early history of today's major interface paradigm has been so often misreported , 1994, INTR.

[142]  Alan C. Kay.  The early history of Smalltalk , 1993, HOPL-II.

[143]  M. Black.  Models and metaphors , 1962 .

[144]  Guy R. Lefrançois.  Psychology for teaching : a bear always usually faces the front , 1975 .

[145]  RaskinJef.  Holes in history , 1994 .

[146]  Anselm L. Strauss,et al.  Strauss, Anselm, and Juliet Corbin. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Newbury Park,CA: Sage, 1990. , 1990 .

[147]  Simone Diniz Junqueira Barbosa,et al.  A semiotic engineering approach to user interface design , 2001, Knowl. Based Syst..

[148]  Brian Cantwell Smith,et al.  On the origin of objects , 1997, Trends in Cognitive Sciences.

[149]  Aaron Marcus,et al.  Managing metaphors for advanced user interfaces , 1994, AVI '94.

[150]  Hirotada Ueda,et al.  FRIEND21 project: a construction of 21st century human interface , 1991, CHI.

[151]  David Canfield Smith,et al.  Pygmalion: A COMPUTER PROGRAM TO Model and Stimulate Creative Thought , 1975 .

[152]  S. Vereza.  Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[153]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[154]  Willett Kempton,et al.  Two Theories of Home Heat Control , 1986, Cogn. Sci..

[155]  Jeff A. Johnson,et al.  The Xerox Star: a retrospective , 1989, Computer.

[156]  D. Gentner,et al.  Cultural models in language and thought: How people construct mental models , 1987 .

[157]  D. Norman.  The psychology of everyday things", Basic Books Inc , 1988 .

[158]  D. Ausubel.  The use of advance organizers in the learning and retention of meaningful verbal material. , 1960 .

[159]  Antti Pirhonen,et al.  To simulate or to stimulate? In search of the power of metaphor in design , 2005 .

[160]  N. Presmeg.  The body in the mind: The bodily basis of meaning, imagination and reason , 1992 .

[161]  David Liddle,et al.  Design of the conceptual model , 1996 .

[162]  R. Keesing,et al.  Cultural models in language and thought: Models, “folk” and “cultural” , 1987 .

[163]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[164]  Alan C. Kay.  A Personal Computer for Children of All Ages , 1972, ACM Annual Conference.

[165]  Andreas Dieberger,et al.  A City Metaphor to Support Navigation in Complex Information Spaces , 1997, J. Vis. Lang. Comput..

[166]  R. J. Bogumil,et al.  The reflective practitioner: How professionals think in action , 1985, Proceedings of the IEEE.