Theoretical foundations for experiential systems design

As multimedia researchers analyze and design "experiential systems' there is a pressing need to place that work on a solid theoretical foundation. Without careful analysis of the objects and methods, terminology, and conceptual frameworks of experiential systems design, misconceptions about what experiences are and how they can be computationally addressed can allow research to proceed in less fruitful directions. This paper addresses core theoretical issues in experiential systems design about the nature of experience, especially the distinction between data which can be represented computationally and experiences which are internal mental events We draw from theoretical work in the humanities that addresses models of human communication and meaning creation, the philosophical investigation of the structures of lived experience (phenomenology), and the application of that philosophical method to understanding the forms and functions of mediated experience (aesthetics). Phenomenology and aesthetics form a theoretical foundation for reassessing the limits and possibilities of computationally modeling and shaping experiences. Radically interdisciplinary work is required that truly integrates technical and humanistic research in order to design experiential systems.

[1]  Michael J. Reddy.  Metaphor and Thought: The conduit metaphor: A case of frame conflict in our language about language , 1993 .

[2]  Marc Davis,et al.  A Brief Overview of the Narrative Intelligence Reading Group , 2003 .

[3]  A. Bazin,et al.  What is cinema , 1967 .

[4]  Terry Winograd,et al.  Understanding computers and cognition - a new foundation for design , 1987 .

[5]  Steven J. Mailloux,et al.  Reader Response Criticism , 1977 .

[6]  Ramesh C. Jain.  Experiential computing , 2003, CACM.

[7]  W. Iser.  The Reading Process: A Phenomenological Approach , 1972 .

[8]  James Joyce,et al.  Reader-Response Criticism and “The Dead” , 1994 .

[9]  Maurice Merleau-Ponty.  Phenomenology of Perception , 1964 .

[10]  W. Iser,et al.  The Act of Reading: A Theory of Aesthetic Response , 1979 .

[11]  S. Eisenstein,et al.  The Film Sense , 1942 .

[12]  David Bordwell.  Narration in the Fiction Film , 1985 .

[13]  Deborah L. Vroman.  The Johns Hopkins Guide to Literary Theory and Criticism , 1999 .

[14]  F. Varela,et al.  CHAPTER NINE The Specious Present: A Neurophenomenology of Time Consciousness , 2000, Naturalizing Phenomenology.

[15]  Ferdinand de Saussure.  Course in General Linguistics , 1916 .

[16]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[17]  S. Eisenstein,et al.  Film Form: Essays in Film Theory , 1949 .

[18]  L. Manovich,et al.  The language of new media , 2001 .

[19]  W. Iser.  The act of reading : a theory of aesthetic response , 1980 .

[20]  W. Iser,et al.  The Implied Reader: Patterns of Communication in Prose Fiction from Bunyan to Beckett , 1975 .

[21]  Michael Groden,et al.  The Johns Hopkins Guide to Literary Theory and Criticism , 1996 .