Semiotic-based Conceptual Modelling of Hypermedia

We address the conceptual modelling of hypermedia regarded as semiotic texts, whose meanings are conceived by a designer, transferred through the artifact and interpreted by users within their context. We outline the communication framework, with the artifact embedding the images of the designer and user. The full model is represented in terms of four interrelated modules: story, discourse, text and social-relational ontologies. The first and second one account for the narrative structures underlying the hypermedia content, which is externalized through sensorial qualities that, in turn, evoke impressions into the user. The model addresses issues that are poorly covered by the description standard MPEG-7. It can be used for analysis, evaluation, indexing of existing hypermedia as well as the design of new ones.

[1]  M. Bernstein,et al.  Reading Hypertext , 2009 .

[2]  John C. McCarthy,et al.  Aesthetics and experience-centered design , 2008, TCHI.

[3]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[4]  J. Russell.  A circumplex model of affect. , 1980 .

[5]  P. Desmet,et al.  Appraisal Patterns of Emotions in Human-Product Interaction , 2009 .

[6]  Dick C. A. Bulterman,et al.  The Amsterdam hypermedia model: adding time and context to the Dexter model , 1994, CACM.

[7]  Merlijn Kouprie,et al.  A framework for empathy in design: stepping into and out of the user's life , 2009 .

[8]  P. John Clarkson,et al.  Representing Artefacts as Media: Modelling the Relationship Between Designer Intent and Consumer Experience , 2008 .

[9]  Elzbieta T. Kazmierczak.  Design as Meaning Making: From Making Things to the Design of Thinking , 2003, Design Issues.

[10]  N. Lowe,et al.  The Classical Plot and the Invention of Western Narrative: A cognitive model , 2000 .

[11]  Richard Buchanan,et al.  Declaration by Design: Rhetoric, Argument, and Demonstration in Design Practice , 1985 .

[12]  Fernando Pereira,et al.  MPEG-7 the generic multimedia content description standard, part 1 - Multimedia, IEEE , 2001 .

[13]  Marc Hassenzahl,et al.  The Semantics of Fun: Differentiating Enjoyable Eeperiences , 2005, Funology.

[14]  Richard Bartle.  Presence and Flow: Ill-Fitting Clothes for Virtual Worlds , 2007 .

[15]  Youn-kyung Lim,et al.  Interactivity Attributes for Expression-oriented Interaction Design , 2011 .

[16]  Jane Hunter,et al.  Adding Multimedia to the SemanticWeb: Building and Applying an MPEG-7 Ontology , 2005, Multimedia Content and the Semantic Web.

[17]  Clarisse Sieckenius de Souza,et al.  The Semiotic Engineering of Human-Computer Interaction , 2005 .

[18]  Paul Hekkert,et al.  10 – PRODUCT AESTHETICS , 2008 .

[19]  Hendrik N.J. Schifferstein,et al.  INTRODUCING PRODUCT EXPERIENCE , 2008 .

[20]  J.M. Martinez,et al.  Standards - MPEG-7 overview of MPEG-7 description tools, part 2 , 2002, IEEE MultiMedia.

[21]  Philippe Salembier,et al.  Description of a Single Multimedia Document , 2002 .

[22]  José M. Martínez.  Standards - MPEG-7 overview of MPEG-7 description tools, part 2 , 2002 .

[23]  Theo van Leeuwen,et al.  Reading Images: The Grammar of Visual Design , 1996 .

[24]  Vito Roberto,et al.  Semiotic design and analysis of hypermedia , 2009, HT '09.

[25]  Paloma Díaz,et al.  A Framework for the Analysis and Comparison of Hypermedia Design Methods , 2003, Applied Informatics.

[26]  P. Hekkert.  Design aesthetics: principles of pleasure in design , 2006 .

[27]  P. Desmet,et al.  Framework of product experience , 2007 .

[28]  Peter C. Wright,et al.  Funology: from usability to enjoyment , 2005 .

[29]  Aldo Gangemi,et al.  Task taxonomies for knowledge content , 2004 .