Multimedia design: the effects of relating multimodal information

Few models describe learner behaviour during the simultaneous processing of several types of information, yet this is the defining characteristic of the use of multimedia tools, which bring together media in different informational formats (fixed or moving images, sound, text). Following studies in cognitive psychology concerning the increase in the ability to form mental images of words, this study was aimed at defining how different multimedia presentation modes affect the learning of foreign language vocabulary (Russian). A statistically significant effect was observed on word memorisation in the different information presentation modes, suggesting better processing when there is co-referencing of the different sources, especially when the encoding and tests modes are the same. In addition to these experimental results, some principles for the design of multimodal learning tools are discussed.

[1]  H. Simon,et al.  Invariants of human behavior. , 1990, Annual review of psychology.

[2]  R. Shepard.  Recognition memory for words, sentences, and pictures , 1967 .

[3]  S. Kosslyn,et al.  Individual differences in mental imagery ability: A computational analysis , 1984, Cognition.

[4]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[5]  P. Chandler,et al.  Cognitive load as a factor in the structuring of technical material. , 1990 .

[6]  S. Kosslyn,et al.  Components of high-level vision: A cognitive neuroscience analysis and accounts of neurological syndromes , 1990, Cognition.

[7]  William Epstein,et al.  Meaning and familiarity in associative learning. , 1960 .

[8]  A. Paivio,et al.  Why are pictures easier to recall than words? , 1968 .

[9]  Allan Paivio,et al.  Short-term sequential memory for pictures and words , 1971 .

[10]  R. Mayer,et al.  For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. , 1994 .

[11]  Michael Pressley,et al.  Children's Use of the Keyword Method to Learn Simple Spanish Vocabulary Words. , 1977 .

[12]  Norbert M. Seel,et al.  2 Presentation of Information by Media and its Effect on Mental Models , 1989 .

[13]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[14]  A. Paivio.  Imagery and verbal processes , 1972 .

[15]  A. Paivio.  Mental imagery in associative learning and memory , 1969 .

[16]  Valérie Gyselinck.  Illustrations et modèles mentaux dans la compréhension de textes , 1996 .

[17]  G. Bower.  Imagery as a relational organizer in associative learning , 1970 .

[18]  Paul Fraisse,et al.  Influence du codage visuel de phrases sur leur mémorisation à court terme , 1975 .

[19]  J. Sweller,et al.  Reducing cognitive load by mixing auditory and visual presentation modes , 1995 .

[20]  P. Fraisse,et al.  [Genetic study of the memorization of words and pictures]. , 1965, Canadian journal of psychology.

[21]  G. Bower,et al.  Comprehension and memory for pictures , 1975, Memory & cognition.

[22]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[23]  R. Atkinson,et al.  An Application of the Mnemonic Keyword Method to the Acquisition of a Russian Vocabulary. Psychology and Education Series, Technical Report No. 237. , 1974 .

[24]  G. Bower,et al.  Depth of processing pictures of faces and recognition memory , 1974 .