Multimedia and Hypermedia technologies can be successfully used in education and rehabilitation for cognitively disabled persons. In particular, storytelling has always proved successfully in creating imaginary worlds that could both protect the child from the difficulties of the outer world and create the conditions to feed new stimuli without causing discomfort. However, traditional storytelling techniques (paper, pencil, the voice of the teacher) sometimes might be vastly improved by using multimedia and hypermedia technologies. The possibility to play different music, to explore spatialized sounds, to record sounds and voices, and the opportunity to play with 3D images within a 3D space using devices as simple as touch screens, may ensure an enhanced level of attention from the children and may give to the teacher new and powerful tools to convey his/her message through the common activity. In this paper we motivate the use of hypermedia educational techniques with cognitively impaired children, outlining the general requirements of an educational framework that might be provided to teachers. We then describe the functioning of a prototype we developed following these requirements, MINUS-TWO: a storytelling environment mainly characterized by a strict cooperation between the child and the teacher or the therapist, by multimodal interaction, sound spatialization and 3D representation. The paper also presents the results we obtained by using these techniques with more than twenty cognitively impaired children.
[1]
J D Woolley,et al.
The developing mind.
,
1993,
Science.
[2]
M. Minsky.
The Society of Mind
,
1986
.
[3]
G. Reeke.
Marvin Minsky, The Society of Mind
,
1991,
Artif. Intell..
[4]
S. Tetzchner,et al.
Augmentative and alternative communication : European perspectives
,
1996
.
[5]
C. L. M..
The Psychology of Attention
,
1890,
Nature.
[6]
C. Shewan,et al.
Augmentative and Alternative Communication
,
2020,
Encyclopedia of Education and Information Technologies.
[7]
Daniel J. Siegel,et al.
The developing mind
,
2001
.
[8]
Bernard Debarbieux,et al.
Non lieux [Auge M. (1992). Non-lieux, Introduction à une anthropologie de la surmodernité. Paris : Seuil.]
,
1993
.
[9]
Thimoty Barbieri.
Networked virtual environments for the Web: the WebTalk-I and WebTalk-II architectures
,
2000,
2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).
[10]
M. Augé.
Non-lieux : introduction à une anthropologie de la surmodernité
,
1992
.
[11]
L. Sbattella,et al.
Virtual Sounds and Virtual Spaces to support persons with cognitive and physical disabilities during Information Retrieval, Rehabilitation and Learning
,
2003
.
[12]
H. Pashler,et al.
The Psychology of Attention
,
2000
.