Paper-based multimedia interaction and disabled children: from experience to learning-for-all

The work reported in this paper is part of larger research, exploring tangible technology to support cognitive, motor and emotional development of severely disabled children in the school context. We designed novel technology enhanced experiences that are both low cost and easily customisable, combine visual communication paradigms with multimedia tangible interaction and promote a wide spectrum of learning benefits. Paper-based elements (PCS cards, drawings, pictures) are associated with multimedia resources (videos, sounds, animations) via RFID technology to create playful interactive spaces customised to the specific learning needs of each disabled child. Paper-based elements work as visual representations for the concepts to be learnt, as communication devices, and as physical affordances for interacting with multimedia resources. The paper presents the approach and its evaluation in a real school context. It highlights the benefits for disabled children as well as for their non-disabled classmates, and pinpoints how the project became a means for real inclusive education.

[1]  Yvonne Rogers,et al.  Using 'tangibles' to promote novel forms of playful learning , 2003, Interact. Comput..

[2]  Franca Garzotto,et al.  A Critical Perspective on Design Patterns for E-Learning , 2008 .

[3]  Caroline Hummels,et al.  The Development of LinguaBytes: An Interactive Tangible Play and Learning System to Stimulate the Language Development of Toddlers with Multiple Disabilities , 2008, Adv. Hum. Comput. Interact..

[4]  Paul Marshall,et al.  Tangibles for children,: the challenges , 2009, CHI Extended Abstracts.

[5]  Gregg Rothermel,et al.  End-user software engineering , 2004, Commun. ACM.

[6]  Franca Garzotto,et al.  Broadening children's involvement as design partners: from technology to , 2008, IDC.

[7]  D. Beukelman,et al.  Augmentative & Alternative Communication: Supporting Children & Adults With Complex Communication Needs , 2006 .

[8]  Jan O. Borchers A pattern approach to interaction design , 2001, DIS '00.

[9]  Tony P. Pridmore,et al.  Classroom collaboration in the design of tangible interfaces for storytelling , 2001, CHI.

[10]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[11]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[12]  B. Bederson,et al.  Designing storytelling technologies to encouraging collaboration between young children , 2000, CHI.

[13]  Justine Cassell,et al.  Making Space for Voice: Technologies to Support Children’s Fantasy and Storytelling , 2001, Personal and Ubiquitous Computing.

[14]  Robert N.F. Conway,et al.  Inclusive education: The way to the future , 2010 .

[15]  Caroline Hummels,et al.  Tangibles for toddlers learning language , 2009, TEI.

[16]  Jim Budd,et al.  PageCraft: learning in context a tangible interactive storytelling platform to support early narrative development for young children , 2007, IDC.

[17]  Allison Druin,et al.  Designing with and for children with special needs: an inclusionary model , 2008, IDC.

[18]  Barry Harper,et al.  Handbook of Research on Learning Design and Learning Objects: Issues, Applications and Technologies , 2008 .

[19]  James A. Hendler,et al.  Designing StoryRooms: interactive storytelling spaces for children , 2000, DIS '00.

[20]  Alan F. Blackwell,et al.  Teaching rhetorical skills with a tangible user interface , 2004, IDC '04.

[21]  Gillian R. Hayes,et al.  Mocotos: mobile communications tools for children with special needs , 2008, IDC.

[22]  Alissa Nicole Antle,et al.  Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces , 2008, TEI.

[23]  James D. Hollan,et al.  KidPad: a design collaboration between children, technologists, and educators , 1997, CHI.

[24]  Erner Grimm,et al.  Little Red Cap , 1964 .

[25]  Martyn Barrett The Development of Language , 2000 .

[26]  Mitchel Resnick,et al.  Some reflections on designing construction kits for kids , 2005, IDC '05.

[27]  Christopher Alexander,et al.  The Timeless Way of Building , 1979 .

[28]  Paul Marshall,et al.  Do tangible interfaces enhance learning? , 2007, TEI.

[29]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[30]  Jettie Hoonhout,et al.  TagTiles: optimal challenge in educational electronics , 2007, TEI.

[31]  Anthony J. Hornof Designing with children with severe motor impairments , 2009, CHI.

[32]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .