Jabberstamp: embedding sound and voice in traditional drawings

We introduce Jabberstamp, the first tool that allows children to synthesize their drawings and voices. To use Jabberstamp, children create drawings, collages or paintings on normal paper. They press a special rubber stamp onto the page to record sounds into their drawings. When children touch the marks of the stamp with a small trumpet, they can hear the sounds playback, retelling the stories they created. We describe our design process and analyze the mechanism between the act of drawing and the one of telling, defining interdependencies between the two activities. In a series of studies, children ages 4--8 use Jabberstamp to convey meaning in their drawings. The system allows collaboration among peers at different developmental levels. Jabberstamp compositions reveal children's narrative styles and their planning strategies. In guided activities, children develop stories by situating sound recording in their drawing, which suggests future opportunities for hybrid voice-visual tools to support children's emergent literacy.

[1]  Lisa Stifelman,et al.  Augmenting real-world objects: a paper-based audio notebook , 1996, CHI Conference Companion.

[2]  Tristan Jehan,et al.  Dolltalk: a computational toy to enhance children's creativity , 2002, CHI Extended Abstracts.

[3]  Mike Ananny,et al.  Supporting children's collaborative authoring: practicing written literacy while composing oral texts , 2002, CSCL.

[4]  Michael F. Graves,et al.  Teaching Reading in the 21st Century , 1998 .

[5]  M. Cole,et al.  Mind in society: The development of higher psychological processes. L. S. Vygotsky. , 1978 .

[6]  Hiroshi Ishii,et al.  I/O brush: drawing with everyday objects as ink , 2004, CHI.

[7]  Catherine E. Snow,et al.  Preventing reading difficulties in young children , 1998 .

[8]  Allison Druin,et al.  KidPad: collaborative storytelling for children , 2002, CHI Extended Abstracts.

[9]  C. Snow Literacy and Language: Relationships during the Preschool Years , 1983 .

[10]  Michael F. Graves,et al.  Teaching Reading in the 21st Century (with Assessments and Lesson Plans Booklet) (4th Edition) , 2006 .

[11]  Lars Erik Holmquist,et al.  Every Object Tells a Story : Physical Interfaces for Digital Storytelling , .

[12]  Maria Montessori,et al.  The Secret of Childhood , 1945 .

[13]  Michael Cole,et al.  THE DEVELOPMENT OF CHILDREN. , 1925, Science.

[14]  Dennis R. Wixon,et al.  CHI '02 Extended Abstracts on Human Factors in Computing Systems , 2002, CHI 2002.

[15]  Alan C. Kay A Personal Computer for Children of All Ages , 1972, ACM Annual Conference.

[16]  Justine Cassell,et al.  Making Space for Voice: Technologies to Support Children’s Fantasy and Storytelling , 2001, Personal and Ubiquitous Computing.

[17]  J. Bruner Toward a Theory of Instruction , 1966 .