Emotional Design for Children's Electronic Picture Book

Picture book is beneficial for children in many ways. In this work, we aim to investigate whether emotional design in an electronic picture book can facilitate children with great multi-sense experience, improve comprehension of children and give children positive emotional experience during reading. We propose a novel PCE (Perception & Comprehension & Expression) model from the perspective of emotional design. First, at the level of perception, it provides interfaces of multi-sensory interaction function. Second, at the level of cognition, it builds some interactive scenes. Third, at the level of expression, it creates some high-level interaction modes based on emotion recognition and emotion feedback. And based on PCE models in practice, we propose an electronic interactive picture book for children (5–8 years old), named E-book. In user study, it is proved that, added emotional design, the electronic picture can not only bring children excellent sensory experience in reading, but also help children get better understanding about the context. Furthermore, it gives children pleasant emotional interaction.

[1]  Barbara A. Wasik,et al.  Book reading and vocabulary development: A systematic review , 2016 .

[2]  Cynthia R. Smith,et al.  Click and Turn the Page: An Exploration of Multiple Storybook Literacy , 2001 .

[3]  David Reinking,et al.  Me and My Hypertext:) A Multiple Digression Analysis of Technology and Literacy (sic). , 1997 .

[4]  Wei Chen,et al.  Emphasis Detection for Voice Dialogue Applications Using Multi-channel Convolutional Bidirectional Long Short-Term Memory Network , 2018, 2018 11th International Symposium on Chinese Spoken Language Processing (ISCSLP).

[5]  Linda D. Labbo,et al.  Weaving Chains of Affect and Cognition: A Young Child's Understanding of CD-ROM Talking Books , 2000 .

[6]  Eunjoon Rachel Um,et al.  Emotional design in multimedia learning. , 2012 .

[7]  B. Fredrickson,et al.  Positive Emotions Trigger Upward Spirals Toward Emotional Well-Being , 2002, Psychological science.

[8]  William Lidwell,et al.  Universal principles of design : 100 ways to enhance usability,influence perception, increase appeal, make better, designdecisions, and teach through design , 2003 .

[9]  Adriana G. Bus,et al.  Quality of book-reading matters for emergent readers: An experiment with the same book in a regular or electronic format , 2002 .

[10]  L PlassJan,et al.  Emotional design and positive emotions in multimedia learning , 2015 .

[11]  Thomas K.F. Chiu,et al.  Emotional Multimedia Design for Developing Mathematical Problem-Solving Skills , 2017 .

[12]  Min-Ju Tsai Guiding Taiwanese kindergarteners' emotional understanding and emotion regulation: The effects of children's picture books , 2008 .

[13]  A. Bus,et al.  The efficacy of electronic books in fostering kindergarten children's emergent story understanding , 2004 .

[14]  Rory T. Devine,et al.  A Social Perspective on Theory of Mind , 2015 .

[15]  R. Mayer,et al.  A coherence effect in multimedia learning: The case for minimizing irrelevant sounds in the design of multimedia instructional messages. , 2000 .

[16]  Jan L. Plass,et al.  Emotional Design in Digital Media for Learning , 2016 .

[17]  R. Mayer,et al.  Benefits of emotional design in multimedia instruction , 2014 .

[18]  Richard J. Shavelson,et al.  Scientific Culture and Educational Research , 2002 .

[19]  A. Fiore,et al.  Influences of online store perception, shopping enjoyment, and shopping involvement on consumer patronage behavior towards an online retailer☆ , 2007 .

[20]  Elizabeth O. Hayward,et al.  Emotional design in multimedia learning: Effects of shape and color on affect and learning , 2014 .

[21]  Traci Sitzmann,et al.  The paradox of seduction by irrelevant details: How irrelevant information helps and hinders self-regulated learning , 2014 .

[22]  Elisabeth André,et al.  Full Body Gestures Enhancing a Game Book for Interactive Story Telling , 2011, ICIDS.

[23]  Bernard L. Hayes,et al.  Interactive Fiction and the Reluctant Reader , 1988 .

[24]  Xiang Li,et al.  IcooBook: When the Picture Book for Children Encounters Aesthetics of Interaction , 2018, ACM Multimedia.

[25]  Elizabeth Sulzby,et al.  Children's emergent reading of favorite storybooks: A developmental study. , 1985 .

[26]  Nelson Zagalo,et al.  Bridging book: a not-so-electronic children's picturebook , 2013, IDC.

[27]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[28]  Anke Königschulte,et al.  Sound as Affective Design Feature in Multimedia Learning--Benefits and Drawbacks from a Cognitive Load Theory Perspective. , 2015 .

[29]  Susanne Bødker,et al.  When second wave HCI meets third wave challenges , 2006, NordiCHI '06.

[30]  Roland Brünken,et al.  Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms , 2015, Comput. Educ..

[31]  W. Doise The social development of the intellect , 1984 .

[32]  Donald A. Norman,et al.  Emotional design , 2004, UBIQ.