An interactive augmented reality coloring book

Creating entertaining and educational books not only requires providing visually stimulating content but also means for students to interact, create, and express themselves. In this paper we present a new type of mixed-reality book experience, which augments an educational coloring book with user-generated three dimensional content. We explore a “pop-up book” metaphor and describe a process by which children's drawing and coloring is used as input to generate and change the appearance of the book content. Our system is based on natural feature tracking and image processing techniques that can be easily exploited for other AR publishing applications.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Ivan Poupyrev,et al.  MagicBook: transitioning between reality and virtuality , 2001, CHI Extended Abstracts.

[3]  Mark Billinghurst,et al.  The mixed reality book: a new multimedia reading experience , 2007, CHI Extended Abstracts.

[4]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[5]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[6]  A. Dunser,et al.  An interactive augmented reality coloring book , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  James C. Lester,et al.  The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedagogical Agents? , 2001 .

[9]  Woontack Woo,et al.  Digilog book for temple bell tolling experience based on interactive augmented reality , 2011, Virtual Reality.

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  R.N. Grant,et al.  Perspective correction for improved visual registration using natural features. , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[12]  Fan Xiao,et al.  What is the best fiducial? , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[13]  Masa Inakage,et al.  Little red: storytelling in mixed reality , 2003, SIGGRAPH '03.

[14]  Eva Hornecker,et al.  An Observational Study of Children Interacting with an Augmented Story Book , 2007, Edutainment.

[15]  R. Mayer,et al.  Role of guidance, reflection, and interactivity in an agent-based multimedia game , 2005 .

[16]  Vincent Lepetit,et al.  The haunted book , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[17]  Mark Fiala,et al.  Comparing ARTag and ARToolkit Plus fiducial marker systems , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[18]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.