Review of Augmented Paper Systems in Education: An Orchestration Perspective

Augmented paper has been proposed as a way to integrate more easily ICTs in settings like formal education, where paper has a strong presence. However, despite the multiplicity of educational applications using paper-based computing, their deployment in authentic settings is still marginal. To better understand this gap between research proposals and everyday classroom application, we surveyed the field of augmented paper systems applied to education, using the notion of "classroom orchestration" as a conceptual tool to understand its potential for integration in everyday educational practice. Our review organizes and classifies the affordances of these systems, and reveals that comparatively few studies provide evidence about the learning effects of system usage, or perform evaluations in authentic setting conditions. The analysis of those proposals that have performed authentic evaluations reveals how paper based-systems can accommodate a variety of contextual constraints and pedagogical approaches, but also highlights the need for further longitudinal, in-the-wild studies, and the existence of design tensions that make the conception, implementation and appropriation of this kind of systems still challenging.

[1]  Katrien Verbert,et al.  D1.1 The STELLAR vision and strategy statement , 2010 .

[2]  Yang Liu,et al.  QOOK: enhancing information revisitation for active reading with a paper book , 2014, TEI '14.

[3]  Scott R. Klemmer,et al.  Classroom Studies of Augmented Notebook Usage Informing the Design of Sharing Mechanisms , 2007 .

[4]  Alejandra Martínez-Monés,et al.  Deploying learning designs across physical and web spaces: Making pervasive learning affordable for teachers , 2014, Pervasive Mob. Comput..

[5]  Pierre Tchounikine,et al.  Scripting and Orchestration: Recent Theoretical Advances , 2013, CSCL.

[6]  Pierre Dillenbourg,et al.  Designing augmented reality for the classroom , 2013, Comput. Educ..

[7]  Bertrand Schneider,et al.  Benefits of a Tangible Interface for Collaborative Learning and Interaction , 2011, IEEE Transactions on Learning Technologies.

[8]  Steve Benford,et al.  Proceedings of the Eighth European Conference on Computer Supported Cooperative Work (ECSCW 2003) , 2003 .

[9]  Sébastien Cuendet Tangible Interfaces for Learning , 2013 .

[10]  Fotis Liarokapis,et al.  Using Augmented Reality as a Medium to Assist Teaching in Higher Education , 2010, Eurographics.

[11]  Andrés Lucero,et al.  The magic wand: enriching shared storybook reading , 2008 .

[12]  Eden Ashley Umble Making it real: the future of stereoscopic 3D film technology , 2006, COMG.

[13]  Miguel Nussbaum,et al.  Classroom logistics: Integrating digital and non-digital resources , 2013, Comput. Educ..

[14]  Max Mühlhäuser,et al.  CoScribe: Integrating Paper and Digital Documents for Collaborative Knowledge Work , 2009, IEEE Transactions on Learning Technologies.

[15]  Beat Signer,et al.  PaperPoint: a paper-based presentation and interactive paper prototyping tool , 2007, Tangible and Embedded Interaction.

[16]  Quentin Bonnard,et al.  Paper Interfaces: an HCI Approach to Geometry Education , 2012 .

[17]  Nian-Shing Chen,et al.  Enhancing English Reading Comprehension by Integrating Direct Access to Digital Materials and Scaffolded Questionings in Paper Prints , 2011, 2011 IEEE 11th International Conference on Advanced Learning Technologies.

[18]  Christian Heath,et al.  Swiping paper: the second hand, mundane artifacts, gesture and collaboration , 2010, Personal and Ubiquitous Computing.

[19]  Danae Stanton Fraser,et al.  Literature Review in Learning with Tangible Technologies , 2004 .

[20]  Charles Hannon Paper-Based Computing , 2008 .

[21]  Raija H. Hämäläinen,et al.  Theoretical and Pedagogical Perspectives on Orchestrating Creativity and Collaborative Learning. , 2011 .

[22]  Télécom Paristech What do U-Note ? An Augmented Note Taking System for the Classroom , 2010 .

[23]  Pierre Dillenbourg,et al.  The Evolution of Research on Computer-Supported Collaborative Learning , 2009 .

[24]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[25]  Timothy K. Shih,et al.  Ubiquitous e-Learning With Multimodal Multimedia Devices , 2007, IEEE Transactions on Multimedia.

[26]  Jiao Jian-li Literature Review in Learning with Tangible Technologies , 2008 .

[27]  Lenh Hung Son Do Supporting Reflection and Classroom Orchestration with Tangible Tabletops , 2012 .

[28]  Beat Signer,et al.  Augmented Paper: Developing Relationships Between Digital Content and Paper , 2007, The Disappearing Computer.

[29]  Mark Billinghurst,et al.  The design of a mixed-reality book: Is it still a real book? , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[30]  Woontack Woo,et al.  Digilog book for temple bell tolling experience based on interactive augmented reality , 2011, Virtual Reality.

[31]  Mårten Pettersson,et al.  Augmenting Pen and Paper to Support Creative Collaboration in Design Education , 2007 .

[32]  M. Bannert,et al.  Game Based Learning , 2008 .

[33]  Carrie Heeter,et al.  Technology-Enhanced Learning , 2000 .

[34]  Mark Billinghurst,et al.  Augmented Reality in the Classroom , 2012, Computer.

[35]  Patrick Olivier,et al.  The ReflecTable: Bridging the Gap between Theory and Practice in Design Education , 2013, INTERACT.

[36]  Yanjie Song,et al.  Orchestration in a networked classroom: Where the teacher's real-time enactment matters , 2013, Comput. Educ..

[37]  Richard J. Anderson,et al.  PaperCP: Exploring the Integration of Physical and Digital Affordances for Active Learning , 2007, INTERACT.

[38]  Hirokazu Kato,et al.  Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation , 2014, IEEE Transactions on Learning Technologies.

[39]  Mike Sharples,et al.  Shared orchestration within and beyond the classroom , 2013, Comput. Educ..

[40]  J. D. Fletcher,et al.  Game-Based Learning , 2014 .

[41]  Motoki Miura,et al.  Augmented Collaborative Card-Based Creative Activity with Digital Pens , 2009, HCI.

[42]  Steffi Beckhaus,et al.  The card box at hand: exploring the potentials of a paper-based tangible interface for education and research in art history , 2007, Tangible and Embedded Interaction.

[43]  Madeline Balaam A Part Practical and Part Conceptual Response to Orchestration , 2013, Comput. Educ..

[44]  Ramana Rao,et al.  Bridging the paper and electronic worlds: the paper user interface , 1993, INTERCHI.

[45]  Rosemary Luckin,et al.  “Making it real”: exploring the potential of augmented reality for teaching primary school science , 2006, Virtual Reality.

[46]  Frank Fischer,et al.  Orchestration is nothing without conducting - But arranging ties the two together!: A response to Dillenbourg (2011) , 2013, Comput. Educ..

[47]  Heinz Ulrich Hoppe,et al.  Classroom orchestration: Synthesis , 2013, Comput. Educ..

[48]  Pierre Dillenbourg,et al.  Design for classroom orchestration , 2013, Comput. Educ..

[49]  Deborah G. Tatar,et al.  The Design Tensions Framework , 2007, Hum. Comput. Interact..

[50]  Carol K. K. Chan Bridging research and practice: Implementing and sustaining knowledge building in Hong Kong classrooms , 2011, Int. J. Comput. Support. Collab. Learn..

[51]  Antonis A. Argyros,et al.  Augmented reality interactive exhibits in Cartographic Heritage: An implemented case-study open to the general public , 2011 .

[52]  Pierre Tchounikine,et al.  Clarifying design for orchestration: Orchestration and orchestrable technology, scripting and conducting , 2013, Comput. Educ..

[53]  P. Twining Oversold and underused: computers in the classroom , 2002 .

[54]  Mahmoud Abdulwahed,et al.  Orchestrating technology enhanced learning: a literature review and a conceptual framework , 2011 .

[55]  Patrick Jermann,et al.  Classroom orchestration: The third circle of usability , 2011, CSCL.

[56]  Scott R. Klemmer,et al.  Toolkit Support for Integrating Physical and Digital Interactions , 2009, Hum. Comput. Interact..

[57]  Michael Eisenberg,et al.  Easigami: a reconfigurable folded-sheet TUI , 2009, TEI.

[58]  Cheolil Lim,et al.  Exploring the Educational Use of an Augmented Reality Books , 2012 .

[59]  Jürgen Steimle Pen-and-Paper User Interfaces - Integrating Printed and Digital Documents , 2012, Human-Computer Interaction Series.

[60]  Po-Yao Chao,et al.  Augmenting Traditional Books with Context-Aware Learning Supports from Online Learning Communities , 2008, J. Educ. Technol. Soc..

[61]  Mariano Alcañiz Raya,et al.  Design and validation of an augmented book for spatial abilities development in engineering students , 2010, Comput. Graph..

[62]  Gudrun Klinker,et al.  Proceedings of the international workshop on Augmented reality : placing artificial objects in real scenes: placing artificial objects in real scenes , 1999 .

[63]  Yoneo Yano,et al.  Paper-top interface for supporting note-taking and its preliminary experiment , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[64]  Cheolil Lim,et al.  Exploring the Educational Use of an Augmented Reality (AR) Book , 2011 .

[65]  James A. Hendler,et al.  Physical programming: tools for kindergarten children to author physical interactive environments , 2003 .

[66]  Chin-Chung Tsai,et al.  Affordances of Augmented Reality in Science Learning: Suggestions for Future Research , 2012, Journal of Science Education and Technology.

[67]  Wendy E. Mackay,et al.  Designing interactive paper: lessons from three augmented reality projects , 1998 .

[68]  Keechul Jung,et al.  Advanced Documents Authoring Tool , 2005, CIVR.

[69]  Massimo Zancanaro,et al.  Audio-augmented paper for therapy and educational intervention for children with autistic spectrum disorder , 2014, Int. J. Hum. Comput. Stud..

[70]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[71]  Jin Won Choi A Technological Review To Develop An Ar-Based Design Supporting System , 2009 .

[72]  Michael S. Horn,et al.  Translating Roberto to Omar: computational literacy, stickerbooks, and cultural forms , 2013, IDC.

[73]  Po-Yao Chao,et al.  The Interactive Multimedia Textbook: Using A Digital Pen to Support Learning for Computer Programming , 2007, Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007).

[74]  Te-Hua Wang,et al.  A SCORM Compliant Courseware Authoring Tool for Supporting Pervasive Learning , 2007, Int. J. Distance Educ. Technol..

[75]  Marcelo Milrad,et al.  Collboard: Fostering new media literacies in the classroom through collaborative problem solving supported by digital pens and interactive whiteboards , 2013, Comput. Educ..

[76]  John R. Wilson,et al.  Mixed reality storytelling environments , 2003, Virtual Reality.

[77]  Gudrun Klinker,et al.  Augmented Reality : Placing Artificial Objects in Real Scenes , 1999 .

[78]  Pan Hui,et al.  Mobile augmented reality survey: a bottom-up approach , 2013, ArXiv.

[79]  Pattie Maes,et al.  Glassified: an augmented ruler based on a transparent display for real-time interactions with paper , 2013, UIST '13 Adjunct.

[80]  Christine Reid,et al.  The Myth of the Paperless Office , 2003, J. Documentation.

[81]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.