"What's Happening at that Hip?": Evaluating an On-body Projection based Augmented Reality System for Physiotherapy Classroom

We present two studies to discuss the design, usability analysis, and educational outcome resulting from our system Augmented Body in physiotherapy classroom. We build on prior user-centric design work that investigates existing teaching methods and discuss opportunities for intervention. We present the design and implementation of a hybrid system for physiotherapy education combining an on-body projection based virtual anatomy supplemented by pen-based tablets to create real-time annotations. We conducted a usability evaluation of this system, comparing with projection only and traditional teaching conditions. Finally, we focus on a comparative study to evaluate learning outcome among students in actual classroom settings. Our studies showed increased usage of visual representation techniques in students'11 note taking behavior and statistically significant improvement in some learning aspects. We discuss challenges for designing augmented reality systems for education, including minimizing attention split, addressing text-entry issues, and digital annotations on a moving physical body.

[1]  S. Vandenberg,et al.  Mental Rotations, a Group Test of Three-Dimensional Spatial Visualization , 1978, Perceptual and motor skills.

[2]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[3]  Jonathan Stephen Fish,et al.  Amplifying the Mind’s Eye: Sketching and Visual Cognition , 1990 .

[4]  Steven K. Feiner,et al.  Hybrid user interfaces: breeding virtually bigger interfaces for physically smaller computers , 1991, UIST '91.

[5]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[6]  T. Perneger.  What's wrong with Bonferroni adjustments , 1998, BMJ.

[7]  Dieter Schmalstieg,et al.  A Hybrid User Interface for Manipulation of Volumetric Medical Data , 2006, 3D User Interfaces (3DUI'06).

[8]  Sharon L. Oviatt,et al.  Human-centered design meets cognitive load theory: designing interfaces that help people think , 2006, MM '06.

[9]  Dorian Gorgan,et al.  Pen Based Graphical Annotation in Medical Education , 2007, Twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS'07).

[10]  P. McMenamin.  Body painting as a tool in clinical anatomy teaching , 2008, Anatomical sciences education.

[11]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[12]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[13]  Iulian Radu,et al.  Augmented reality in education: a meta-review and cross-media analysis , 2014, Personal and Ubiquitous Computing.

[14]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[15]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[16]  Chris Dede,et al.  Augmented Reality Teaching and Learning , 2014 .

[17]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[18]  Artur Ryt,et al.  Range of Motion Measurements Using Motion Capture Data and Augmented Reality Visualisation , 2014, ICCVG.

[19]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[20]  Voicu Popescu,et al.  Virtual annotations of the surgical field through an augmented reality transparent display , 2016, The Visual Computer.

[21]  Sangtae Ha,et al.  Automatically Freezing Live Video for Annotation during Remote Collaboration , 2015, CHI Extended Abstracts.

[22]  Murat Akçayır,et al.  Advantages and challenges associated with augmented reality for education: A systematic review of the literature , 2017 .

[23]  Niels De Ruiter,et al.  A Hybrid 2D/3D User Interface for Radiological Diagnosis , 2018, Journal of Digital Imaging.

[24]  Frank Vetere,et al.  Augmented Studio: Projection Mapping on Moving Body for Physiotherapy Education , 2017, CHI.

[25]  Frank Vetere,et al.  Body as a Canvas: An Exploration on the Role of the Body as Display of Digital Information , 2018, Conference on Designing Interactive Systems.