Body as a Canvas: An Exploration on the Role of the Body as Display of Digital Information

Human body in HCI is often seen as an actuator for issuing commands and providing input to digital systems. We present the concept of the body as a canvas, in which the body acts as both an actuator and a display for information. Body as a canvas creates an interaction loop where interaction with information causes changes in the body, which in turn changes the display of information. Our qualitative study using an on-body projection system in a public exhibition investigates this concept with regards to body characteristics, types of body input, interactions between multiple bodies, and comparison to other display technologies. Our findings show that body as a canvas create connectedness between the body and information. Finally, we discuss how body characteristics and appearances can complement the information, when the body acts as a canvas.

[1]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[2]  David England.  Whole Body Interaction: An Introduction , 2011, Whole Body Interaction.

[3]  Toni Robertson,et al.  Moving and making strange: An embodied approach to movement-based interaction design , 2013, TCHI.

[4]  Aaron Levisohn.  The body as a medium: reassessing the role of kinesthetic awareness in interactive applications , 2007, ACM Multimedia.

[5]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[6]  Marianne Raynaud.  Pattie Maes on unveiling the "Sixth Sense", game-changing wearable tech (8:29) , 2009 .

[7]  Tom Tullis,et al.  Measuring the User Experience, Second Edition: Collecting, Analyzing, and Presenting Usability Metrics , 2013 .

[8]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[9]  Nassir Navab,et al.  mirracle: An augmented reality magic mirror system for anatomy education , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[10]  Xu Jia,et al.  How users manipulate deformable displays as input devices , 2010, CHI.

[11]  Dwight Conquergood,et al.  Rethinking ethnography: Towards a critical cultural politics , 1991 .

[12]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[13]  Mamiko Sakata,et al.  Human Body as the Medium in Dance Movement , 2004, Int. J. Hum. Comput. Interact..

[14]  Desney S. Tan,et al.  Skinput: appropriating the body as an input surface , 2010, CHI.

[15]  Frank Vetere,et al.  Onebody: Remote Posture Guidance System using First Person View in Virtual Environment , 2016, NordiCHI.

[16]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[17]  Suranga Nanayakkara,et al.  SPARSH: passing data using the body as a medium , 2011, CSCW '11.

[18]  Divya Sharma,et al.  Body area networks: A survey , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[19]  Richard Martin,et al.  Design for wearability , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[20]  Yvonne Rogers,et al.  MagicFace: Stepping into Character through an Augmented Reality Mirror , 2017, CHI.

[21]  Pedro Lopes,et al.  Proprioceptive Interaction , 2015, CHI.

[22]  Paul Dourish,et al.  Where the action is , 2001 .

[23]  Yu Sun,et al.  Spatial Augmented Reality on Person: Exploring the Most Personal Medium , 2013, HCI.

[24]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[25]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[26]  Yuta Sugiura,et al.  EarTouch: turning the ear into an input surface , 2017, MobileHCI.

[27]  N. D. Durie,et al.  Digest of papers , 1976 .

[28]  Woontack Woo,et al.  Mirror Mirror: An On-Body T-shirt Design System , 2016, CHI.

[29]  Frank Vetere,et al.  Augmented Studio: Projection Mapping on Moving Body for Physiotherapy Education , 2017, CHI.

[30]  Pattie Maes,et al.  WUW - wear Ur world: a wearable gestural interface , 2009, CHI Extended Abstracts.

[31]  Maud Marchal,et al.  The Mind-Mirror: See your brain in action in your head using EEG and augmented reality , 2014, 2014 IEEE Virtual Reality (VR).