Exploring Eyes-free Interaction with Wrist-Worn Deformable Materials

Recent work has explored how on-the-wrist devices can be augmented with displays, sensors, and aesthetics to produce a new genre of wearable, digital jewelry. Most often, these devices are augmented with hardware (e.g., touch-screens, gyroscopes) to receive wearer input. Breakthroughs in sensing materials allow novel inputs such as squeeze, bend, and stretch, which may be more suited to interaction with a discreet wearable. We explore interactions with a flexible bracelet that can be manipulated through bend, stretch, and touch. We discuss the process involved in fabricating materials that convert these actions into measurable parameters. We particularly focus on eyes-free interactions with bracelets that take advantage of the tactile feedback from the act of deformation, and demonstrate some early, low-fidelity prototype concepts.

[1]  Brian Byunghyun Kang,et al.  Development of a polymer-based tendon-driven wearable robotic hand , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Xu Jia,et al.  How users manipulate deformable displays as input devices , 2010, CHI.

[3]  Ian Oakley,et al.  Designing Eyes-Free Interaction , 2007, HAID.

[4]  Roel Vertegaal,et al.  Sensing touch using resistive graphs , 2014, Conference on Designing Interactive Systems.

[5]  Roel Vertegaal,et al.  With a flick of the wrist: stretch sensors as lightweight input for mobile devices , 2012, Tangible and Embedded Interaction.

[6]  김보아,et al.  How Users Manipulate Deformable Displays as Input Devices , 2011 .

[7]  Audrey Girouard,et al.  Fabricating Bendy: Design and Development of Deformable Prototypes , 2014, IEEE Pervasive Computing.

[8]  Rahim Mutlu,et al.  Fabrication and characterisation of highly stretchable elastomeric strain sensors for prosthetic hand applications , 2016 .

[9]  Vuokko Lantz,et al.  Squeezy bracelet: designing a wearable communication device for tactile interaction , 2014, NordiCHI.

[10]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[11]  Roel Vertegaal,et al.  Evaluating effects of structural holds on pointing and dragging performance with flexible displays , 2011, CHI.

[12]  Wendy E. Mackay,et al.  Stretchis: Fabricating Highly Stretchable User Interfaces , 2016, UIST.

[13]  Sean White,et al.  Facet: a multi-segment wrist worn system , 2012, UIST.

[14]  Hyung-Soon Park,et al.  Thumb joint angle estimation for soft wearable hand robotic devices , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[15]  G. Tröster,et al.  Sensor for Measuring Strain in Textile , 2008, Sensors.

[16]  Junichiro Makino,et al.  4.45 Pflops astrophysical N-body simulation on K computer -- The gravitational trillion-body problem , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[17]  Sylvain Bouchigny,et al.  Exploring Interactions with a Flexible Tactile Device for Multi-Context Interaction , 2016, CHI Extended Abstracts.

[18]  Ross T. Smith,et al.  Passive Deformable Haptic glove to support 3D interactions in mobile augmented reality environments , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[19]  Roel Vertegaal,et al.  HoloFlex: A Flexible Holographic Smartphone with Bend Input , 2016, CHI Extended Abstracts.

[20]  Julia Seiter,et al.  Getting dressed in tech , 2013, XRDS.

[21]  Yuta Sugiura,et al.  A thin stretchable interface for tangential force measurement , 2012, UIST.

[22]  Tong Zhang,et al.  A flexible pressure-sensitive array based on soft substrate , 2015 .

[23]  Cameron S. Miner,et al.  Digital jewelry: wearable technology for everyday life , 2001, CHI Extended Abstracts.

[24]  Roel Vertegaal,et al.  Snaplet: using body shape to inform function in mobile flexible display devices , 2011, CHI Extended Abstracts.

[25]  Li-Wei Chan,et al.  FlexiBend: Enabling Interactivity of Multi-Part, Deformable Fabrications Using Single Shape-Sensing Strip , 2015, UIST.

[26]  James R. Eagan,et al.  Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets , 2013, CHI.

[27]  Susanne Boll,et al.  Tangible Apps Bracelet: Designing Modular Wrist-Worn Digital Jewellery for Multiple Purposes , 2016, Conference on Designing Interactive Systems.