HandLog: a deformable tangible device for continuous input through finger flexion

We introduce HandLog, a novel handheld interaction device that supports single handed deformation through finger flexion as a continuous digital input. It consists of a 3D printed core inserted within a foam sleeve embedded with conductive foam columns. By measuring resistance changes across the columns during deformation, whole hand or individual finger flexion motions can be mapped to digital data in real-time. We conducted a user study that demonstrated the successful use of the device for game input. The results indicated that users could quickly become competent with the device and that when compared with discrete controls its supported interactions created a more engaging experience. HandLog has great potential for other application domains, including hand exercise for rehabilitation and handheld controllers for smart homes in ubiquitous computing.

[1]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[2]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[3]  M. Latash,et al.  Force sharing among fingers as a model of the redundancy problem , 1998, Experimental Brain Research.

[4]  Pierre Dragicevic,et al.  Tangible remote controllers for wall-size displays , 2012, CHI.

[5]  Pramod Kumar,et al.  SOFTii: Soft Tangible Interface for Continuous Control of Virtual Objects with Pressure-based Input , 2015, TEI.

[6]  Meredith Ringel Morris,et al.  iStuff: a physical user interface toolkit for ubiquitous computing environments , 2003, CHI '03.

[7]  F. R. Wilson.  The Hand: How Its Use Shapes the Brain, Language, and Human Culture , 1998 .

[8]  Hiroshi Ishii,et al.  mediaBlocks: physical containers, transports, and controls for online media , 1998, SIGGRAPH.

[9]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[10]  Ross T. Smith,et al.  Digital foam interaction techniques for 3D modeling , 2008, VRST '08.

[11]  Luc Geurts,et al.  Skweezee-Mote: A Case-Study of a Gesture-Based Tangible Product Design for a Television Remote Control , 2015 .

[12]  Pattie Maes,et al.  WUW - wear Ur world: a wearable gestural interface , 2009, CHI Extended Abstracts.

[13]  Ross T. Smith,et al.  Passive Deformable Haptic glove to support 3D interactions in mobile augmented reality environments , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[14]  Johan Kildal,et al.  Interacting with Deformable User Interfaces: Effect of Material Stiffness and Type of Deformation Gesture , 2012, HAID.

[15]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[16]  Jan O. Borchers,et al.  Pinstripe: eyes-free continuous input on interactive clothing , 2011, CHI.

[17]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[18]  Luc Geurts,et al.  Empowering Occupational Therapists with a DIY-toolkit for Smart Soft Objects , 2015, TEI.

[19]  Tamotsu Murakami,et al.  Direct and intuitive input device for 3-D shape deformation , 1994, CHI '94.

[20]  Hiroshi Ishii,et al.  Tangible User Interfaces , 2006 .

[21]  Ross T. Smith,et al.  Tech Note: Digital Foam , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[22]  Edward H. Adelson,et al.  deForm: an interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch , 2011, UIST.

[23]  HolmanDavid,et al.  Organic user interfaces , 2008 .

[24]  Luc Geurts,et al.  The skweezee system: enabling the design and the programming of squeeze interactions , 2013, UIST.

[25]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[26]  Gazihan Alankus,et al.  Stroke Therapy through Motion-Based Games: A Case Study , 2010, TACC.

[27]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[28]  Alan F. Blackwell,et al.  Using solid diagrams for tangible interface prototyping , 2005, IEEE Pervasive Comput..

[29]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[30]  Hiroshi Ishii,et al.  Sensetable: a wireless object tracking platform for tangible user interfaces , 2001, CHI.