WhammyPhone: Exploring Tangible Audio Manipulation Using Bend Input on a Flexible Smartphone

We present WhammyPhone, a novel audio interface that supports physical manipulation of digital audio through bend gestures. WhammyPhone combines a high-resolution flexible display, bend sensors, and a set of intuitive interaction techniques that enable novice users to manipulate sound in a tangible fashion. With WhammyPhone, bend gestures can control both discrete (e.g. triggering a note) and continuous parameters (e.g. pitch bend). We showcase application scenarios that leverage the unique input modalities of WhammyPhone and discuss its potential for digital audio manipulation.

[1]  Roel Vertegaal,et al.  PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays , 2011, CHI.

[2]  Adrian Freed,et al.  Colocated surface sound interaction , 2013, CHI Extended Abstracts.

[3]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[4]  HolmanDavid,et al.  Organic user interfaces , 2008 .

[5]  Roel Vertegaal,et al.  BendFlip: Examining Input Techniques for Electronic Book Readers with Flexible Form Factors , 2011, INTERACT.

[6]  Paulo Blikstein,et al.  BeatTable: a tangible approach to rhythms and ratios , 2013, IDC.

[7]  Kasper Hornbæk,et al.  Deformable Interfaces for Performing Music , 2015, CHI.

[8]  Ivan Poupyrev,et al.  New interfaces for musical expression , 2001, CHI Extended Abstracts.

[9]  Luke Dahl,et al.  The WaveSaw: a flexible instrument for direct timbral manipulation , 2007, NIME '07.

[10]  Jean Vanderdonckt,et al.  AudioCubes: a distributed cube tangible interface based on interaction range for sound design , 2008, Tangible and Embedded Interaction.

[11]  Alexander Refsum Jensenius,et al.  SIG NIME: music, technology, and human-computer interaction , 2013, CHI Extended Abstracts.

[12]  Michael J. Lyons,et al.  Creating new interfaces for musical expression: introduction to NIME , 2009, SIGGRAPH '09.

[13]  Vincent Lévesque,et al.  ReFlex: A Flexible Smartphone with Active Haptic Feedback for Bend Input , 2016, TEI.

[14]  Roel Vertegaal,et al.  Organic user interfaces: designing computers in any way, shape, or form , 2007, CACM.