Aerial tunes: exploring interaction qualities of mid-air displays

New types of interfaces are emerging in the form of shape changing and mid-air interfaces. However, little is known about how such interfaces are experienced and explored over time. This paper presents Aerial Tunes, a collaborative, tangible interface, based on balls hovering in mid-air, which can be manipulated individually, or collaboratively to explore and experiment with an ambient soundscape. We describe the design of Aerial Tunes and the technical challenges in constructing the prototype, Aerial Tunes exemplify how systems can be designed to support aesthetic experiences and promote enjoyment and excitement through a seemingly magical and unstable display, supporting explorative and tangible interaction coupled with sound feedback. Based on a four-week field study of the prototype at a public main library, we report how people experienced, investigated, interpreted and explored this interface. We describe the design intentions and qualities, which served to invite for exploration and resulted in multiple and diverse interpretations.

[1]  Wendy E. Mackay,et al.  Triangulation within and across HCI disciplines , 1999 .

[2]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[3]  Tony P. Pridmore,et al.  Deception and magic in collaborative interaction , 2010, CHI.

[4]  Bruce Tog Tognazzini,et al.  Principles, techniques, and ethics of stage magic and their application to human interface design , 1993, INTERCHI.

[5]  Ismo Rakkolainen,et al.  Mid-air displays enabling novel user interfaces , 2008, SAME '08.

[6]  Ivan Poupyrev,et al.  Augmented Groove: Collaborative Jamming in Augmented Reality , 2000, SIGGRAPH 2000.

[7]  Hiroshi Ishii,et al.  ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation , 2011, UIST.

[8]  Tina Blaine,et al.  Contexts of Collaborative Musical Experiences , 2003, NIME.

[9]  Tomoko Yonezawa,et al.  Tangible Sound: Musical Instrument Using Fluid Media , 2000, ICMC.

[10]  Alex Pentland,et al.  Augmented Performance in Dance and Theater , 1999 .

[11]  Stephan Wensveen,et al.  Augmenting fun and beauty: a pamphlet , 2000, DARE '00.

[12]  Steve Benford,et al.  Designing the spectator experience , 2005, CHI.

[13]  Miguel Bruns Alonso,et al.  MusicCube: making digital music tangible , 2005, CHI EA '05.

[14]  Anna Xambó,et al.  TOUCHtr4ck: democratic collaborative music , 2011, Tangible and Embedded Interaction.

[15]  Ben Matthews,et al.  Easy doesn’t do it: skill and expression in tangible aesthetics , 2007, Personal and Ubiquitous Computing.

[16]  Jay Lee,et al.  Bottles as a minimal interface to access digital information , 2001, CHI Extended Abstracts.

[17]  Markus Bischof,et al.  Xenakis: combining tangible interaction with probability-based musical composition , 2008, Tangible and Embedded Interaction.

[18]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.

[19]  Lisa E. Szechter,et al.  Gravitating toward science: Parent–child interactions at a gravitational‐wave observatory , 2009 .

[20]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[21]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[22]  Martin Ludvigsen,et al.  Aesthetic interaction: a pragmatist's aesthetics of interactive systems , 2004, DIS '04.

[23]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[24]  Joseph A. Paradiso,et al.  Tangible Music Interfaces using Passive Magnetic Tags , 2001, NIME.

[25]  Jean Vanderdonckt,et al.  AudioCubes: a distributed cube tangible interface based on interaction range for sound design , 2008, Tangible and Embedded Interaction.

[26]  Yvonne Rogers,et al.  Moving on from Weiser's Vision of Calm Computing: Engaging UbiComp Experiences , 2006, UbiComp.

[27]  Caroline Hummels,et al.  ISH and the search for resonant tangible interaction , 2004, Personal and Ubiquitous Computing.

[28]  Dominique Robson.  PLAY!: Sound Toys for Non-Musicians , 2002, Computer Music Journal.

[29]  William W. Gaver,et al.  Design: Cultural probes , 1999, INTR.

[30]  Robert J. K. Jacob,et al.  Introduction to special issue on the aesthetics of interaction , 2008, TCHI.

[31]  Phoebe Sengers,et al.  Staying open to interpretation: engaging multiple meanings in design and evaluation , 2006, DIS '06.

[32]  Dag Svanæs,et al.  In search of metaphors for tangible user intefaces , 2000, DARE '00.

[33]  James Gibson,et al.  Block Jam: A Tangible Interface for Interactive Music , 2003, NIME.

[34]  Kasper Hornbæk,et al.  mixiTUI: a tangible sequencer for electronic live performances , 2009, Tangible and Embedded Interaction.

[35]  Sergi Jordà,et al.  A system for collaborative music composition over the web , 2001, 12th International Workshop on Database and Expert Systems Applications.

[36]  Karen Littleton,et al.  Issues and techniques for collaborative music making on multi-touch surfaces , 2010 .

[37]  Gunnar Kramp,et al.  LinkLights: a modular, user adaptable system to support rehabilitation practices , 2011, PETRA '11.