Let's jam the reactable

There has been little research on how interactions with tabletop and Tangible User Interfaces (TUIs) by groups of users change over time. In this article, we investigate the challenges and opportunities of a tabletop tangible interface based on constructive building blocks. We describe a long-term lab study of groups of expert musicians improvising with the Reactable, a commercial tabletop TUI for music performance. We examine interaction, focusing on interface, tangible, musical, and social phenomena. Our findings reveal a practice-based learning between peers in situated contexts, and new forms of participation, all of which is facilitated by the Reactable's tangible interface, if compared to traditional musical ensembles. We summarise our findings as a set of design considerations and conclude that construction processes on interactive tabletops support learning by doing and peer learning, which can inform constructivist approaches to learning with technology.

[1]  R. Keith Sawyer,et al.  Group Creativity: Music, Theater, Collaboration , 2003 .

[2]  Yvonne Rogers,et al.  Around the table: are multiple-touch surfaces better than single-touch for children's collaborative interactions? , 2009, CSCL.

[3]  J. Gillon,et al.  Group dynamics , 1996 .

[4]  Sara Price,et al.  Interfering and resolving: How tabletop interaction facilitates co-construction of argumentative knowledge , 2011, Int. J. Comput. Support. Collab. Learn..

[5]  Sergi Jordà,et al.  Dynamic patches for live musical performance , 2004 .

[6]  Frederick A. Seddon,et al.  Modes of communication during jazz improvisation , 2005, British Journal of Music Education.

[7]  Lev Vygotsky.  Mind in society , 1978 .

[8]  Pierre Dillenbourg,et al.  Interactive tabletops in education , 2011, Int. J. Comput. Support. Collab. Learn..

[9]  Kyle Gann,et al.  Silence : lectures and writings , 2011 .

[10]  Michael S. Horn,et al.  Tangible programming and informal science learning: making TUIs work for museums , 2008, IDC.

[11]  Peter Wittenburg,et al.  Annotation by Category: ELAN and ISO DCR , 2008, LREC.

[12]  James Gibson,et al.  Block Jam: A Tangible Interface for Interactive Music , 2003, NIME.

[13]  Karen Littleton,et al.  Issues and techniques for collaborative music making on multi-touch surfaces , 2010 .

[14]  John Rooksby,et al.  Wild in the Laboratory: A Discussion of Plans and Situated Actions , 2013, TCHI.

[15]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[16]  William Day.  The Ends of Improvisation , 2010 .

[17]  湯淺 太一,et al.  20世紀の名著名論:Seymour Papert: Mindstorms:Children Computers and Powerful Ideas Basic Books New York 1980 , 2005 .

[18]  Ingrid T. Monson.  Saying Something: Jazz Improvisation and Interaction , 1997 .

[19]  Roberto Pugliese,et al.  Augmenting human-human interaction in mobile group improvisation , 2012, NIME.

[20]  Pattie Maes,et al.  Siftables: towards sensor network user interfaces , 2007, TEI.

[21]  Michael Gurevich,et al.  Collaborative composition and socially constituted instruments: Ensemble laptop performance through the lens of ethnography , 2012, NIME.

[22]  L. Witmer.  The Montessori Method , 1914, The Psychological clinic.

[23]  Meredith Ringel Morris,et al.  Beyond "social protocols": multi-user coordination policies for co-located groupware , 2004, CSCW.

[24]  Orit Shaer,et al.  G-nome surfer: a tabletop interface for collaborative exploration of genomic data , 2010, CHI.

[25]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[26]  J. Sloboda.  Generative Processes in Music: The Psychology of Performance, Improvisation, and Composition , 1985 .

[27]  M. Sheelagh T. Carpendale,et al.  Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits , 2011, CHI.

[28]  Gerald Penn,et al.  Living with a Tabletop: Analysis and Observations of Long Term Office Use of a Multi-Touch Table , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[29]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[30]  Murphy McCaleb.  Embodied knowledge in ensemble performance : the case of informed observation , 2011 .

[31]  Sergi Jordà.  Multi-user Instruments: Models, Examples and Promises , 2005, NIME.

[32]  Bertrand Schneider,et al.  Phylo-Genie: engaging students in collaborative 'tree-thinking' through tabletop techniques , 2012, CHI.

[33]  Michael S. Horn,et al.  Of BATs and APEs: an interactive tabletop game for natural history museums , 2012, CHI.

[34]  Mitchel Resnick,et al.  Extending tangible interfaces for education: digital montessori-inspired manipulatives , 2005, CHI.

[35]  Yvonne Rogers,et al.  Rethinking 'multi-user': an in-the-wild study of how groups approach a walk-up-and-use tabletop interface , 2011, CHI.

[36]  Miller Puckette,et al.  Max at Seventeen , 2002, Computer Music Journal.

[37]  Ben Swift,et al.  Becoming-sound: affect and assemblage in improvisational digital music making , 2012, CHI.

[38]  Elise van den Hoven,et al.  Exploring How Tangible Tools Enable Collaboration in a Multi-touch Tabletop Game , 2011, INTERACT.

[39]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[40]  Yvonne Rogers,et al.  Fighting for control: children's embodied interactions when using physical and digital representations , 2009, CHI.

[41]  Alexander Refsum Jensenius,et al.  Musical Gestures: concepts and methods in research , 2010 .

[42]  Xiang Cao,et al.  Telling the whole story: anticipation, inspiration and reputation in a field deployment of TellTable , 2010, CSCW '10.

[43]  J. Cole,et al.  Enacting Intersubjectivity: A Cognitive and Social Perspective on the Study of Interactions , 2008 .

[44]  Nick Bryan-Kinns,et al.  Inter-Play : Understanding Group Music Improvisation as a Form of Everyday Interaction , 2005 .

[45]  Michael S. Horn,et al.  It's just a toolbar!: using tangibles to help children manage conflict around a multi-touch tabletop , 2010, TEI.

[46]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[47]  Anne Marie Piper,et al.  Tabletop displays for small group study: affordances of paper and digital materials , 2009, CHI.

[48]  Nick Bryan-Kinns,et al.  Hey Man, You're Invading my Personal Space ! Privacy and Awareness in Collaborative Music , 2010, NIME.

[49]  Frank O'Malley,et al.  The Education of Man , 1944, The Review of Politics.

[50]  Gil Weinberg,et al.  Interconnected Musical Networks: Toward a Theoretical Framework , 2005, Computer Music Journal.

[51]  Peter Manuel.  Improvisation in Latin Dance Music: History and style , 1998 .

[52]  Robert A. Moog,et al.  Voltage Controlled Electronic Music Modules , 1964 .

[53]  Sergi Jordà,et al.  Digital Instruments and Players: Part II-Diversity, Freedom and Control , 2004, ICMC.

[54]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[55]  Yvonne Rogers,et al.  Collaboration and interference: awareness with mice or touch input , 2008, CSCW.

[56]  M. Sheelagh T. Carpendale,et al.  Theory of Tabletop Territoriality , 2010, Tabletops.

[57]  Derek Bailey.  Improvisation: Its nature and practice in music , 1980 .

[58]  Allan Kuchinsky,et al.  Video-as-data: Technical and social aspects of a collaborative multimedia application , 1995, Computer Supported Cooperative Work (CSCW).

[59]  J. Roschelle.  Learning by Collaborating: Convergent Conceptual Change , 1992 .

[60]  Pierre Dillenbourg,et al.  Paper-based concept map: the effects of tabletop on an expressive collaborative learning task , 2009, BCS HCI.

[61]  Paul Marshall,et al.  Beyond one-size-fits-all: how interactive tabletops support collaborative learning , 2011, IDC.

[62]  Tina Blaine,et al.  Contexts of Collaborative Musical Experiences , 2003, NIME.

[63]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[64]  Nick Bryan-Kinns,et al.  Mutual engagement and collocation with shared representations , 2013, Int. J. Hum. Comput. Stud..

[65]  John A. Sloboda,et al.  The role of practice in the development of performing musicians , 1996 .

[66]  Jeff Pressing,et al.  Improvisation: Methods and models. , 1988 .

[67]  Sergi Jordà,et al.  On stage: the reactable and other musical tangibles go real , 2008, Int. J. Arts Technol..

[68]  Eva Hornecker,et al.  “I don’t understand it either, but it is cool” - visitor interactions with a multi-touch table in a museum , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[69]  Peter E. Keller,et al.  Joint action in music performance , 2008 .

[70]  Bruno Nettl,et al.  In the course of performance : studies in the world of musical improvisation , 1999 .

[71]  Jonathan Grudin,et al.  Groupware and social dynamics: eight challenges for developers , 1994, CACM.

[72]  Fabio Pianesi,et al.  The role of psychological ownership and ownership markers in collaborative working environment , 2006, ICMI '06.

[73]  Jeff Pressing,et al.  Cognitive Processes in Improvisation , 1984 .

[74]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[75]  音樂學系.  Improvisation: , 2018, The Poem Electric.

[76]  Satoshi Kawase.  An Exploratory Study of Gazing Behavior During Live Performance , 2009 .

[77]  James McCartney,et al.  Rethinking the Computer Music Language: SuperCollider , 2002, Computer Music Journal.

[78]  Emma Mercier,et al.  Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review , 2011, Int. J. Comput. Support. Collab. Learn..

[79]  M. Cole,et al.  Mind in society: The development of higher psychological processes. L. S. Vygotsky. , 1978 .