Intermodulation: Improvisation and Collaborative Art Practice for HCI

This paper integrates theory, ethnography, and collaborative artwork to explore improvisational activity as both topic and tool of multidisciplinary HCI inquiry. Building on theories of improvisation drawn from art, music, HCI and social science, and two ethnographic studies based on interviews, participant observation and collaborative art practice, we seek to elucidate the improvisational nature of practice in both art and ordinary action, including human-computer interaction. We identify five key features of improvisational action -- reflexivity, transgression, tension, listening, and interdependence -- and show how these can deepen and extend both linear and open-ended methodologies in HCI and design. We conclude by highlighting collaborative engagement based on 'intermodulation' as a tool of multidisciplinary inquiry for HCI research and design.

[1]  Laewoo Kang,et al.  Intermodulator: Interactive Audio-visual System for Collaborative Improvisation , 2018, CHI Extended Abstracts.

[2]  Laewoo Kang Echo(): Listening to the Reflection of Obsolete Technology , 2017, Conference on Designing Interactive Systems.

[3]  Dan Crowe,et al.  Kaufman, Scott Barry and Carolyn Gregoire. Wired to Create: Unraveling the Mysteries of the Creative Mind , 2017 .

[4]  Kim Halskov,et al.  Documenting the Research Through Design Process , 2016, Conference on Designing Interactive Systems.

[5]  A. Baki Kocaballi,et al.  Performative Photography as an Ideation Method , 2016, Conference on Designing Interactive Systems.

[6]  Laewoo Kang Breaking AndyWall: Transgressive and Playful Exploration on the Dynamic Role of Users in Art and Design , 2016, CHI Extended Abstracts.

[7]  Peter Dalsgaard,et al.  Experimental Systems in Research through Design , 2016, CHI.

[8]  Richard Banks,et al.  From Research Prototype to Research Product , 2016, CHI.

[9]  J. Bodor,et al.  Zen for Film , 2016 .

[10]  George E. Lewis,et al.  The Oxford handbook of critical improvisation studies , 2016 .

[11]  George E. Lewis,et al.  The Oxford Handbook of Critical Improvisation Studies, Volume 1 , 2016 .

[12]  Shaowen Bardzell,et al.  Immodest Proposals: Research Through Design and Knowledge , 2015, CHI.

[13]  Kristina Höök,et al.  Knowledge Production in Interaction Design , 2015, CHI Extended Abstracts.

[14]  Phoebe Sengers,et al.  Constructing and constraining participation in participatory arts and HCI , 2015, Int. J. Hum. Comput. Stud..

[15]  Jonathan Hook,et al.  HCI: human-computer improvisation , 2014, DIS Companion '14.

[16]  Estelle Barrett,et al.  Practice as Research: Approaches to Creative Arts Enquiry , 2014 .

[17]  Steven J. Jackson,et al.  Breakdown, obsolescence and reuse: HCI and the art of repair , 2014, CHI.

[18]  Stefan Rennick Egglestone,et al.  Performance-Led Research in the Wild , 2013, TCHI.

[19]  L. Connelly Grounded theory. , 2013, Medsurg nursing : official journal of the Academy of Medical-Surgical Nurses.

[20]  D. Norman The Design of Everyday Things: Revised and Expanded Edition , 2013 .

[21]  Jonathan Hook,et al.  Exploring HCI's relationship with liveness , 2012, CHI EA '12.

[22]  William W. Gaver What should we expect from research through design? , 2012, CHI.

[23]  William W. Gaver,et al.  Annotated portfolios , 2012, INTR.

[24]  Matt Ratto,et al.  Critical Making: Conceptual and Material Studies in Technology and Social Life , 2011, Inf. Soc..

[25]  Kazuhiro Jo,et al.  ParticipArt: Exploring participation in interactive art installations , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[26]  John Zimmerman,et al.  An analysis and critique of Research through Design: towards a formalization of a research approach , 2010, Conference on Designing Interactive Systems.

[27]  Guy Hoffman,et al.  Gesture-based human-robot Jazz improvisation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[28]  S. McAndrew Method meets art: Arts‐based research practice , 2010 .

[29]  Matthew D. Thibeault,et al.  Plans, Takes, and Mis-takes , 2008, Outlines. Critical Practice Studies.

[30]  Gerhard Fischer,et al.  Creativity and evolution: a metadesign perspective , 2008, Digit. Creativity.

[31]  Gottschewski Hermann 음악연주에서의 "준비"와 "즉흥" , 2007 .

[32]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[33]  Elizabeth Gerber,et al.  Improvisation principles and techniques for design , 2007, CHI.

[34]  Elisa Giaccardi,et al.  About face interface: creative engagement in the new media arts and HCI , 2006, CHI EA '06.

[35]  R. Sawyer,et al.  Group creativity: musical performance and collaboration , 2006 .

[36]  Ernest A. Edmonds,et al.  The studio as laboratory: Combining creative practice and digital technology research , 2005, Int. J. Hum. Comput. Stud..

[37]  John C. McCarthy,et al.  Technology as experience , 2004, INTR.

[38]  M. Katritzky Improvisation in the Arts of the Middle Ages and Renaissance , 2003 .

[39]  Ernest A. Edmonds,et al.  Creativity, art practice, and knowledge , 2002, CACM.

[40]  Christina Goulding,et al.  Grounded theory , 2015 .

[41]  Jeff Pressing,et al.  IMPROVISATION : METHODS AND MODELS to appear in : Generative processes in music , 2002 .

[42]  R. Keith Sawyer,et al.  Improvisation and the creative process : Dewey, collingwood, and the aesthetics of spontaneity , 2000 .

[43]  B. C. Smith,et al.  Organising User Interfaces Around Reflective Accounts , 1998 .

[44]  P. Agre Computation and human experience , 1997 .

[45]  P. Berliner Thinking in Jazz: The Infinite Art of Improvisation , 1995 .

[46]  Jean-Gabriel Ganascia,et al.  Simulating Creativity in Jazz Performance , 1994, AAAI.

[47]  Francis Rumsey,et al.  Sound and recording: An introduction , 1992 .

[48]  T. P. Hughes,et al.  The Social Construction of Technological Systems: New Directions in the Sociology and History of Technology , 1989 .

[49]  David Chapman,et al.  Pengi: An Implementation of a Theory of Activity , 1987, AAAI.

[50]  L. Suchman Plans and situated actions , 1987 .

[51]  Pengi: lementation of a Theory of Activity , 1987 .

[52]  Don Koberg,et al.  The all new universal traveler : a soft-systems guide to creativity, problem-solving, and the process of reaching goals , 1981 .

[53]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .