Ecologically grounded multimodal design: The Palafito 1.0 study

We present results of a ten-month design study targeting the observation of creative artistic practice by a video-ar­ tist, a sculptor and a composer. The study yielded the multimedia installation Palafito/Palafita/Home-on-stilts 1.0, featuring 19:30 minutes of sonic material and video footage, and three 5x8x3-meter raw-wood sculptures. This paper focuses on the procedural dimensions of the asynchronous, ubiquitous group activities carried out by the three subjects through light-weight, off-the-shelf in­ frastructure. Data was extracted from a virtual forum and a file repository. The analysis of the creative exchange in­ dicated cycles of activity alternating between reflection, exploratory action and product-oriented action. The parti­ cipants were engaged in reflective activities 63% of the time, epistemic activities spanned 33% of the study and product-oriented activities accounted for only 4% of the creative design cycle. Dialogic activities did not follow a regular pattern, but a relationship between enactive and dialogic activities was observed. We discuss the implica­ tions of these results for embedded-embodied approaches to sound art.

[1]  Raymond Erickson.  Music Analysis and the Computer , 1968 .

[2]  Damián Keller,et al.  Urban Corridor: Accumulation and Interaction as Form-Bearing Process , 2002, ICMC.

[3]  Damián Keller,et al.  New concepts and techniques in eco-composition , 2006, Organised Sound.

[4]  P. Cisek.  BEYOND THE COMPUTER METAPHOR: BEHAVIOR AS INTERACTION , 1999 .

[5]  Ron Wakkary,et al.  A sustainable identity: the creativity of an everyday designer , 2009, CHI.

[6]  Andrea Botero,et al.  Expanding Design Space : Design-In-Use Activities and Strategies , 2010 .

[7]  David Collins.  A synthesis process model of creative thinking in music composition , 2005 .

[8]  Damin Keller,et al.  Compositional Processes from an Ecological Perspective , 2000, Leonardo Music Journal.

[9]  A. Costall,et al.  Socializing Affordances , 1995 .

[10]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[11]  Paul P. Maglio,et al.  On Distinguishing Epistemic from Pragmatic Action , 1994, Cogn. Sci..

[12]  W. Davis.  The Ecological Approach to Visual Perception , 2012 .

[13]  Marcelo Soares Pimenta,et al.  Principles for Music Creation by Novices in Networked Music Environments , 2011 .

[14]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[15]  Damián Keller,et al.  Ecologically-based Granular Synthesis , 1998, ICMC.

[16]  Matthew Burtner,et al.  EcoSono: Adventures in interactive ecoacoustics in the world , 2011, Organised Sound.

[17]  Agostino Di Scipio,et al.  The Synthesis of Environmental Sound Textures by Iterated Nonlinear Functions, and its Ecological Relevance to Perceptual Modeling , 2002 .

[18]  三嶋 博之.  The theory of affordances , 2008 .

[19]  Adam Lockhart,et al.  Exploring Cognitive Process Through Music Composition , 2006, ICMC.

[20]  Adam Basanta,et al.  Syntax as Sign: The use of ecological models within a semiotic approach to electroacoustic composition , 2010, Organised Sound.

[21]  David Hakken.  Work‐Oriented Design of Computer Artifacts , 1989 .

[22]  Damián Keller,et al.  Social and perceptual processes in the installation The Trade , 2000, Organised Sound.

[23]  William H. Warren,et al.  Direct Perception: The View from Here , 2005 .

[24]  Marcelo Soares Pimenta,et al.  Anchoring In Ubiquitous Musical Activities , 2010, ICMC.

[25]  Barry Truax,et al.  Genres and techniques of soundscape composition as developed at Simon Fraser University , 2002, Organised Sound.

[26]  Morton Feldman,et al.  Give My Regards to Eighth Street: Collected Writings of Morton Feldman , 2004 .

[27]  Marcelo Soares Pimenta,et al.  Technological Support for Online Communities Focusing on Music Creation: Adopting Collaboration, Flexibility, and Multiculturality from Brazilian Creativity Styles , 2013 .

[28]  Dave Collins.  'Getting there': Do we need to study how people compose music? , 2012 .

[29]  W. L. Windsor,et al.  A perceptual approach to the description and analysis of acousmatic music , 1995 .

[30]  Marcelo Soares Pimenta,et al.  Musical interaction patterns: communicating computer music knowledge in a multidisciplinary project , 2010, SIGDOC '10.

[31]  Maria Helena de Lima,et al.  Creativity-centred design for ubiquitous musical activities: Two case studies , 2012 .

[32]  Agostino Di Scipio.  Émergence du Son, Son d’Emergence. Essai d’épistémologie expérimentale par un compositeur , 2008 .

[33]  Pierre Schaeffer,et al.  Traité des objets musicaux : essai interdisciplines , 1966 .

[34]  Marcelo Soares Pimenta,et al.  Convergent Trends Toward Ubiquitous Music , 2011 .

[35]  F. Varela.  Whence Perceptual Meaning? A Cartography of Current Ideas , 1992 .

[36]  Alan Marsden.  'What was the question?': music analysis and the computer. , 2009 .

[37]  Miko Laakso,et al.  Foundations for studying creative design practices , 2011, DESIRE.

[38]  Jonathan Berger,et al.  Paititi: a multimodal journey to el dorado (original artwork, installation, sound synthesis, video) , 2004 .

[39]  Michael T. Turvey,et al.  Gibsonian Affordances for Roboticists , 2007, Adapt. Behav..

[40]  Richard Wesley Nance.  COMPOSITIONAL EXPLORATIONS OF PLASTIC SOUND , 2007 .

[41]  Barry Eaglestone,et al.  Cognitive Styles and Computer-Based Creativity Support Systems: Two Linked Studies of Electro-acoustic Music Composers , 2007, CMMR.

[42]  Andrew R. Brown,et al.  An Introduction to Eco-Structuralism , 2006, ICMC.

[43]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[44]  Matthew Burtner,et al.  Ecoacoustic and shamanic technologies for multimedia composition and performance , 2005, Organised Sound.

[45]  Marcelo Soares Pimenta,et al.  The Mobile Csound Platform , 2012, ICMC.

[46]  Natasha Barrett,et al.  A compositional methodology based on data extracted from natural phenomena , 2000, ICMC.

[47]  Andy Clark,et al.  Beyond the Flesh: Some Lessons from a Mole Cricket , 2005, Artificial Life.

[48]  Ken Friedman,et al.  The Fluxus performance workbook , 2002 .

[49]  Tom Davis,et al.  Cross-Pollination: towards an Aesthetics of the Real , 2009, ICMC.

[50]  Margaret Wilson,et al.  The re-tooled mind: how culture re-engineers cognition. , 2010, Social cognitive and affective neuroscience.

[51]  Pierre Schaeffer.  Traité des objets musicaux , 1966 .

[52]  R. Weisberg.  Creativity: Beyond the Myth of Genius , 1993 .

[53]  Edwin Hutchins,et al.  Cognitive Ecology , 2010, Top. Cogn. Sci..

[54]  Pierre Boulez,et al.  Orientations: Collected Writings , 1986 .

[55]  Damián Keller,et al.  Analysis by Modeling: Xenakis's ST/10-1 080262 , 2004 .

[56]  K. Knuth,et al.  What Is a Question , 2004, physics/0403089.