Cognition and Physicality in Musical Cyberinstruments

In this paper, we present the SensOrg, a musical CyberInstrument designed as a modular assembly of input/output devices and musical software, mapped and arranged according to functional characteristics of the Man-Instrument system. We discuss how the cognitive ergonomics of non-verbal and symbolic task modalities influenced the design of our hardware interface for asynchronous as well as synchronous task situations. Using malleable atoms and tangible bits, we externally represented the musical functionality in a physical interface which is totally flexible yet completely freezable.

[1]  Roel Vertegaal,et al.  The Sentograph: Input Devices and the Communication of Bodily Expression , 1995, ICMC.

[2]  Johan Sundberg,et al.  Musical Performance: A Synthesis-by-Rule Approach , 1983 .

[3]  J. Iaccino,et al.  Left Brain - Right Brain Differences: Inquiries, Evidence, and New Approaches , 1993 .

[4]  Roel Vertegaal,et al.  Quarterly Progress and Status Report Towards a musician’s cockpit: Transducers, feedback and musical function , 2007 .

[5]  John Strawn,et al.  Meta + Hodos and META Meta + Hodos , 1987 .

[6]  David Zicarelli,et al.  Max: Interactive Graphic Programming Environment , 1991 .

[7]  Roel Vertegaal.  The Standard Instrument Space Libraries: Demonstrating the Power of ISEE , 1995, ICMC.

[8]  J. G. Miller.  Living systems. , 1972, Currents in modern biology.

[9]  Roel Vertegaal,et al.  Looking for sound?: selling perceptual space in hierarchically nested boxes , 1998, CHI Conference Summary.

[10]  David J. Israel,et al.  What is information , 1990 .

[11]  Roel Vertegaal,et al.  ISEE: An Intuitive Sound Editing Environment , 1994 .

[12]  B. Hedberg.  How Organizations Learn and Unlearn , 1981 .

[13]  Richard Polfreman,et al.  A Human Factors Approach to Computer Music Systems User-Interface Design , 1995, ICMC.

[14]  C. Palmer.  Music performance. , 1997, Annual review of psychology.

[15]  Barry Eaglestone,et al.  An evaluation of input devices for use in the ISEE human-synthesizer interface , 1994, ICMC.

[16]  M. Mead,et al.  Cybernetics , 1953, The Yale Journal of Biology and Medicine.

[17]  Todd Winkler,et al.  Making Motion Musical: Gesture Mapping Strategies for Interactive Computer Music , 1995, ICMC.

[18]  Manfred Clynes,et al.  THE COMMUNICATION OF EMOTION: THEORY OF SENTICS , 1980 .

[19]  Volker Krefeld,et al.  The Hand in the Web: An Interview with Michel Waisvisz , 1990 .

[20]  Curtis Roads,et al.  Responsive Input Devices and Sound Synthesis by Stimulation of Instrumental Mechanisms: The Cordis System , 1984 .

[21]  Jock D. Mackinlay,et al.  A semantic analysis of the design space of input devices , 1990 .

[22]  M. Argyle.  The Psychology of Interpersonal Behaviour , 1967 .

[23]  J. Sloboda.  The Musical Mind: The Cognitive Psychology of Music , 1987 .

[24]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[25]  Jiajie Zhang,et al.  Representations in Distributed Cognitive Tasks , 1994, Cogn. Sci..

[26]  Curtis Roads,et al.  Music, Mind, and Brain: The Neuropsychology of Music , 1983 .

[27]  Sylvie Gibet,et al.  Instrumental Gesture Modeling by Identification with Time-varying Mechanical Models , 1988, ICMC.

[28]  Betty Edwards,et al.  Drawing on the right side of the brain , 1981, CHI Conference Summary.

[29]  Roel Vertegaal,et al.  Comparison of Input Devices in an ISEE Direct Timbre Manipulation Task , 1996, Interact. Comput..

[30]  Neil Gershenfeld,et al.  MIT-Media Lab , 1991, ICMC.

[31]  Jock D. Mackinlay,et al.  A Semantic Analysis of the Design Space of Input Devices , 1990, Hum. Comput. Interact..

[32]  Brian Shackel,et al.  Human Factors and Usability - Whence and Whither , 1985, Software-Ergonomie.

[33]  Steven W. Keele,et al.  Movement control in skilled motor performance. , 1968 .

[34]  Jeff Pressing.  Cybernetic Issues in Interactive Performance Systems , 1990 .