Melody Slot Machine: A Controllable Holographic Virtual Performer

This paper describes the "Melody Slot Machine," an interactive music system that enables control over virtual performers. Conventional virtual players focus on what kind of output performance is given to the input performance, and the performance output is difficult to control. The Melody Slot Machine enables the user to select the melody to be played next by the virtual player by rotating a dial. Furthermore, the performer is projected on a holographic display, and the user can feel as if a real virtual player is there. To achieve this, the system needs to change the melody and the performance video.

[1]  Satoshi Tojo,et al.  Implementing “A Generative Theory of Tonal Music” , 2006 .

[2]  Satoshi Tojo,et al.  \sigma GTTM III: Learning-Based Time-Span Tree Generator Based on PCFG , 2015, CMMR.

[3]  Satoshi Tojo,et al.  Melody Extrapolation in GTTM Approach , 2009, ICMC.

[4]  Keiji Hirata,et al.  Interactive Music Summarization Based on Generative Theory of Tonal Music , 2003 .

[5]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[6]  Belinda Thom,et al.  Interactive Improvisational Music Companionship: A User-Modeling Approach , 2003, User Modeling and User-Adapted Interaction.

[7]  Satoshi Tojo,et al.  deepGTTM-III: Multi-task Learning with Grouping and Metrical Structures , 2017, CMMR.

[8]  François Pachet,et al.  The Continuator: Musical Interaction With Style , 2003, ICMC.

[9]  Satoshi Tojo,et al.  Melody Morphing Method Based on GTTM , 2008, ICMC.

[10]  Satoshi Tojo,et al.  Melody Expectation Method Based on GTTM and TPS , 2008, ISMIR.

[11]  Yoichi Muraoka,et al.  A Jazz Session System for Interplay Among All Players - VirJa Session (Virtual Jazz Session System) , 1996, ICMC.

[12]  Masataka Goto,et al.  A Learning-Based Jam Session System that Imitates a Player's Personality Model , 2003, IJCAI.

[13]  Shlomo Dubnov,et al.  OMax brothers: a dynamic yopology of agents for improvization learning , 2006, AMCMM '06.

[14]  Rosa Maria Vicari,et al.  A multiagent approach for musical interactive systems , 2003, AAMAS '03.

[15]  Keiji Hirata,et al.  Ha-Hi-Hun plays Chopin's Etude , 2003 .

[16]  S. Hedges.  DICE MUSIC IN THE EIGHTEENTH CENTURY , 1978 .