FXive: A Web Platform for Procedural Sound Synthesis

FXive is a real-time sound effect synthesis framework in the browser. The system is comprised of a library of synthesis models, audio effects, post-processing tools, temporal and spatial placement functionality for the user to create the scene from scratch. The real-time nature allows the user to manipulate multiple parameters to shape the sound at the point of creation. Semantic descriptors are mapped to low level parameters in order to provide an intuitive means of user manipulation. Post-processing features allow for the auditory, temporal and spatial manipulation of these individual sound effects.

[1]  Joshua D. Reiss,et al.  Physical Modeling and Synthesis of Motor Noise for Replication of a Sound Effects Library , 2010 .

[2]  Antti Jylhä,et al.  3-D Sound Synthesis of a Honeybee Swarm , 2009 .

[3]  William J. Wilkinson.  A Synthesis Model for Mammalian Vocalization Sound Effects , 2016 .

[4]  Joshua D. Reiss,et al.  Sound Synthesis of Objects Swinging through Air Using Physical Models , 2017 .

[5]  Joshua D. Reiss,et al.  Physically Derived Synthesis Model of an Aeolian Tone , 2016 .

[6]  Andrew P. McPherson,et al.  Mapping and interaction strategies for performing environmental sound , 2014, 2014 IEEE VR Workshop: Sonic Interaction in Virtual Environments (SIVE).

[7]  Perry R. Cook,et al.  Real Sound Synthesis for Interactive Applications , 2002 .

[8]  Joshua D. Reiss,et al.  Perceptual Evaluation of Synthesized Sound Effects , 2018, ACM Trans. Appl. Percept..

[9]  Joshua D. Reiss,et al.  Creating Real-Time Aeroacoustic Sound Effects Using Physically Informed Models , 2018 .

[10]  Boris Smus.  Web Audio API , 2013 .

[11]  Andy Farnell.  Marching onwards Procedural synthetic footsteps for video games and animation , 2007 .

[12]  Davide Rocchesso,et al.  The Sounding Object , 2002 .

[13]  Andy Farnell.  An introduction to procedural audio and its application in computer games , 2007 .

[14]  Andy Farnell,et al.  Designing Sound , 2008 .

[15]  Joshua D. Reiss,et al.  Physically Derived Sound Synthesis Model of a Propeller , 2017, Audio Mostly Conference.

[16]  V. Ament.  The Foley Grail: The Art of Performing Sound for Film, Games, and Animation , 2009 .

[17]  Ryan Stables,et al.  JSAP: A Plugin Standard for the Web Audio API with Intelligent Functionality , 2016 .

[18]  LUCAS MENGUAL,et al.  Modal Synthesis of Weapon Sounds , 2016 .

[19]  William J. Wilkinson,et al.  Latent force models for sound: Learning modal synthesis parameters and excitation functions from audio recordings , 2017 .

[20]  Andrew P. McPherson,et al.  Human performance of computational sound models for immersive environments , 2014 .

[21]  Armin Taghipour,et al.  On Similarity and Density of Applause Sounds , 2017 .

[22]  Joshua D. Reiss,et al.  What do your footsteps sound like? An investigation on interactive footstep sounds adjustment , 2016 .

[23]  Joshua D. Reiss,et al.  REAL-TIME PHYSICAL MODEL FOR SYNTHESIS OF SWORD SWING SOUNDS , 2017 .

[24]  Perry R. Cook,et al.  Physically Informed Sonic Modeling (PhISM): Synthesis of percussive sounds , 1997 .