Low latency audio pitch shifting in the time domain

This paper presents a novel pitch shifting algorithm that achieves latency significantly lower than existing techniques. As such, it provides a solution for various situations such as live performances in which pitch shifting within less than 10 ms of latency is desired. Based on IIR filters, oscillators and ring modulations, the proposed algorithm completely differs from previous approaches. This paper presents this novel algorithm in detail and shows how it was implemented. It further compares it to other pitch shifting techniques in terms of latency.

[1]  Dinesh K. Pai,et al.  JASS: A JAVA AUDIO SYNTHESIS SYSTEM FOR PROGRAMMERS , 2001 .

[2]  Jean Laroche,et al.  Phase-vocoder: about this phasiness business , 1997, Proceedings of 1997 Workshop on Applications of Signal Processing to Audio and Acoustics.

[3]  Richard G. Lyons,et al.  Understanding Digital Signal Processing , 1996 .

[4]  Jens GULDEN.  Using the JACK Audio Connection Kit with Java , 2007 .

[5]  R. Meddis,et al.  A unitary model of pitch perception. , 1997, The Journal of the Acoustical Society of America.

[6]  Jean Laroche,et al.  Improved phase vocoder time-scale modification of audio , 1999, IEEE Trans. Speech Audio Process..

[7]  Perception of a Spectrally Deprived Speech Signal , 2004, Human Physiology.

[8]  Miller Puckette,et al.  Accuracy of frequency estimates using the phase vocoder , 1998, IEEE Trans. Speech Audio Process..

[9]  L. Auger.  The Journal of the Acoustical Society of America , 1949 .

[10]  Stefan Müller Arisona,et al.  Real-Time, low Latency audio Processing in Java , 2007, ICMC.

[11]  Jean Laroche,et al.  New phase-vocoder techniques for pitch-shifting, harmonizing and other exotic effects , 1999, Proceedings of the 1999 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics. WASPAA'99 (Cat. No.99TH8452).

[12]  Eugene Coyle,et al.  An Efficient Phasiness Reduction Technique for Moderate Audio Time-scale Modification , 2004 .

[13]  David Dorran,et al.  Audio Time-Scale Modification , 2005 .

[14]  Jean Laroche,et al.  New phase-vocoder techniques for real-time pitch shifting , 1999 .

[15]  Jan O. Borchers,et al.  An Analysis of Startup and Dynamic Latency in phase vocoder-Based Time-stretching Algorithms , 2007, ICMC.

[16]  Scott Wardle.  A Hilbert-Transformer Frequency Shifter for Audio , 2008 .

[17]  J. L. Flanagan,et al.  PHASE VOCODER , 2008 .

[18]  John ffitch,et al.  The sliding phase vocoder , 2007, ICMC.

[19]  Jean Laroche.  Autocorrelation method for high-quality time/pitch-scaling , 1993, Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[20]  Jan O. Borchers,et al.  PhaVoRIT: A Phase Vocoder for Real-Time Interactive Time-Stretching , 2006, ICMC.

[21]  Mark Sandler,et al.  Fast implementation for non-linear time-scaling of stereo signals , 2005 .

[22]  Julius O. Smith,et al.  Multiresolution sinusoidal modeling for wideband audio with modifications , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[23]  William A. Sethares,et al.  Rhythm and Transforms , 2007 .

[24]  Julius O. Smith,et al.  A Sines+Transients+Noise Audio Representation for Data Compression and Time/Pitch Scale Modifications , 1998 .

[25]  Fabio Kon,et al.  The Quest for Low Latency , 2004, ICMC.

[26]  Jean Laroche,et al.  New Phase-Vocoder Techniques are Real-Time Pitch Shifting, Chorusing, Harmonizing, and Other Exotic Audio Modifications , 1999 .