Human time-frequency acuity beats the Fourier uncertainty principle.

The time-frequency uncertainty principle states that the product of the temporal and frequency extents of a signal cannot be smaller than 1/(4 π). We study human ability to simultaneously judge the frequency and the timing of a sound. Our subjects often exceeded the uncertainty limit, sometimes by more than tenfold, mostly through remarkable timing acuity. Our results establish a lower bound for the nonlinearity and complexity of the algorithms employed by our brains in parsing transient sounds, rule out simple "linear filter" models of early auditory processing, and highlight timing acuity as a central feature in auditory object processing.

[1]  Alain de Cheveigné,et al.  Pitch perception models , 2005 .

[2]  Roy D. Patterson,et al.  In Auditory Physiology and Perception , 1992 .

[3]  S. Snyder,et al.  Proceedings of the National Academy of Sciences , 1999 .

[4]  Michael S. Lewicki,et al.  Efficient auditory coding , 2006, Nature.

[5]  Khaled H. Hamed,et al.  Time-frequency analysis , 2003 .

[6]  J. C. R. Licklider.  A Duplex Theory of Pitch Perception , 1951 .

[7]  O. A. Trowell.  Annual Review of Physiology , 1948, Nature.

[8]  R. Patterson,et al.  Complex Sounds and Auditory Images , 1992 .

[9]  D. Gabor.  Acoustical Quanta and the Theory of Hearing , 1947, Nature.

[10]  Physical Review , 1965, Nature.

[11]  E. Kandel,et al.  Proceedings of the National Academy of Sciences of the United States of America. Annual subject and author indexes. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[12]  J. H. Casseday,et al.  Timing in the auditory system of the bat. , 1999, Annual review of physiology.

[13]  K. Kodera,et al.  Analysis of time-varying signals with small BT values , 1978 .

[14]  C. E. Ho,et al.  A procedure for an automated measurement of song similarity , 2000, Animal Behaviour.

[15]  William J. Williams,et al.  Improved time-frequency representation of multicomponent signals using exponential kernels , 1989, IEEE Trans. Acoust. Speech Signal Process..

[16]  D. A. Ronken.  Some effects of bandwith-duration constraints on frequency discrimination. , 1971, The Journal of the Acoustical Society of America.

[17]  D. Thomson,et al.  Spectrum estimation and harmonic analysis , 1982, Proceedings of the IEEE.

[18]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[19]  R. Rosenfeld.  Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[20]  P. C. Pandey,et al.  The Journal of the Acoustical Society of America , 1939 .

[21]  W. B. Fraser,et al.  Proc. of The Royal Society of London Series A - Mathematical Physical and Engineering Sciences , 2002 .

[22]  Marcelo O Magnasco,et al.  Sparse time-frequency representations , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[23]  J. Fritz,et al.  Dynamics of Precise Spike Timing in Primary Auditory Cortex , 2004, The Journal of Neuroscience.

[24]  Francois Le Chevalier,et al.  Principles of Radar and Sonar Signal Processing , 2002 .

[25]  B. Moore.  Frequency difference limens for short-duration tones. , 1973, The Journal of the Acoustical Society of America.

[26]  Marina Bosi,et al.  Introduction to Digital Audio Coding and Standards , 2004, J. Electronic Imaging.

[27]  Ieee Acoustics,et al.  IEEE Transactions on Acoustics, Speech, and Signal Processing , 1974 .

[28]  Joerg F. Hipp,et al.  Time-Frequency Analysis , 2014, Encyclopedia of Computational Neuroscience.

[29]  E. P..  Animal Behaviour , 1901, Nature.

[30]  Laurel H. Carney,et al.  Evaluating Auditory Performance Limits: I. One-Parameter Discrimination Using a Computational Model for the Auditory Nerve , 2001, Neural Computation.

[31]  E. Wigner.  On the quantum correction for thermodynamic equilibrium , 1932 .

[32]  Kelly Fitz,et al.  Algorithms for computing the time-corrected instantaneous frequency (reassigned) spectrogram, with applications. , 2004, The Journal of the Acoustical Society of America.

[33]  G. Gescheider.  Psychophysics: The Fundamentals , 1997 .

[34]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[35]  R. Freyman,et al.  A general equation describing frequency discrimination as a function of frequency and sensation level. , 1983, The Journal of the Acoustical Society of America.