Time-frequency super-resolution with superlets

Due to the Heisenberg–Gabor uncertainty principle, finite oscillation transients are difficult to localize simultaneously in both time and frequency. Classical estimators, like the short-time Fourier transform or the continuous-wavelet transform optimize either temporal or frequency resolution, or find a suboptimal tradeoff. Here, we introduce a spectral estimator enabling time-frequency super-resolution, called superlet, that uses sets of wavelets with increasingly constrained bandwidth. These are combined geometrically in order to maintain the good temporal resolution of single wavelets and gain frequency resolution in upper bands. The normalization of wavelets in the set facilitates exploration of data with scale-free, fractal nature, containing oscillation packets that are self-similar across frequencies. Superlets perform well on synthetic data and brain signals recorded in humans and rodents, resolving high frequency bursts with excellent precision. Importantly, they can reveal fast transient oscillation events in single trials that may be hidden in the averaged time-frequency spectrum by other methods. Identifying the frequency, temporal location, duration, and amplitude of finite oscillation packets in neurophysiological signals with high precision is challenging. The authors present a method based on multiple wavelets to improve the detection of localized time-frequency packets.

[1]  P. Tiesinga Motifs in health and disease: the promise of circuit interrogation by optogenetics , 2012, The European journal of neuroscience.

[2]  H. Cline,et al.  What Is Excitation/Inhibition and How Is It Regulated? A Case of the Elephant and the Wisemen , 2019, Journal of experimental neuroscience.

[3]  J. Fermaglich Electric Fields of the Brain: The Neurophysics of EEG , 1982 .

[4]  Arved J. Raudkivi,et al.  ANALYSIS OF INFORMATION , 1979 .

[5]  Gerhard Werner,et al.  Fractals in the Nervous System: Conceptual Implications for Theoretical Neuroscience , 2009, Front. Physiology.

[6]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[7]  Juhan Nam,et al.  A super-resolution spectrogram using coupled PLCA , 2010, INTERSPEECH.

[8]  V. Pisarenko The Retrieval of Harmonics from a Covariance Function , 1973 .

[9]  Charles E. Schroeder,et al.  Oscillatory Bursting as a Mechanism for Temporal Coupling and Information Coding , 2020, Frontiers in Computational Neuroscience.

[10]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[11]  T. Sejnowski,et al.  Cortical Enlightenment: Are Attentional Gamma Oscillations Driven by ING or PING? , 2009, Neuron.

[12]  W. Freiwald,et al.  Oscillatory synchrony in the monkey temporal lobe correlates with performance in a visual short-term memory task. , 2004, Cerebral cortex.

[13]  Bruno Torrésani,et al.  Characterization of signals by the ridges of their wavelet transforms , 1997, IEEE Trans. Signal Process..

[14]  Roland Wilson,et al.  A generalized wavelet transform for Fourier analysis: The multiresolution Fourier transform and its application to image and audio signal analysis , 1992, IEEE Trans. Inf. Theory.

[15]  G. Buzsáki Rhythms of the brain , 2006 .

[16]  G. Feng,et al.  Imaging Neuronal Subsets in Transgenic Mice Expressing Multiple Spectral Variants of GFP , 2000, Neuron.

[17]  Brenda J Butka Imaging , 2003, JAMA.

[18]  Boualem Boashash,et al.  Resolution measure criteria for the objective assessment of the performance of quadratic time-frequency distributions , 2003, IEEE Trans. Signal Process..

[19]  C. Parameswariah,et al.  Frequency Characteristics of Wavelets , 2002, IEEE Power Engineering Review.

[20]  D. Godwin,et al.  Expression of channelrhodopsin-2 localized within the deep CA1 hippocampal sublayer in the Thy1 line 18 mouse , 2018, Brain Research.

[21]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[22]  Maurice de Gosson,et al.  Born-Jordan quantization , 2016 .

[23]  Werner Lutzenberger,et al.  Fractal dimension of electroencephalographic time series and underlying brain processes , 1995, Biological Cybernetics.

[24]  C. Torrence,et al.  A Practical Guide to Wavelet Analysis. , 1998 .

[25]  Olivier J. J. Michel,et al.  Time-frequency complexity and information , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  I. Osorio,et al.  Intrinsic time-scale decomposition: time–frequency–energy analysis and real-time filtering of non-stationary signals , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[27]  P. Pupalaikis,et al.  Modern RF and Microwave Measurement Techniques: TDR-based S-parameters , 2013 .

[28]  Ali N. Akansu,et al.  Emerging applications of wavelets: A review , 2010, Phys. Commun..

[29]  Jont B. Allen,et al.  Short term spectral analysis, synthesis, and modification by discrete Fourier transform , 1977 .

[30]  Syed Ismail Shah,et al.  Techniques to Obtain Good Resolution and Concentrated Time-Frequency Distributions: A Review , 2009, EURASIP J. Adv. Signal Process..

[31]  David Kleinfeld,et al.  Spectral methods for functional brain imaging. , 2014, Cold Spring Harbor protocols.

[32]  P. Mitra,et al.  Analysis of dynamic brain imaging data. , 1998, Biophysical journal.

[33]  Nancy Kopell,et al.  Synchronization in Networks of Excitatory and Inhibitory Neurons with Sparse, Random Connectivity , 2003, Neural Computation.

[34]  Lucia Melloni,et al.  Visual Exploration and Object Recognition by Lattice Deformation , 2011, PloS one.

[35]  Ana-Maria Ichim,et al.  Fractional Superlets , 2021, 2020 28th European Signal Processing Conference (EUSIPCO).

[36]  K. Deisseroth,et al.  Parvalbumin neurons and gamma rhythms enhance cortical circuit performance , 2009, Nature.

[37]  L. Cohen Generalized Phase-Space Distribution Functions , 1966 .

[38]  B. Hannaford,et al.  Approximating time-frequency density functions via optimal combinations of spectrograms , 1994, IEEE Signal Processing Letters.

[39]  Amy Hu,et al.  Thy1 transgenic mice expressing the red fluorescent calcium indicator jRGECO1a for neuronal population imaging in vivo , 2018, bioRxiv.

[40]  Andrei Ciuparu,et al.  Sources of bias in single‐trial normalization procedures , 2016, The European journal of neuroscience.

[41]  Ovidiu F. Jurjuţ,et al.  The oscillation score: an efficient method for estimating oscillation strength in neuronal activity. , 2008, Journal of neurophysiology.

[42]  Boualem Boashash,et al.  Time-Frequency Signal Analysis and Processing: A Comprehensive Reference , 2015 .

[43]  Danko Nikolić,et al.  Properties of multivariate data investigated by fractal dimensionality , 2008, Journal of Neuroscience Methods.

[44]  Richard Kronland-Martinet,et al.  Asymptotic wavelet and Gabor analysis: Extraction of instantaneous frequencies , 1992, IEEE Trans. Inf. Theory.

[45]  R. Shapley,et al.  Is Gamma-Band Activity in the Local Field Potential of V1 Cortex a “Clock” or Filtered Noise? , 2011, The Journal of Neuroscience.

[46]  J. Lilly Element analysis: a wavelet-based method for analysing time-localized events in noisy time series , 2017, Proceedings of the Royal Society A.

[47]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[48]  Walter J. Freeman,et al.  A field-theoretic approach to understanding scale-free neocortical dynamics , 2005, Biological Cybernetics.

[49]  J. Morlet,et al.  Wave propagation and sampling theory—Part I: Complex signal and scattering in multilayered media , 1982 .

[50]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[51]  Olivier Rioul,et al.  Time-scale energy distributions: a general class extending wavelet transforms , 1992, IEEE Trans. Signal Process..

[52]  Jessica A. Cardin,et al.  Driving fast-spiking cells induces gamma rhythm and controls sensory responses , 2009, Nature.

[53]  Vasile V Moca,et al.  Emergence of beta/gamma oscillations: ING, PING, and what about RING? , 2011, BMC Neuroscience.

[54]  Danko Nikolić,et al.  Scaled correlation analysis: a better way to compute a cross‐correlogram , 2012, The European journal of neuroscience.

[55]  Jae S. Lim,et al.  Combined multiresolution (wide-band/narrow-band) spectrogram , 1992, IEEE Trans. Signal Process..

[56]  W. Singer,et al.  Gamma or no gamma, that is the question , 2014, Trends in Cognitive Sciences.

[57]  Christopher Heil,et al.  Continuous and Discrete Wavelet Transforms , 1989, SIAM Rev..

[58]  John Ashmead Morlet wavelets in quantum mechanics , 2012 .

[59]  Sampsa Vanhatalo,et al.  Fine spatiotemporal structure of phase in human intracranial EEG , 2006, Clinical Neurophysiology.

[60]  Fredric J. Harris,et al.  Multirate Signal Processing for Communication Systems , 2004 .

[61]  H. Leonhardt,et al.  A guide to super-resolution fluorescence microscopy , 2010, The Journal of cell biology.

[62]  Walter J. Freeman Qualitative Overview of Population Neurodynamics , 1994 .

[63]  William J. Williams,et al.  Improved time-frequency representation of multicomponent signals using exponential kernels , 1989, IEEE Trans. Acoust. Speech Signal Process..

[64]  R. C. Macridis A review , 1963 .

[65]  Patrick J. Loughlin,et al.  An information-theoretic approach to positive time-frequency distributions , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[66]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[67]  J. Pernier,et al.  Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. , 1997, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[69]  Joerg F. Hipp,et al.  Time-Frequency Analysis , 2014, Encyclopedia of Computational Neuroscience.

[70]  P. Nunez,et al.  Electric fields of the brain , 1981 .

[71]  Benjamin R. Arenkiel,et al.  Imaging Neural Activity Using Thy1-GCaMP Transgenic Mice , 2012, Neuron.

[72]  Danko Nikolić,et al.  Membrane Resonance Enables Stable and Robust Gamma Oscillations , 2012, Cerebral cortex.

[73]  LJubisa Stankovic,et al.  A measure of some time-frequency distributions concentration , 2001, Signal Process..