Optimizing time-frequency kernels for classification

In many pattern recognition applications, features are traditionally extracted from standard time-frequency representations (TFRs). This assumes that the implicit smoothing of, say, a spectrogram is appropriate for the classification task. Making such assumptions may degrade classification performance. In general, ana time-frequency classification technique that uses a singular quadratic TFR (e.g., the spectrogram) as a source of features will never surpass the performance of the same technique using a regular quadratic TFR (e,g., Rihaczek or Wigner-Ville). Any TFR that is not regular is said to be singular. Use of a singular quadratic TFR implicitly discards information without explicitly determining if it is germane to the classification task. We propose smoothing regular quadratic TFRs to retain only that information that is essential for classification. We call the resulting quadratic TFRs class-dependent TFRs. This approach makes no a priori assumptions about the amount and type of time-frequency smoothing required for classification. The performance of our approach is demonstrated on simulated and real data. The simulated study indicates that the performance can approach the Bayes optimal classifier. The real-world pilot studies involved helicopter fault diagnosis and radar transmitter identification.

[1]  C. Doncarli,et al.  Optimal kernels of time-frequency representations for signal classification , 1998, Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis (Cat. No.98TH8380).

[2]  Simon Haykin,et al.  Modular learning strategy for signal detection in a nonstationary environment , 1997, IEEE Trans. Signal Process..

[3]  Les E. Atlas,et al.  Data-driven time-frequency classification techniques applied to tool-wear monitoring , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[4]  R. Tibshirani,et al.  Flexible Discriminant Analysis by Optimal Scoring , 1994 .

[5]  Thomas W. Parks,et al.  Discrete-time, discrete-frequency, time-frequency analysis , 1998, IEEE Trans. Signal Process..

[6]  David L. Donoho,et al.  Improved linear discrimination using time-frequency dictionaries , 1995, Optics + Photonics.

[7]  Jasha Droppo,et al.  Optimizing time-frequency distributions for automatic classification , 1997, Optics & Photonics.

[8]  Jasha Droppo,et al.  Class-Dependent Time-Frequency Distributions via Operator Theory , 1997 .

[9]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[10]  Les Atlas,et al.  Data-driven optimization of time and frequency resolution for radar transmitter identification , 1998, Optics & Photonics.

[11]  Jasha Droppo,et al.  Application of classifier-optimal time-frequency distributions to speech analysis , 1998, Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis (Cat. No.98TH8380).

[12]  T. Claasen,et al.  THE WIGNER DISTRIBUTION - A TOOL FOR TIME-FREQUENCY SIGNAL ANALYSIS , 1980 .

[13]  Jasha Droppo,et al.  An operator theory approach to discrete time-frequency distributions , 1996, Proceedings of Third International Symposium on Time-Frequency and Time-Scale Analysis (TFTS-96).

[14]  L. Atlas,et al.  Applications of Operator Theory to Time- Frequency Analysis and Classification , 1997 .

[15]  Les E. Atlas,et al.  Class-dependent, discrete time-frequency distributions via operator theory , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  R. Tibshirani,et al.  Discriminant Analysis by Gaussian Mixtures , 1996 .

[17]  P. D. McFadden,et al.  A Signal Processing Technique for Detecting Local Defects in a Gear from the Signal Average of the Vibration , 1985 .

[18]  Franz Hlawatsch,et al.  Regularity and unitarity of bilinear time-frequency signal representations , 1992, IEEE Trans. Inf. Theory.

[19]  J. Friedman Regularized Discriminant Analysis , 1989 .

[20]  August W. Rihaczek,et al.  Signal energy distribution in time and frequency , 1968, IEEE Trans. Inf. Theory.

[21]  Nathan Intrator,et al.  Classification of underwater mammals using feature extraction based on time-frequency analysis and BCM theory , 1998, IEEE Trans. Signal Process..

[22]  J.T.E. McDonnell,et al.  Time-frequency and time-scale techniques for the classification of native and bioprosthetic heart valve sounds , 1998, IEEE Transactions on Biomedical Engineering.

[23]  W. J. Wang,et al.  Application of orthogonal wavelets to early gear damage detection , 1995 .

[24]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[25]  Les E. Atlas,et al.  Optimization of time and frequency resolution for radar transmitter identification , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[26]  W. D. Mark Analysis of the vibratory excitation of gear systems: Basic theory , 1978 .

[27]  D. H. Kil,et al.  Pattern recognition and prediction with applications to signal characterization , 1996 .

[28]  Khaled H. Hamed,et al.  Time-frequency analysis , 2003 .