Simultaneous nonparametric regression in RADWT dictionaries

Abstract A new technique for nonparametric regression of multichannel signals is presented. The technique is based on the use of the Rational-Dilation Wavelet Transform (RADWT), equipped with a tunable Q-factor able to provide sparse representations of functions with different oscillations persistence. In particular, two different frames are obtained by two RADWT with different Q-factors that give sparse representations of functions with low and high resonance. It is assumed that the signals are measured simultaneously on several independent channels and that they share the low resonance component and the spectral characteristics of the high resonance component. Then, a regression analysis is performed by means of the grouped lasso penalty. Furthermore, a result of asymptotic optimality of the estimator is presented using reasonable assumptions and exploiting recent results on group-lasso like procedures. Numerical experiments show the performance of the proposed method in different synthetic scenarios as well as in a real case example for the analysis and joint detection of sleep spindles and K-complex events for multiple electroencephalogram (EEG) signals.

[1]  Allan Kardec Barros,et al.  Extraction of Sleep-Spindles from the Electroencephalogram (EEG) , 2000, ANNIMAB.

[2]  Hristo S. Paskov,et al.  Multitask learning improves prediction of cancer drug sensitivity , 2016, Scientific Reports.

[3]  Jian Huang,et al.  Penalized methods for bi-level variable selection. , 2009, Statistics and its interface.

[4]  Laxmi Parida,et al.  Novel applications of multitask learning and multiple output regression to multiple genetic trait prediction , 2016, Bioinform..

[5]  Larry A. Wasserman,et al.  Nonparametric regression and classification with joint sparsity constraints , 2008, NIPS.

[6]  Alain Rakotomamonjy,et al.  Surveying and comparing simultaneous sparse approximation (or group-lasso) algorithms , 2011, Signal Process..

[7]  Ziv Bar-Joseph,et al.  Reconstructing cancer drug response networks using multitask learning , 2017, BMC Systems Biology.

[8]  Abdennaceur Kachouri,et al.  Sleep spindle and K-complex detection using tunable Q-factor wavelet transform and morphological component analysis , 2015, Front. Hum. Neurosci..

[9]  Ivan W. Selesnick,et al.  Detection of K-complexes and sleep spindles (DETOKS) using sparse optimization , 2015, Journal of Neuroscience Methods.

[10]  Ivan W. Selesnick,et al.  Resonance-based signal decomposition: A new sparsity-enabled signal analysis method , 2011, Signal Process..

[11]  Mohamed-Jalal Fadili,et al.  Morphological Diversity and Sparsity for Multichannel Data Restoration , 2009, Journal of Mathematical Imaging and Vision.

[12]  Aurelie C. Lozano,et al.  Multi-level Lasso for Sparse Multi-task Regression , 2012, ICML.

[13]  Sara van de Geer,et al.  Statistics for High-Dimensional Data , 2011 .

[14]  Massimiliano Pontil,et al.  Convex multi-task feature learning , 2008, Machine Learning.

[15]  Robert Tibshirani,et al.  STANDARDIZATION AND THE GROUP LASSO PENALTY. , 2012, Statistica Sinica.

[16]  J. Tropp.  Algorithms for simultaneous sparse approximation. Part II: Convex relaxation , 2006, Signal Process..

[17]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[18]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[19]  Tom F. Wilderjans,et al.  A flexible framework for sparse simultaneous component based data integration , 2011, BMC Bioinformatics.

[20]  Ivan W. Selesnick,et al.  Frequency-Domain Design of Overcomplete Rational-Dilation Wavelet Transforms , 2009, IEEE Transactions on Signal Processing.

[21]  Jian Huang,et al.  A Selective Review of Group Selection in High-Dimensional Models. , 2012, Statistical science : a review journal of the Institute of Mathematical Statistics.

[22]  Yi Yang,et al.  A fast unified algorithm for solving group-lasso penalize learning problems , 2014, Statistics and Computing.

[23]  Ivan W. Selesnick,et al.  Multichannel sleep spindle detection using sparse low-rank optimization , 2017, Journal of Neuroscience Methods.

[24]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[25]  C. Phillips,et al.  Sleep Spindles as an Electrographic Element: Description and Automatic Detection Methods , 2016, Neural plasticity.

[26]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Francis R. Bach,et al.  Structured Variable Selection with Sparsity-Inducing Norms , 2009, J. Mach. Learn. Res..

[29]  Jian Huang,et al.  Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors , 2012, Statistics and Computing.