Supervised chaotic source separation by a tank of water

Whether listening to overlapping conversations in a crowded room or recording the simultaneous electrical activity of millions of neurons, the natural world abounds with sparse measurements of complex overlapping signals that arise from dynamical processes. While tools that separate mixed signals into linear sources have proven necessary and useful, the underlying equational forms of most natural signals are unknown and nonlinear. Hence, there is a need for a framework that is general enough to extract sources without knowledge of their generating equations and flexible enough to accommodate nonlinear, even chaotic, sources. Here, we provide such a framework, where the sources are chaotic trajectories from independently evolving dynamical systems. We consider the mixture signal as the sum of two chaotic trajectories and propose a supervised learning scheme that extracts the chaotic trajectories from their mixture. Specifically, we recruit a complex dynamical system as an intermediate processor that is constantly driven by the mixture. We then obtain the separated chaotic trajectories based on this intermediate system by training the proper output functions. To demonstrate the generalizability of this framework in silico, we employ a tank of water as the intermediate system and show its success in separating two-part mixtures of various chaotic trajectories. Finally, we relate the underlying mechanism of this method to the state-observer problem. This relation provides a quantitative theory that explains the performance of our method, and why separation is difficult when two source signals are trajectories from the same chaotic system.

[1]  Yujiro Inouye On the observability of autonomous nonlinear systems , 1977 .

[2]  S P Fitzgibbon,et al.  Removal of EEG Noise and Artifact Using Blind Source Separation , 2007, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[3]  Lloyd N. Trefethen,et al.  Fourth-Order Time-Stepping for Stiff PDEs , 2005, SIAM J. Sci. Comput..

[4]  Hugo Vélez-Pérez,et al.  Blind source separation, wavelet denoising and discriminant analysis for EEG artefacts and noise cancelling , 2012, Biomed. Signal Process. Control..

[5]  DeLiang Wang,et al.  Supervised Speech Separation Based on Deep Learning: An Overview , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[6]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[7]  L. Tsimring,et al.  Multiplexing chaotic signals using synchronization , 1996 .

[8]  Edward Ott,et al.  Attractor reconstruction by machine learning. , 2018, Chaos.

[9]  K. Obermayer,et al.  Principal Component Analysis and Blind Separation of Sources for Optical Imaging of Intrinsic Signals , 2000, NeuroImage.

[10]  Alexander S. Dmitriev,et al.  Separation of chaotic signal sum into components in the presence of noise , 2003 .

[11]  Pengju He,et al.  Single channel blind source separation on the instantaneous mixed signal of multiple dynamic sources , 2017, Mechanical Systems and Signal Processing.

[12]  Erkki Oja,et al.  Independent component approach to the analysis of EEG and MEG recordings , 2000, IEEE Transactions on Biomedical Engineering.

[13]  R. Brockett,et al.  Reservoir observers: Model-free inference of unmeasured variables in chaotic systems. , 2017, Chaos.

[14]  Yoshiki Kuramoto,et al.  Diffusion-Induced Chaos in Reaction Systems , 1978 .

[15]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources via an independent component analysis , 1996, IEEE Trans. Signal Process..

[16]  DeLiang Wang,et al.  A classification based approach to speech segregation. , 2012, The Journal of the Acoustical Society of America.

[17]  Michał Szydłowski,et al.  Lax-Wendroff and McCormack Schemes for Numerical Simulation of Unsteady Gradually and Rapidly Varied Open Channel Flow , 2014 .

[18]  Hirokazu Kameoka,et al.  A review of blind source separation methods: two converging routes to ILRMA originating from ICA and NMF , 2019, APSIPA Transactions on Signal and Information Processing.