Unsupervised Complex Semi-Binary Matrix Factorization for Activation Sequence Recovery of Quasi-Stationary Sources

Advocating for a sustainable, resilient and human-centric industry, the three pillars of Industry 5.0 call for an increased understanding of industrial processes and manufacturing systems, as well as their energy sustainability. One of the most fundamental elements of comprehension is knowing when the systems are operated, as this is key to locating energy intensive subsystems and operations. Such knowledge is often lacking in practice. Activation statuses can be recovered from sensor data though. Some non-intrusive sensors (accelerometers, current sensors, etc.) acquire mixed signals containing information about multiple actuators at once. Despite their low cost as regards the fleet of systems they monitor, additional signal processing is required to extract the individual activation sequences. To that end, sparse regression techniques can extract leading dynamics in sequential data. Notorious dictionary learning algorithms have proven effective in this regard. This paper considers different industrial settings in which the identification of binary subsystem activation sequences is sought. In this context, it is assumed that each sensor measures an extensive physical property, source signals are periodic, quasi-stationary and independent, albeit these signals may be correlated and their noise distribution is arbitrary. Existing methods either restrict these assumptions, e.g., by imposing orthogonality or noise characteristics, or lift them using additional assumptions, typically using nonlinear transforms.

[1]  K. Tsui,et al.  Difference mode decomposition for adaptive signal decomposition , 2023, Mechanical Systems and Signal Processing.

[2]  J. Antoni,et al.  A probability model with Variational Bayesian Inference for the complex interference suppression in the acoustic array measurement , 2023, Mechanical Systems and Signal Processing.

[3]  I. Mporas,et al.  Non-Intrusive Load Monitoring: A Review , 2023, IEEE Transactions on Smart Grid.

[4]  R. Plateaux,et al.  Scalable ontology-based V&V process for heterogeneous systems and applications , 2022, MoDELS.

[5]  P. Weiss,et al.  Spurious minimizers in non uniform Fourier sampling optimization , 2022, Inverse Problems.

[6]  Ignavier Ng,et al.  On the Identifiability of Nonlinear ICA: Sparsity and Beyond , 2022, NeurIPS.

[7]  Qingyi Wang,et al.  A Novel Underdetermined Blind Source Separation Method Based on OPTICS and Subspace Projection , 2021, Symmetry.

[8]  Michele Dassisti,et al.  Digital twin paradigm: A systematic literature review , 2021, Comput. Ind..

[9]  N. Dervilis,et al.  Equation discovery for nonlinear dynamical systems: A Bayesian viewpoint , 2021 .

[10]  Jérôme Antoni,et al.  The acoustic inverse problem in the framework of alternating direction method of multipliers , 2021 .

[11]  Rajiv Tiwari,et al.  Signal based condition monitoring techniques for fault detection and diagnosis of induction motors: A state-of-the-art review , 2020 .

[12]  N. Vayatis,et al.  Robust Kernel Density Estimation with Median-of-Means principle , 2020, ICML.

[13]  Tomasz Barszcz,et al.  Impulsive source separation using combination of Nonnegative Matrix Factorization of bi-frequency map, spatial denoising and Monte Carlo simulation , 2019, Mechanical Systems and Signal Processing.

[14]  Zongze Wu,et al.  Underdetermined Blind Source Separation of Speech Mixtures Based on K-means Clustering , 2019, 2019 Chinese Control Conference (CCC).

[15]  Yan Xu,et al.  Enhanced sparse component analysis for operational modal identification of real-life bridge structures , 2019, Mechanical Systems and Signal Processing.

[16]  Zhao Zhang,et al.  Trace Ratio Criterion based Discriminative Feature Selection via l2, p-norm regularization for supervised learning , 2018, Neurocomputing.

[17]  Maxim Naumov,et al.  On Periodic Functions as Regularizers for Quantization of Neural Networks , 2018, ArXiv.

[18]  Stephan Günnemann,et al.  Overlapping Community Detection with Graph Neural Networks , 2018, ArXiv.

[19]  Alexandre Gramfort,et al.  Multivariate Convolutional Sparse Coding for Electromagnetic Brain Signals , 2018, NeurIPS.

[20]  Henning Lange,et al.  Variational BOLT: Approximate Learning in Factorial Hidden Markov Models With Application to Energy Disaggregation , 2018, AAAI.

[21]  Sanjay H Upadhyay,et al.  Bearing performance degradation assessment based on a combination of empirical mode decomposition and k-medoids clustering , 2017 .

[22]  Umut Simsekli,et al.  Learning the Morphology of Brain Signals Using Alpha-Stable Convolutional Sparse Coding , 2017, NIPS.

[23]  Jacek Wodecki,et al.  Local fault detection of rolling element bearing components by spectrogram clustering with semi-binary NMF , 2017 .

[24]  Shubi Kaijage,et al.  A Survey on Non-Intrusive Load Monitoring Methodies and Techniques for Energy Disaggregation Problem , 2017, ArXiv.

[25]  Charles A. Sutton,et al.  Sequence-to-point learning with neural networks for nonintrusive load monitoring , 2016, AAAI.

[26]  Yasuhiro Hayashi,et al.  Energy Disaggregation Based on Semi-Binary NMF , 2016, MLDM.

[27]  Jin Chen,et al.  Detection and diagnosis of bearing faults using shift-invariant dictionary learning and hidden Markov model , 2016 .

[28]  W. Knottenbelt,et al.  Neural NILM: Deep Neural Networks Applied to Energy Disaggregation , 2015, BuildSys@SenSys.

[29]  Marie Lasserre,et al.  Bayesian sparse Fourier representation of off-grid targets , 2014, 2014 International Radar Conference.

[30]  Steven L. Brunton,et al.  Dynamic Mode Decomposition with Control , 2014, SIAM J. Appl. Dyn. Syst..

[31]  Fulei Chu,et al.  Recent advances in time–frequency analysis methods for machinery fault diagnosis: A review with application examples , 2013 .

[32]  Rajat Raina,et al.  Shift-Invariance Sparse Coding for Audio Classification , 2012, UAI.

[33]  Roland Badeau,et al.  NMF With Time–Frequency Activations to Model Nonstationary Audio Events , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[34]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[35]  Xuezhi Zhao,et al.  Similarity of signal processing effect between Hankel matrix-based SVD and wavelet transform and its mechanism analysis , 2009 .

[36]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[37]  Rémi Gribonval,et al.  A survey of Sparse Component Analysis for blind source separation: principles, perspectives, and new challenges , 2006, ESANN.

[38]  Chang Dong Yoo,et al.  Underdetermined Independent Component Analysis by Data Generation , 2004, ICA.

[39]  Jian Li,et al.  Amplitude estimation of sinusoidal signals: survey, new results, and an application , 2000, IEEE Trans. Signal Process..

[40]  M. B. Priestley,et al.  Non-linear and non-stationary time series analysis , 1990 .

[41]  Thomas Kailath,et al.  ESPRIT-estimation of signal parameters via rotational invariance techniques , 1989, IEEE Trans. Acoust. Speech Signal Process..

[42]  R. Fletcher Practical Methods of Optimization , 1988 .

[43]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[44]  R. Zdunek,et al.  Non-negative tensor factorization for vibration-based local damage detection , 2023, Mechanical Systems and Signal Processing.

[45]  Fei Liu,et al.  Impulsive components separation using minimum-determinant KL-divergence NMF of bi-variable map for bearing diagnosis , 2022, Mechanical Systems and Signal Processing.

[46]  P. S. Heyns,et al.  Importance of temporal preserving latent analysis for latent variable models in fault diagnostics of rotating machinery , 2022, Mechanical Systems and Signal Processing.

[47]  Min Li,et al.  A distributed dynamic load identification method based on the hierarchical-clustering-oriented radial basis function framework using acceleration signals under convex-fuzzy hybrid uncertainties , 2022, Mechanical Systems and Signal Processing.

[48]  A. Swami,et al.  Overlapping Community Detection via Semi-Binary Matrix Factorization: Identifiability and Algorithms , 2022, IEEE Transactions on Signal Processing.

[49]  Ramandeep Kaur,et al.  A Survey of Clustering Techniques , 2010 .

[50]  Jérôme Antoni,et al.  Second Order Blind Source Separation techniques (SO-BSS) and their relation to Stochastic Subspace Identification (SSI) algorithm , 2011 .

[51]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[52]  Jin Chen,et al.  A novel dictionary learning named deep and shared dictionary learning for fault diagnosis , 2022, Mechanical Systems and Signal Processing.

[53]  M. Rébillat,et al.  Real-time sinusoidal parameter estimation for damage growth monitoring during ultrasonic very high cycle fatigue tests , 2022, Mechanical Systems and Signal Processing.

[54]  Jia-jia Jiang,et al.  Reconstruction of blade tip-timing signals based on the MUSIC algorithm , 2022 .

[55]  Shenxin Yin,et al.  A focusing MUSIC algorithm for baseline-free Lamb wave damage localization , 2022 .