RTSNet: Learning to Smooth in Partially Known State-Space Models

The smoothing task is core to many signal processing applications. A widely popular smoother is the Rauch-Tung-Striebel (RTS) algorithm, which achieves minimal mean-squared error recovery with low complexity for linear Gaussian state space (SS) models, yet is limited in systems that are only partially known, as well as non-linear and non-Gaussian. In this work we propose RTSNet, a highly efficient model-based and data-driven smoothing algorithm suitable for partially known SS models. RTSNet integrates dedicated trainable models into the flow of the classical RTS smoother, while iteratively refining its sequence estimate via deep unfolding methodology. As a result, RTSNet learns from data to reliably smooth when operating under model mismatch and non-linearities while retaining the efficiency and interpretability of the traditional RTS smoothing algorithm. Our empirical study demonstrates that RTSNet overcomes non-linearities and model mismatch, outperforming classic smoothers operating with both mismatched and accurate domain knowledge. Moreover, while RTSNet is based on compact neural networks, which leads to faster training and inference times, it demonstrates improved performance over previously proposed deep smoothers in non-linear settings.

[1]  Nir Shlezinger,et al.  Latent-KalmanNet: Learned Kalman Filtering for Tracking from High-Dimensional Signals , 2023, IEEE Transactions on Signal Processing.

[2]  Antônio H. Ribeiro,et al.  Deep networks for system identification: a Survey , 2023, Automatica.

[3]  Nir Shlezinger,et al.  Learn to Rapidly and Robustly Optimize Hybrid Precoding , 2023, IEEE Transactions on Communications.

[4]  Ju Sun,et al.  NCVX: A General-Purpose Optimization Solver for Constrained Machine and Deep Learning , 2022, ArXiv.

[5]  Nir Shlezinger,et al.  Discriminative and Generative Learning for Linear Estimation of Random Signals [Lecture Notes] , 2022, ArXiv.

[6]  Yonina C. Eldar,et al.  RTSNet: Deep Learning Aided Kalman Smoothing , 2022, ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Stephen P. Boyd,et al.  Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization , 2022, IEEE Access.

[8]  Yonina C. Eldar,et al.  Unsupervised Learned Kalman Filtering , 2021, 2022 30th European Signal Processing Conference (EUSIPCO).

[9]  W. Gilpin Chaos as an interpretable benchmark for forecasting and data-driven modelling , 2021, NeurIPS Datasets and Benchmarks.

[10]  Yonina C. Eldar,et al.  Uncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Models , 2021, ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Nir Shlezinger,et al.  Data-Driven Kalman-Based Velocity Estimation for Autonomous Racing , 2021, 2021 IEEE International Conference on Autonomous Systems (ICAS).

[12]  Yonina C. Eldar,et al.  KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics , 2021, IEEE Transactions on Signal Processing.

[13]  Ruixin Niu,et al.  EKFNet: Learning System Noise Statistics from Measurement Data , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Mattia Zorzi,et al.  Learning the tuned liquid damper dynamics by means of a robust EKF , 2021, 2021 American Control Conference (ACC).

[15]  Yonina C. Eldar,et al.  Model-Based Deep Learning , 2020, Proceedings of the IEEE.

[16]  Stephen P. Boyd,et al.  Learning Convex Optimization Models , 2020, IEEE/CAA Journal of Automatica Sinica.

[17]  Long Quan,et al.  KFNet: Learning Temporal Camera Relocalization Using Kalman Filtering , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yonina C. Eldar,et al.  DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection , 2020, IEEE Transactions on Wireless Communications.

[19]  Yonina C. Eldar,et al.  Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing , 2019, IEEE Signal Processing Magazine.

[20]  Stephen P. Boyd,et al.  Fitting a Kalman Smoother to Data , 2019, 2020 American Control Conference (ACC).

[21]  Victor Garcia Satorras,et al.  Combining Generative and Discriminative Models for Hybrid Inference , 2019, Neural Information Processing Systems.

[22]  Federico Wadehn,et al.  State Space Methods with Applications in Biomedical Signal Processing , 2019 .

[23]  Gregor H. W. Gebhardt,et al.  Recurrent Kalman Networks: Factorized Inference in High-Dimensional Deep Feature Spaces , 2019, ICML.

[24]  Ghulam Rasool,et al.  Constrained State Estimation - A Review , 2018, 1807.03463.

[25]  Ami Wiesel,et al.  Learning to Detect , 2018, IEEE Transactions on Signal Processing.

[26]  Sharon Gannot,et al.  A Hybrid Approach for Speaker Tracking Based on TDOA and Data-Driven Models , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[27]  Marco Fraccaro,et al.  A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning , 2017, NIPS.

[28]  Nassir Navab,et al.  Long Short-Term Memory Kalman Filters: Recurrent Neural Estimators for Pose Regularization , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Alexander J. Smola,et al.  Latent LSTM Allocation: Joint Clustering and Non-Linear Dynamic Modeling of Sequence Data , 2017, ICML.

[30]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[31]  Ka-Veng Yuen,et al.  Stable Robust Extended Kalman Filter , 2017 .

[32]  Uri Shalit,et al.  Structured Inference Networks for Nonlinear State Space Models , 2016, AAAI.

[33]  Lennart Ljung,et al.  Generalized Kalman smoothing: Modeling and algorithms , 2016, Autom..

[34]  Justin Dauwels,et al.  Outlier-insensitive Kalman smoothing and marginal message passing , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[35]  Sergey Levine,et al.  Backprop KF: Learning Discriminative Deterministic State Estimators , 2016, NIPS.

[36]  Maximilian Karl,et al.  Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data , 2016, ICLR.

[37]  Hans-Andrea Loeliger,et al.  On sparsity by NUV-EM, Gaussian message passing, and Kalman smoothing , 2016, 2016 Information Theory and Applications Workshop (ITA).

[38]  Luca Martino,et al.  Cooperative parallel particle filters for online model selection and applications to urban mobility , 2015, Digit. Signal Process..

[39]  Il Memming Park,et al.  BLACK BOX VARIATIONAL INFERENCE FOR STATE SPACE MODELS , 2015, 1511.07367.

[40]  Uri Shalit,et al.  Deep Kalman Filters , 2015, ArXiv.

[41]  Mattia Zorzi,et al.  On the robustness of the Bayes and Wiener estimators under model uncertainty , 2015, Autom..

[42]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[43]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[44]  J. Burke,et al.  Optimization viewpoint on Kalman smoothing, with applications to robust and sparse estimation , 2013, 1303.1993.

[45]  Aleksandr Y. Aravkin,et al.  Sparse/robust estimation and Kalman smoothing with nonsmooth log-concave densities: modeling, computation, and theory , 2013, J. Mach. Learn. Res..

[46]  Aleksandr Y. Aravkin,et al.  Smoothing dynamic systems with state-dependent covariance matrices , 2012, 53rd IEEE Conference on Decision and Control.

[47]  Jeffrey Humpherys,et al.  A Fresh Look at the Kalman Filter , 2012, SIAM Rev..

[48]  G. Pillonetto,et al.  An $\ell _{1}$-Laplace Robust Kalman Smoother , 2011, IEEE Transactions on Automatic Control.

[49]  Andrew W. Eckford,et al.  Expectation Maximization as Message Passing - Part I: Principles and Gaussian Messages , 2009, ArXiv.

[50]  Bjarne A. Foss,et al.  Applying the unscented Kalman filter for nonlinear state estimation , 2008 .

[51]  Simo Särkkä,et al.  Unscented Rauch-Tung-Striebel Smoother , 2008, IEEE Trans. Autom. Control..

[52]  Li Ping,et al.  The Factor Graph Approach to Model-Based Signal Processing , 2007, Proceedings of the IEEE.

[53]  Melvin J. Hinich,et al.  Time Series Analysis by State Space Methods , 2001 .

[54]  A. Doucet,et al.  Monte Carlo Smoothing for Nonlinear Time Series , 2004, Journal of the American Statistical Association.

[55]  Index , 1999, Brain Research.

[56]  P. Moral,et al.  Nonlinear filtering : Interacting particle resolution , 1997 .

[57]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[58]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[59]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[60]  M. Gruber AN APPROACH TO TARGET TRACKING , 1967 .

[61]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[62]  R. Kálmán A new approach to linear filtering and prediction problems" transaction of the asme~journal of basic , 1960 .

[63]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series, with Engineering Applications , 1949 .

[64]  Matthias W. Seeger,et al.  Deep State Space Models for Time Series Forecasting , 2018, NeurIPS.

[65]  Ka-Veng Yuen,et al.  Online updating and uncertainty quantification using nonstationary output-only measurement , 2016 .

[66]  Yoshua Bengio Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[67]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[68]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[69]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[70]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[71]  G. Bierman Fixed interval smoothing with discrete measurements , 1972 .

[72]  R. M. Dressler,et al.  APPLICATION OF THE EXTENDED KALMAN FILTER TO BALLISTIC TRAJECTORY ESTIMATION. , 1967 .