Fast Non-Linear Methods for Dynamic Texture Prediction

This paper aims to develop a fast dynamic-texture prediction method, using tools from non-linear dynamical modeling, and fast approaches for approximate regression. We consider dynamic textures to be described by patch-level non-linear processes, thus requiring tools such as delay-embedding to uncover a phase-space where dynamical evolution can be more easily modeled. After mapping the observed time-series from a dynamic texture video to its recovered phase-space, a time-efficient approximate prediction method is presented which utilizes locality-sensitive hashing approaches to predict possible phase-space vectors, given the current phase-space vector. Our experiments show the favorable performance of the proposed approach, both in terms of prediction fidelity, and computational time. The proposed algorithm is applied to shading prediction in utility scale solar arrays.

[1]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[2]  Andrea Masiero,et al.  Non Linear Temporal Textures Synthesis: A Monte Carlo Approach , 2006, ECCV.

[3]  Andreas Spanias,et al.  A brief survey of machine learning methods and their sensor and IoT applications , 2017, 2017 8th International Conference on Information, Intelligence, Systems & Applications (IISA).

[4]  E. Nadaraya.  On Estimating Regression , 1964 .

[5]  Mubarak Shah,et al.  Time series prediction by chaotic modeling of nonlinear dynamical systems , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Mahesh K. Banavar,et al.  Signal Processing for Solar Array Monitoring, Fault Detection, and Optimization , 2012, Signal Processing for Solar Array Monitoring, Fault Detection, and Optimization.

[7]  Andreas Spanias,et al.  A cyber-physical system approach for photovoltaic array monitoring and control , 2017, 2017 8th International Conference on Information, Intelligence, Systems & Applications (IISA).

[8]  Andreas Spanias,et al.  A Cyber-Physical Photovoltaic Array Monitoring and Control System , 2017, Int. J. Monit. Surveillance Technol. Res..

[9]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[10]  Andreas Spanias,et al.  Optimizing Kernel Machines Using Deep Learning , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[12]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[13]  Narendra Ahuja,et al.  Dynamic Textures Synthesis as Nonlinear Manifold Learning and Traversing , 2006, BMVC.

[14]  Jens-Rainer Ohm,et al.  Analysis/synthesis coding of dynamic textures based on motion distribution statistics , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[15]  Sabine Süsstrunk,et al.  Higher Order SVD Analysis for Dynamic Texture Synthesis , 2008, IEEE Transactions on Image Processing.

[16]  Michael I. Jordan,et al.  Nonparametric Bayesian Learning of Switching Linear Dynamical Systems , 2008, NIPS.

[17]  Harry Shum,et al.  Synthesizing Dynamic Texture with Closed-Loop Linear Dynamic System , 2004, ECCV.

[18]  Alexandr Andoni,et al.  Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[19]  A. Mees,et al.  Dynamics from multivariate time series , 1998 .

[20]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[21]  Xilin Chen,et al.  Temporally multiple dynamic textures synthesis using piecewise linear dynamic systems , 2013, 2013 IEEE International Conference on Image Processing.

[22]  Andreas Spanias,et al.  Topology reconfiguration for optimization of photovoltaic array output , 2016 .

[23]  Konstantinos G. Derpanis,et al.  Two-Stream Convolutional Networks for Dynamic Texture Synthesis , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[25]  Andreas Spanias,et al.  Shading prediction, fault detection, and consensus estimation for solar array control , 2018, 2018 IEEE Industrial Cyber-Physical Systems (ICPS).

[26]  Leon A. Gatys,et al.  Synthesising Dynamic Textures using Convolutional Neural Networks , 2017, ArXiv.

[27]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[28]  Payam Saisan,et al.  Dynamic texture recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.