A new image prediction model based on spatio-temporal techniques

This paper addresses an image prediction problem focused on images with no identifiable objects. In it, we present several approaches to predict the next image of a given sequence, when the image lacks the well-defined objects, such as meteorological maps or satellite imagery. In these images no clear borders are present, and any object candidate moves, changes, appears and disappears in any image. Nevertheless, this evolution, though unrestricted, is gradual and, hence, prediction looks feasible. One of the approaches presented here, based on a spatio-temporal autoregressive (STAR) model, offers good results for these kinds of images.The main contribution of this paper is to adapt spatio-temporal models to an image prediction problem.As a byproduct of this research, we have achieved a new image compression method, suitable for images without defined shapes.

[1]  Barak A. Pearlmutter.  Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.

[2]  Timothy F. Cootes,et al.  Comparing Active Shape Models with Active Appearance Models , 1999, BMVC.

[3]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[4]  Alfred Mertins,et al.  Flexible, highly scalable, object-based wavelet image compression algorithm for network applications , 2004 .

[5]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Fernando J. Pineda,et al.  Recurrent Backpropagation and the Dynamical Approach to Adaptive Neural Computation , 1989, Neural Computation.

[7]  A. Lapedes,et al.  Nonlinear signal processing using neural networks: Prediction and system modelling , 1987 .

[8]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[9]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[10]  Ioannis Pitas,et al.  Prediction and tracking of moving objects in image sequences , 2000, IEEE Trans. Image Process..

[11]  P. Pfeifer,et al.  A Three-Stage Iterative Procedure for Space-Time Modeling , 1980 .

[12]  Daoud Berkani,et al.  Low-order model for speech signals , 2004, Signal Processing.

[13]  J. Ramos,et al.  Space-Time Modeling of Vector Hydrologic Sequences , 1986 .

[14]  Milan Sonka,et al.  Robust active appearance models and their application to medical image analysis , 2005, IEEE Transactions on Medical Imaging.

[15]  David I. Harvey.  The evaluation of economic forecasts , 1997 .

[16]  Timothy F. Cootes,et al.  Model-based image analysis of a model organism for life science research , 1999 .

[17]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[18]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[19]  Ronald P. Barry,et al.  Spatiotemporal Autoregressive Models of Neighborhood Effects , 1998 .

[20]  T. Subba Rao,et al.  Spatio-temporal modelling of temperature time series: a comparative study , 2004 .

[21]  Michael Egmont-Petersen,et al.  Image processing with neural networks - a review , 2002, Pattern Recognit..

[22]  Marvin Minsky,et al.  Computation : finite and infinite machines , 2016 .

[23]  J. S. Erkelens,et al.  Autoregressive modeling for speech coding: Estimation, interpolation and quantization , 1996 .

[24]  Scott E. Fahlman,et al.  The Recurrent Cascade-Correlation Architecture , 1990, NIPS.

[25]  Marta E. Zorrilla,et al.  Preprocessing Phase in the PIETSI Project (Prediction of Time Evolution Images Using Intelligent Systems) , 2003, EUROCAST.

[26]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[27]  Timothy F. Cootes,et al.  Active Shape Models and the shape approximation problem , 1996, Image Vis. Comput..

[28]  Marta E. Zorrilla,et al.  Meteorological Image Descriptors , 2005, EUROCAST.

[29]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[30]  Jonathan A. Marshall,et al.  Curved Trajectory Prediction Using a Self-Organizing Neural Network , 2000, Int. J. Neural Syst..

[31]  Timothy F. Cootes,et al.  Statistical models of appearance for medical image analysis and computer vision , 2001, SPIE Medical Imaging.

[32]  C. Lee Giles,et al.  Learning Chaotic Attractors by Neural Networks , 2000, Neural Computation.