Future image frame generation using Artificial Neural Network with selected features

This paper presents a novel approach for the generation of Future image frames using Artificial Neural Network (ANN) on spatiotemporal framework. The input to this network are hyper-dimensional color and spatiotemporal features of every pixel of an image in an image sequence. Principal Component Analysis, Mutual Information, Interaction Information and Bhattacharyya Distance measure based feature selection techniques have been used to reduce the dimensionality of the feature set. The pixel values of an image frame are predicted using a simple ANN back propagation algorithm. The ANN network is trained for R, G and B values for each and every pixel in an image frame. The resulting model is successfully applied on an image sequence of a landing fighter plane. As Mentioned above four feature selection techniques are used to compare the performance of the proposed ANN model. The quality of the generated future image frames is assessed using, Canny edge detection based Image Comparison Metric(CIM) and Mean Structural Similarity Index Measure(MSSIM) image quality measures. The proposed approach is found to have generated six future image frames successfully with acceptable quality of images.

[1]  Ai Hui Tan,et al.  From a Gaussian mixture model to additive fuzzy systems , 2005, IEEE Transactions on Fuzzy Systems.

[2]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[3]  William J. McGill Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[4]  Neil A. Thacker,et al.  The Bhattacharyya metric as an absolute similarity measure for frequency coded data , 1998, Kybernetika.

[5]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[6]  Dongfeng Ren,et al.  Research on feature extraction from remote sensing image , 2010, 2010 International Conference on Computer Application and System Modeling (ICCASM 2010).

[7]  Nikhil R. Pal,et al.  Prediction of satellite images using fuzzy rule based Gaussian regression , 2010, 2010 IEEE 39th Applied Imagery Pattern Recognition Workshop (AIPR).

[8]  Colas Schretter,et al.  Information-Theoretic Feature Selection in Microarray Data Using Variable Complementarity , 2008, IEEE Journal of Selected Topics in Signal Processing.

[9]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Nishchal K. VermaandM Interactive Fuzzy System Using CWM , 2005 .

[11]  Fengxi Song,et al.  Feature Selection Using Principal Component Analysis , 2010, 2010 International Conference on System Science, Engineering Design and Manufacturing Informatization.

[12]  X. Guorong,et al.  Bhattacharyya distance feature selection , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  Xinghuo Yu,et al.  A general backpropagation algorithm for feedforward neural networks learning , 2002, IEEE Trans. Neural Networks.

[14]  Hayit Greenspan,et al.  Probabilistic space-time video modeling via piecewise GMM , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Chulhee Lee,et al.  Feature extraction based on the Bhattacharyya distance for multimodal data , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[16]  Guorong Xuan,et al.  Bhattacharyya distance feature selection , 1996, ICPR.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  W.C. Chan,et al.  A wavelet and Canny based image comparison , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[19]  Bhaskar D. Rao,et al.  A generalized learning paradigm exploiting the structure of feedforward neural networks , 1996, IEEE Trans. Neural Networks.

[20]  W. J. McGill Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.