A motion trajectory based video retrieval system using parallel adaptive self organizing maps

We present a novel motion trajectory based video retrieval system using LAMSTAR-based adaptive self organizing maps (PASOMs) in this paper. The trajectories are extracted from video by a robust tracker. To reduce the high dimension of motion trajectories, we first decompose each trajectory into sub-trajectories by using a maximum acceleration based approach. Each subtrajectory is then modeled and coded by two different methods, polynomial curving fitting and independent component analysis. To fuse the different features of subtrajectories for more efficient and flexible retrieval, we use PASOMs as the searching tool. Experimental results show the superior performance of the proposed approach for video retrieval comparing with prior approaches.

[1]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[2]  Shih-Fu Chang,et al.  Motion trajectory matching of video objects , 1999, Electronic Imaging.

[3]  Aapo Hyvärinen,et al.  Survey on Independent Component Analysis , 1999 .

[4]  Dan Schonfeld,et al.  Segmented trajectory based indexing and retrieval of video data , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  Avideh Zakhor,et al.  Motion indexing of video , 1997, Proceedings of International Conference on Image Processing.

[6]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..

[7]  Alfred She,et al.  Motion descriptors for content-based video representation , 2000, Signal Process. Image Commun..

[8]  Forouzan Golshani,et al.  Motion recovery for video content classification , 1995, TOIS.

[9]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[10]  Daniel Graupe,et al.  Principles of Artificial Neural Networks , 2018, Advanced Series in Circuits and Systems.