Feature extraction of temporal texture based on spatiotemporal motion trajectory

A framework and method are proposed to extract local features of a certain kind of naturally occurring, non-rigid motion pattern, referred to as temporal texture. To catch both the spatial and temporal features of this complex pattern, we focus on the surfaces of motion trajectories in spatiotemporal space derived from multiple frames of an image sequence, and represent the surfaces as a set of tangent planes of the surfaces. From the distribution of the tangent planes in local regions in time and space, spatial and temporal texture features are computed The features considered here include spatial arrangement of dominant contours, uniformity of velocity components, and trajectory run length. Experimental results show that the newly defined features have the capability of quantifying the features of complex motion patterns such as weather radar images.

[1]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[2]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  Charles R. Dyer,et al.  Computing spatiotemporal surface flow , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Randal C. Nelson,et al.  Qualitative recognition of motion using temporal texture , 1992, CVGIP Image Underst..

[5]  Hiroshi Harashima,et al.  Spatiotemporal representation of dynamic objects , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Mubarak Shah,et al.  Motion-based recognition a survey , 1995, Image Vis. Comput..

[7]  Martin Szummer,et al.  Temporal texture modeling , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  Satoshi Suzuki,et al.  Image velocity estimation from trajectory surface in spatiotemporal space , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.