Block-matching-based motion field generation utilizing directional edge displacement

A motion field generation algorithm using block matching of edge flag histograms has been developed aiming at its application to motion recognition systems. Use of edge flags instead of pixel intensities has made the algorithm robust against illumination changes. In order to detect local motions of interest effectively, a new adaptive frame interval adjustment scheme has been introduced in which only the edge flags due to local motions present in the frame are accumulated and utilized in block matching. These edge flags are projected onto x and y axes to generate histograms and the motion in x and y directions are determined by histogram matching. As a result, the computational cost for best match search has been substantially reduced. A vector representation of the motion field, which is called projected principal-motion distribution (PPMD), has also been proposed. It was applied to preliminary motion recognition experiments using Hidden Markov Models (HMMs) and its effectiveness has been confirmed. Moreover the advantage of the proposed motion field generation method over the simple optical flow as well as the conventional block matching method using pixel intensities has been demonstrated.

[1]  Tieniu Tan,et al.  Gesture recognition using temporal template based trajectories , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[3]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Ian D. Reid,et al.  Joint Bayes Filter: A Hybrid Tracker for Non-rigid Hand Motion Recognition , 2004, ECCV.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[7]  Tadashi Shibata,et al.  An edge-based face detection algorithm robust against illumination, focus, and scale variations , 2004, 2004 12th European Signal Processing Conference.

[8]  Philip Kahn,et al.  Integrating moving edge information along a 2D trajectory in densely sampled imagery , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Tadashi Shibata,et al.  An image representation algorithm compatible with neural-associative-processor-based hardware recognition systems , 2003, IEEE Trans. Neural Networks.

[10]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[11]  Tadashi Shibata,et al.  Illumination-invariant face identification using edge-based feature vectors in pseudo-2D Hidden Markov Models , 2006, 2006 14th European Signal Processing Conference.

[12]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  James W. Davis,et al.  Real-time recognition of activity using temporal templates , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[14]  T. Shibata,et al.  A Feature-Based Optical Flow Processor Architecture Featuring Single-Motion-Vector/Cycle Generation , 2007, 2007 International Symposium on System-on-Chip.

[15]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[16]  J. H. Duncan,et al.  On the Detection of Motion and the Computation of Optical Flow , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[19]  Michael J. Black,et al.  Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion , 1995, Proceedings of IEEE International Conference on Computer Vision.

[20]  Randal C. Nelson,et al.  Recognition of motion from temporal texture , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.