Motion Analysis: Past, Present and Future

The subject of motion has been the center of interdisciplinary studies since the time when Zeno posed his paradox circa 500BC. However, computer vision, the use of a camera and a computer to recognize objects, people and/or events automatically, is a relatively young field of research. Its development began in the early 1960s; however, it has matured fairly quickly. Today, it is contributing to the solutions of some of the most serious societal problems. Motion analysis of a sequence of images is an important part of computer vision. This chapter briefly presents the contributions to motion analysis from other fields followed by the computer vision-based analysis of motion from a sequence of images. Analysis and understanding of images based on both feature tracking and optical flow estimation are presented. Early works focused on the computation of structure from motion of objects from a sequence of images via point features. This was followed by the computation of optical flow to characterize motion. Applications today focus on the monitoring of traffic, providing guidance to a motorist in terms of his/her position relative to traffic lanes and traffic ahead, and inspection of complicated three-dimensional industrial parts, to mention a few. Research focus has shifted from inanimate objects to people, for example monitoring people and their activities in public places or monitoring activities from an unmanned aerial vehicle. These applications are dominating the research scene through the belief that computer vision/motion analysis can contribute to the solution of societal surveillance and biometric problems. The chapter ends with a discussion of the future directions of research in motion analysis and possible applications.

[1]  R. Addams LI. An account of a peculiar optical phænomenon seen after having looked at a moving body , 1834 .

[2]  H. Wallach,et al.  The kinetic depth effect. , 1953, Journal of experimental psychology.

[3]  Wesley C. Salmon,et al.  Zeno's Paradoxes, , 1970 .

[4]  G. Johansson Visual motion perception. , 1975, Scientific American.

[5]  Jake K. Aggarwal,et al.  Computer Analysis of Moving Polygonal Images , 1975, IEEE Transactions on Computers.

[6]  S. Ullman The interpretation of structure from motion , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[8]  R. Woodham,et al.  Determining the movement of objects from a sequence of images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[11]  Jake K. Aggarwal,et al.  Structure from Motion of Rigid and Jointed Objects , 1981, Artif. Intell..

[12]  Thomas S. Huang,et al.  Image Sequence Processing and Dynamic Scene Analysis , 1983, NATO ASI Series.

[13]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[15]  J. Aggarwal,et al.  Motion Understanding: Robot and Human Vision , 1988 .

[16]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[17]  S. Zeki The visual image in mind and brain. , 1992, Scientific American.

[18]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[21]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[22]  Rachid Deriche,et al.  Optical-Flow Estimation while Preserving Its Discontinuities: A Variational Approach , 1995, ACCV.

[23]  Mubarak Shah,et al.  Motion-based recognition a survey , 1995, Image Vis. Comput..

[24]  Shlomo Nir,et al.  NATO ASI Series , 1995 .

[25]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[26]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .

[27]  Larry S. Davis,et al.  W/sup 4/: Who? When? Where? What? A real time system for detecting and tracking people , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[28]  Jake K. Aggarwal,et al.  Tracking Human Motion in Structured Environments Using a Distributed-Camera System , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interaction , 1999, ICVS.

[30]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[31]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[32]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Harriet A Allen,et al.  Visual mechanisms of motion analysis and motion perception. , 2004, Annual review of psychology.

[34]  Jake K. Aggarwal,et al.  A hierarchical Bayesian network for event recognition of human actions and interactions , 2004, Multimedia Systems.

[35]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[36]  David J. Fleet,et al.  Optical Flow Estimation , 2006, Handbook of Mathematical Models in Computer Vision.

[37]  Yiannis Aloimonos,et al.  A Roadmap to the Integration of Early Visual Modules , 2007, International Journal of Computer Vision.

[38]  Carlos Vázquez,et al.  Joint multiregion segmentation and parametric estimation of image motion by basis function representation and level set evolution , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Shree K. Nayar,et al.  Cata-Fisheye Camera for Panoramic Imaging , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[40]  Jake K. Aggarwal,et al.  Semantic Representation and Recognition of Continued and Recursive Human Activities , 2009, International Journal of Computer Vision.

[41]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Bertrand Russell THE PROBLEM OF INFINITY CONSIDERED HISTORICALLY , 2009 .

[43]  Narendra Ahuja,et al.  A hemispherical imaging camera , 2010, Comput. Vis. Image Underst..

[44]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[45]  Javier Sánchez Pérez,et al.  TV-L1 Optical Flow Estimation , 2013, Image Process. Line.