First Sight: A Human Body Outline Labeling System

First Sight, a vision system in labeling the outline of a moving human body, is proposed in this paper. The emphasis of First Sight is on the analysis of motion information gathered solely from the outline of a moving human object. Two main processes are implemented in First Sight. The first process uses a novel technique to extract the outline of a moving human body from an image sequence. The second process, which employs a new human body model, interprets the outline and produces a labeled two-dimensional human body stick figure for each frame of the image sequence. Extensive knowledge of the structure, shape, and posture of the human body is used in the model. The experimental results of applying the technique on unedited image sequences with self-occlusions and missing boundary lines are encouraging. >

[1]  G. Johansson.  Visual perception of biological motion and a model for its analysis , 1973 .

[2]  Rudolf von Laban,et al.  Laban's principles of dance and movement notation , 1975 .

[3]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[4]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[5]  Martin Herman,et al.  Understanding body postures of human stick figures , 1979 .

[6]  Norman I. Badler,et al.  Digital Representations of Human Movement , 1979, CSUR.

[7]  J. O'Rourke,et al.  A spherical representation of a human body for visualizing movement , 1979, Proceedings of the IEEE.

[8]  K. Ramesh Babu,et al.  Linear Feature Extraction and Description , 1979, IJCAI.

[9]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  R. F. Rashid,et al.  Towards a system for the interpretation of moving light displays , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jake K. Aggarwal,et al.  Visually Interpreting the Motion of Objects in Space , 1981, Computer.

[13]  Ramesh C. Jain,et al.  Extraction of Motion Information from Peripheral Processes , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[15]  Jake K. Aggarwal,et al.  Survey: representation methods for three-dimensional objects. , 1981 .

[16]  David C. Hogg.  Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[17]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[18]  Koichiro Akita,et al.  Image sequence analysis of real world human motion , 1984, Pattern Recognit..

[19]  Azriel Rosenfeld,et al.  Axial representations of shape , 1986, Computer Vision Graphics and Image Processing.

[20]  Yee-Hong Yang,et al.  A region based approach for human body motion analysis , 1987, Pattern Recognit..

[21]  Yee-Hong Yang,et al.  Human body motion segmentation in a complex scene , 1987, Pattern Recognit..

[22]  D. Hogg,et al.  Finding a known object using a generate and test strategy , 1988 .

[23]  Jean Ponce,et al.  On characterizing ribbons and finding skewed symmetries , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[24]  Yee-Hong Yang,et al.  Stationary background generation: An alternative to the difference of two images , 1990, Pattern Recognit..

[25]  Yee-Hong Yang,et al.  Log-Tracker: an Attribute-Based Approach to Tracking Human Body Motion , 1991, Int. J. Pattern Recognit. Artif. Intell..

[26]  H. Yang,et al.  First sight: towards a system in human body motion recognition and understanding , 1992 .

[27]  Daniel P. Huttenlocher,et al.  Comparing images using the Hausdorff distance under translation , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  K. Rohr.  Towards model-based recognition of human movements in image sequences , 1994 .