Summaries of 107 Computer Vision-Based Human Motion Capture Papers

This technical report contains summaries of 107 papers concerned with computer vision-based human motion capture. The report can be seen as an appendix to a survey, Computer Vision-Based Human Motion Capture A Survey, which I wrote in parallel to this report. The survey gives a taxonomy for the papers described in this report. The summaries are presented in alphabetic order, with respect to the surname of the rst Author. I have tried to give objective summaries of the di erent papers and only give subjective critique in an item, comments, reserved for this purpose. I have also tried to use the same amount of energy and space on the di erent summaries. But large variations between the length of the di erent summaries can be observed. This is mainly due to the length of the papers, but also due to my interest in the individual papers. Preface This technical report contains summaries of 107 papers concerned with computer vision-based human motion capture. The report can be seen as an appendix to a survey, Computer Vision-Based Human Motion Capture A Survey, which I wrote in parallel to this report. This report has been written as a separate report due to its size alone. The writing of the two reports was carried out in the winter 98/99 while the reading of papers was done during the summer and fall of 1998. The work presented is the rst step in my Ph.D.-study titled: "Multiple Cues for Model-Based Human Motion Capture". Whenever I use 'he' throughout the report is should be read as he/she. Aalborg, Denmark, March 1999. Thomas B. Moeslund (tbm@vision.auc.dk)

[1]  Trevor Darrell,et al.  A novel environment for situated vision and behavior , 1994 .

[2]  J. Sklansky,et al.  Segmentation of people in motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[3]  David C. Hogg.  Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[4]  James W. Davis,et al.  Virtual PAT: A Virtual Personal Aerobics Trainer , 1998 .

[5]  Kee Chang Lee,et al.  Virtual Stage: A Location-Based Karaoke System , 1998, IEEE Multim..

[6]  Pietro Perona,et al.  Monocular tracking of the human arm in 3D , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Ioannis A. Kakadiaris,et al.  Vision-based animation of digital humans , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[8]  Yoshiaki Shirai,et al.  Detection of the movements of persons from a sparse sequence of TV images , 1983, Pattern Recognition.

[9]  Ioannis A. Kakadiaris,et al.  Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  A F Bobick,et al.  Movement, activity and action: the role of knowledge in the perception of motion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Takeo Kanade,et al.  Constructing virtual worlds using dense stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Ramesh C. Jain,et al.  Reality modeling and visualization from multiple video sequences , 1996, IEEE Computer Graphics and Applications.

[13]  Aaron F. Bobick,et al.  Computers Seeing Action , 1996, BMVC.

[14]  Alex Pentland,et al.  Staying Alive: A Virtual Reality Visualization Tool for Cancer Patients , 1996 .

[15]  Ioannis A. Kakadiaris,et al.  3D human body model acquisition from multiple views , 1995, Proceedings of IEEE International Conference on Computer Vision.

[16]  Alex Pentland,et al.  Perceptive Spaces for Performance and Entertainment Untethered Interaction Using Computer Vision and Audition , 1997, Appl. Artif. Intell..

[17]  Andrea Bottino,et al.  Toward Non-intrusive Motion Capture , 1998, ACCV.

[18]  Atsushi Nakazawa,et al.  Human tracking using distributed vision systems , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[19]  Fink Philip,et al.  Three-Dimensional Analysis of Human Movement , 1995 .

[20]  David Hansel,et al.  A model driven 3D image interpretation system applied to person detection in video images , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[21]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Other Conferences.

[22]  H. Nagel,et al.  Tracking of persons in monocular image sequences , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[23]  A. Pentland.  Smart rooms, smart clothes , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[24]  Geoffrey D. Sullivan,et al.  Model-based Recognition of Human Posture using Single Synthetic Images , 1989, Alvey Vision Conference.

[25]  PeopleIsmail,et al.  W 4 : Who ? When ? Where ? What ? A Real Time System for Detecting and Tracking , 1998 .

[26]  Helen C. Shen,et al.  A 3D Reconstruction System for Human Body Modeling , 1998, CAPTECH.

[27]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[28]  Noboru Ohnishi,et al.  Cue circles: image feature for measuring 3-D motion of articulated objects using sequential image pair , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[29]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  J. Crowley.  Recognizing Motion Using Local Appearance , 1998 .

[31]  Yee-Hong Yang,et al.  Log-Tracker: an Attribute-Based Approach to Tracking Human Body Motion , 1991, Int. J. Pattern Recognit. Artif. Intell..

[32]  Gang Xu,et al.  Tracking Human Body Motion Based on a Stick Figure Model , 1994, J. Vis. Commun. Image Represent..

[33]  Hironobu Fujiyoshi,et al.  Real-time human motion analysis by image skeletonization , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[34]  Kazuo Kyuma,et al.  Computer vision for computer games , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[35]  T. M. Kepple.  MOVE3D-software for analyzing human motion , 1992, Proceedings of the Johns Hopkins National Search for Computing Applications to Assist Persons with Disabilities.

[36]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[37]  Yee-Hong Yang,et al.  A region based approach for human body motion analysis , 1987, Pattern Recognit..

[38]  Yee-Hong Yang,et al.  First Sight: A Human Body Outline Labeling System , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  James W. Davis,et al.  The Representation and Recognition of Action Using Temporal Templates , 1997, CVPR 1997.

[40]  M. Rossi,et al.  Tracking and counting moving people , 1994, Proceedings of 1st International Conference on Image Processing.

[41]  Larry S. Davis,et al.  Ghost: a human body part labeling system using silhouettes , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[42]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[43]  Thomas B. Moeslund,et al.  Computer Vision-Based Human Motion Capture - A Survey , 1999 .

[44]  Michael J. Black,et al.  Cardboard people: a parameterized model of articulated image motion , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[45]  J. Ohya,et al.  Real-time estimation of human body posture from monocular thermal images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Jake K. Aggarwal,et al.  Tracking human motion in an indoor environment , 1995, Proceedings., International Conference on Image Processing.

[47]  Masanori Yamada,et al.  A new robust real-time method for extracting human silhouettes from color images , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[48]  Michel Dhome,et al.  Human body limbs tracking by multi-ocular vision , 1997 .

[49]  Andrew Bernat,et al.  Security Applications Of Computer Motion Detection , 1987, Other Conferences.

[50]  Masahiko Yachida,et al.  Multiple-view-based tracking of multiple humans , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[51]  Hans-Hellmut Nagel,et al.  Tracking Persons in Monocular Image Sequences , 1999, Comput. Vis. Image Underst..

[52]  Michael J. Black,et al.  Parameterized Modeling and Recognition of Activities , 1999, Comput. Vis. Image Underst..

[53]  Claudio S. Pinhanez,et al.  Using Computer Vision to Control a Reactive Computer Graphics Character in a Theater Play , 1999, ICVS.

[54]  Minoru Asada,et al.  MDL-based spatiotemporal segmentation from motion in a long image sequence , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[55]  Christopher R. Wren,et al.  Real-Time 3-D Tracking of the Human Body , 1996 .

[56]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[57]  James W. Davis,et al.  An appearance-based representation of action , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[58]  Paul Allard,et al.  Three-dimensional analysis of human movement , 1995 .

[59]  Takuya Kondo,et al.  Skill recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[60]  R. Nelson,et al.  Low level recognition of human motion (or how to get your man without finding his body parts) , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[61]  Patrick Bouthemy,et al.  Complex object tracking by visual servoing based on 2D image motion , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[62]  Jiang Yu Zheng,et al.  A model based approach in extracting and generating human motion , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[63]  Helen C. Shen,et al.  3-D Reconstruction of Multipart Self-Occluding Objects , 1998, ACCV.

[64]  Karl Rohr,et al.  Human Movement Analysis Based on Explicit Motion Models , 1997 .

[65]  Alex Pentland,et al.  Dynamic models of human motion , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[66]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[67]  Daniel Thalmann,et al.  A real time anatomical converter for human motion capture , 1996 .

[68]  Juhui Wang,et al.  Human motion analysis with detection of subpart deformations , 1992, Electronic Imaging.

[69]  Peter Nordlund,et al.  Figure-ground segmentation using multiple cues , 1998 .

[70]  Jake K. Aggarwal,et al.  Tracking human motion using multiple cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[71]  David C. Hogg,et al.  An Eecient Method for Contour Tracking Using Active Shape Models , 1994 .

[72]  J. O'Rourke,et al.  Model-based image analysis of human motion using constraint propagation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Yee-Hong Yang,et al.  Human body motion segmentation in a complex scene , 1987, Pattern Recognit..

[74]  Koichiro Akita,et al.  Image sequence analysis of real world human motion , 1984, Pattern Recognit..

[75]  Masanobu Yamamoto,et al.  Human motion analysis based on a robot arm model , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[76]  Yuhua Luo,et al.  An automatic rotoscopy system for human motion based on a biomechanic graphical model , 1992, Comput. Graph..

[77]  Larry S. Davis,et al.  Visual Surveillance of Human Activity , 1998, ACCV.

[78]  R. Jain,et al.  Estimation of articulated motion using kinematically constrained mixture densities , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[79]  Alex Pentland,et al.  Machine Understanding of Human Action , 1995 .

[80]  Yi Li,et al.  Human posture recognition using multi-scale morphological method and Kalman motion estimation , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[81]  Matthew Turk,et al.  Visual interaction with lifelike characters , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[82]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[83]  Pietro Perona,et al.  Reach out and touch space (motion learning) , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[84]  Jake K. Aggarwal,et al.  Articulated and elastic non-rigid motion: a review , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[85]  Carlo S. Regazzoni,et al.  Human body modelling for people localization and tracking from real image sequences , 1995 .

[86]  Christian Wöhler,et al.  Motion-based recognition of pedestrians , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[87]  Aaron F. Bobick,et al.  Recognition of human body motion using phase space constraints , 1995, Proceedings of IEEE International Conference on Computer Vision.

[88]  J. Aggarwal,et al.  Lower limb kinematics of human walking with the medial axis transformation , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[89]  Mubarak Shah,et al.  Motion-based recognition a survey , 1995, Image Vis. Comput..

[90]  Hsi-Jian Lee,et al.  Knowledge-guided visual perception of 3-D human gait from a single image sequence , 1992, IEEE Trans. Syst. Man Cybern..