Recognition and simulation of actions performable on rigidly-jointed actors such as human bodies have been the subject of our research for some time. One part of an ongoing effort towards a total human movement simulator is to develop a system to perform the actions of American Sign Language (ASL). However, one of the “channels” of ASL communication, the face, presents problems which are not well handled by a rigid model.
An integrated system for an internal representation and simulation of the face is presented, along with a proposed image analysis model. Results from an implementation of the internal model and simulation modules are presented, as well as comments on the future of computer controlled recognition of facial actions.
We conclude with a discussion on extensions of the system, covering relations between flexible masses and rigid (jointed) ones. Applications of this theory into constrained actions, such as across rigid nonmoving sheets of bone (forehead, eyes) are also discussed.
[1]
R. Birdwhistell.
Kinesics and context
,
1970
.
[2]
R. Birdwhistell.
Kinesics and Context: Essays on Body Motion Communication
,
1971
.
[3]
Frederic I. Parke,et al.
A parametric model for human faces.
,
1974
.
[4]
Ron Hackathorn,et al.
Anima II: a 3-D color animation system
,
1977,
SIGGRAPH.
[5]
N. Badler,et al.
The Simulation of Human Movement by Computer
,
1978
.
[6]
Norman I. Badler,et al.
Digital Representations of Human Movement
,
1979,
CSUR.
[7]
John Chapman,et al.
The integration of subjective and objective data in the animation of human movement
,
1980,
SIGGRAPH '80.
[8]
J. O'Rourke,et al.
Model-based image analysis of human motion using constraint propagation
,
1980,
IEEE Transactions on Pattern Analysis and Machine Intelligence.
[9]
Norman I. Badler,et al.
Human Movement Understanding: A Variety of Perspectives
,
1980,
AAAI.