Perceptual interfaces in human computer interaction

Humans are viewed as efficiently processing multiple sources of information supporting their interactions with the world and with others. This theoretical framework has been successful in predicting for a wide variety of research findings, as well as rationalizing everyday experiences. Existing controversies over perceptual interfaces are considered in terms of this framework. The conclusion is that both inputs and outputs in human computer environments should be characterized by many different sources of information from multiple modalities.

[1]  D. Massaro,et al.  The contribution of fundamental frequency and voice onset time to the /zi/-/si/ distinction. , 1976, The Journal of the Acoustical Society of America.

[2]  Dominic W. Massaro,et al.  Consolidation and interference in the perceptual memory system , 1970 .

[3]  Paul J. Laurienti,et al.  Neural mechanisms for integrating information from multiple senses , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[4]  Go Kawai.  Spoken language processing applied to nonnative language pronunciation learning , 1999 .

[5]  Jörn Ostermann,et al.  Multimodal speech synthesis , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[6]  Ben Shneiderman,et al.  Direct manipulation for comprehensible, predictable and controllable user interfaces , 1997, IUI '97.

[7]  D. Massaro.  Perceiving talking faces: from speech perception to a behavioral principle , 1999 .

[8]  Jacques de Villiers,et al.  New tools for interactive speech and language training: Using animated conversational agents in the classrooms of profoundly deaf children , 1999 .

[9]  Dominic W. Massaro,et al.  Real-time speech synthesis , 1976 .

[10]  Dominic W. Massaro,et al.  SPEECH RECOGNITION AND SENSORY INTEGRATION , 1998 .

[11]  D. Massaro,et al.  Perceiving Talking Faces , 1995 .

[12]  David G. Stork,et al.  Speech recognition and sensory integration , 1998 .

[13]  Eric Petajan,et al.  Approaches to visual speech processing based on the MPEG-4 Face Animation standard , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[14]  Deb Roy,et al.  Learning from multimodal observations , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).