Developing Intelligent MultiMedia applications

Intelligent multimedia (IntelliMedia), which involves the computer processing and understanding of perceptual input from at least speech, text and visual images, and then reacting to it, is complex and involves signal and symbol processing techniques from not just engineering and computer science but also artificial intelligence and cognitive science (Mc Kevitt, 1994, 1995/96, 1997). With IntelliMedia systems, people can interact in spoken dialogues with machines, querying about what is being presented and even their gestures and body language can be interpreted.

[1]  Thomas B. Moeslund,et al.  A platform for developing Intelligent MultiMedia applications , 1998 .

[2]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[3]  Heidi Christensen,et al.  Functional Specification of the CPK Spoken Language Recognition Research System (SLANG) , 1997 .

[4]  Mark T. Maybury,et al.  Planning Multimedia Explanations Using Communicative Acts , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[5]  Wolfgang Wahlster,et al.  Smartkom: multimodal communication with a life- like character , 2001, INTERSPEECH.

[6]  Thomas Rist,et al.  On the Simultaneous Interpretation of Real World Image Sequences and their Natural Language Description: The System Soccer , 1988, ECAI.

[7]  Michael Manthey.  THE PHASE WEB PARADIGM , 1998 .

[8]  Retz-Schmidt Gudula.  Recognizing intentions, interactions, and causes of plan failures , 1991 .

[9]  Derek Partridge.  A new guide to artificial intelligence , 1991, Ablex series in computational science.

[10]  Wolfgang Wahlster,et al.  Incremental Natural Language Description of Dynamic Imagery , 1989, Wissensbasierte Systeme.

[11]  R. Lewin.  The book , 1986, Nature.

[12]  Thomas Rist,et al.  The Design of Illustrated Documents as a Planning Task , 1993, AAAI Workshop on Intelligent Multimedia Interfaces.

[13]  Oliviero Stock,et al.  Natural Language and Exploration of an Information Space: The ALFresco Interactive System , 1991, IJCAI.

[14]  J. Cassell,et al.  Communicative humanoids: a computational model of psychosocial dialogue skills , 1996 .

[15]  Ipke Wachsmuth,et al.  Collaborative Research Centre “Situated Artificial Communicators” at the University of Bielefeld, Germany , 2004, Artificial Intelligence Review.

[16]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[17]  Wolfgang Wahlster,et al.  Readings in Intelligent User Interfaces , 1998 .

[18]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[19]  W. Wahister.  One word says more than a thousand pictures: on the automatic verbalization of the results of image sequence analysis system , 1987 .

[20]  Gernot A. Fink,et al.  A communication framework for heterogeneous distributed pattern analysis , 1995, Proceedings 1st International Conference on Algorithms and Architectures for Parallel Processing.

[21]  Paul McKevitt,et al.  Integration of Natural Language and Vision Processing , 1996, Springer Netherlands.

[22]  W. Maab,et al.  Vitra guide: multimodal route descriptions for computer assisted vehicle navigation , 1993 .

[23]  Wolfgang Wahlster,et al.  Plan-Based Integration of Natural Language and Graphics Generation , 1993, Artif. Intell..

[24]  Naoyuki Okada.  Integrating vision, motion and language through mind , 2004, Artificial Intelligence Review.

[25]  Mark T. Maybury,et al.  Intelligent multimedia interfaces , 1994, CHI Conference Companion.

[26]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[27]  Gudula Retz-Schmidt,et al.  Methods for the Intentional Description of Image Sequences , 1991, Wissensbasierte Systeme.

[28]  Paul Dalsgaard,et al.  A frame semantics for an IntelliMedia TourGuide , 1997 .

[29]  Bernd Neumann,et al.  NOAS: Ein System zur natürlichsprachlichen Beschreibung zeitveränderlicher Szenen , 1986, Inform. Forsch. Entwickl..

[30]  Marvin Minsky,et al.  A framework for representing knowledge" in the psychology of computer vision , 1975 .

[31]  Zenon W. Pylyshyn,et al.  What the Mind’s Eye Tells the Mind’s Brain: A Critique of Mental Imagery , 1973 .

[32]  Fabio Pianesi,et al.  Natural language generation and hypertext access , 1993, Appl. Artif. Intell..

[33]  S. Kosslyn,et al.  Imagery, propositions, and the form of internal representations , 1977, Cognitive Psychology.

[34]  Fredrik Bajers.  Reference Problems in Chameleon , 1999 .

[35]  H. Ritter,et al.  A distributed system for integrated speech and image understanding , 2002, Proceedings Mexico-USA Collaboration in Intelligent Systems Technologies..

[36]  Tom Brøndsted.  The natural language processing modules in REWARD and intellimedia 2000 , 1999 .

[37]  Fredrik Bajers.  THE CPK NLP SUITE FOR SPOKEN LANGUAGE UNDERSTANDING , 1999 .

[38]  Wolfgang Wahlster,et al.  One word says more than a thousand pictures , 1989 .

[39]  Poul Leth-Espensen,et al.  Separation of Speech Signals using Eigenfiltering in a Dual Beamforming System , 1996 .

[40]  Tom Brøndsted,et al.  Sprog og multimedier , 1997 .