The outlines of a theory and technology of human-computer interaction as represented in the model of the HuComTech project

The HuComTech project aims at developing a theory of multimodal human-computer interaction linking knowledge about human-human interaction to technological implementation. The purpose is to contribute to a more efficient and human-like human-computer interaction system by defining the main structural elements of communication, identifying their markers and defining their alignment with other markers in a multimodal environment. The novelty of the proposed system is its bidirectionality (both analysis and synthesis). This advantage is utilized in a new multimodal corpus and database.

[1]  Siobhan Chapman Logic and Conversation , 2005 .

[2]  D. Sperber,et al.  Relevance: Communication and Cognition , 1989 .

[3]  Dan Jurafsky,et al.  Pragmatics and Computational Linguistics , 2008 .

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  Takeo Kanade,et al.  Object Detection Using the Statistics of Parts , 2004, International Journal of Computer Vision.

[6]  Fadi Dornaika,et al.  Fast and reliable active appearance model search for 3-D face tracking , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Dan Sperber,et al.  Pragmatics, modularity and mindreading , 2002 .

[8]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[9]  Egon L. van den Broek,et al.  Modeling human color categorization , 2008, Pattern Recognit. Lett..

[10]  J. Oberlander,et al.  Abduction, Belief and Context in Dialogue , 2000 .

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  T Enikő Németh Verbal information transmission without communicative intention , 2008 .

[13]  Sven Behnke,et al.  Feature-based head pose estimation from images , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[14]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.