Sentient map – a new paradigm for visual computing

Abstract A sentient map enables the user to view a collection of information items as a map so that gestures, or more specifically c-gestures, can be used for the interaction between the user and the information system. Different c-gestures are dynamically transformed into spatial/temporal queries, or σ-queries, for accessing the information items in multimedia databases and data sources. An application in e-learning called the Growing Book is described. The visual computing paradigm offered by the sentient map can be summarized as follows: “I come, I see, I gesture”.

[1]  Monica Bordegoni An Environment for the Specification and Recognition of Dynamic Gestures , 1994, J. Vis. Lang. Comput..

[2]  Erland Jungert,et al.  A Spatial/Temporal Query Language for Multiple Data Sources in a Heterogeneous Information System Environment , 1998, Int. J. Cooperative Inf. Syst..

[3]  Tsuhan Chen,et al.  Gesture-enhanced information retrieval and presentation in a distributed learning environment , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[4]  Shi-Kuo Chang MAWC Operations for the Growing Book , 2001, MDIC.

[5]  Sylvie Gibet,et al.  High level specification and control of communication gestures: the GESSYCA system , 1999, Proceedings Computer Animation 1999.

[6]  Jean-Claude Martin,et al.  A Unified Framework for Constructing Multimodal Experiments and Applications , 1998, Cooperative Multimodal Communication.

[7]  Shi-Kuo Chang The Sentient Map , 2000, J. Vis. Lang. Comput..

[8]  Erland Jungert,et al.  Symbolic Projection for Image Information Retrieval and Spatial Reasoning , 1996, Symbolic Projection for Image Information Retrieval and Spatial Reasoning.