The Sentient Map

The sentient map is a new paradigm for visual information retrieval. It enables the user to view data as maps, so that gestures, more specifically c-gestures, can be used for the interaction between the user and the multimedia information system. Different c-gestures are then dynamically transformed into spatial/temporal queries, or ?-queries, for multimedia information sources and databases. An e-learning environment involving many academic institutions serves as a test bed to evaluate this approach.

[1]  Chaitanya K. Baru,et al.  Join and Data Redistribution Algorithms for Hypercubes , 1993, IEEE Trans. Knowl. Data Eng..

[2]  Vincent Oria,et al.  MOQL: A Multimedia Object Query Language , 2000 .

[3]  Azriel Rosenfeld,et al.  Content-Based Access to Multimedia Information , 1999 .

[4]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[5]  J. Black.  Maps and History , 1997 .

[6]  Edward P. F. Chan,et al.  QL/G: A Query Language for Geometric Data Bases , 1996 .

[7]  Russ Holden.  Digital's DB Integrator: a commercial multi-database management system , 1994, Proceedings of 3rd International Conference on Parallel and Distributed Information Systems.

[8]  Geoffrey Z. Liu.  Symbolic projection for image information retrieval and spatial reasoning , 1997 .

[9]  Shi-Kuo Chang.  Extending Visual Languages for Multimedia , 1996, IEEE Multim..

[10]  Tsuhan Chen,et al.  Gesture-enhanced information retrieval and presentation in a distributed learning environment , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[11]  Katsumi Tanaka,et al.  Video Database Systems - Recent Trends in Research and Development Activities , 1997, Handbook of Multimedia Information Management.

[12]  Thomas D. C. Little,et al.  Video query formulation , 1995, Electronic Imaging.

[13]  Adam Cheyer,et al.  Multimodal Maps: An Agent-Based Approach , 1995, Multimodal Human-Computer Communication.

[14]  Christos Faloutsos,et al.  An Efficient Pictorial Database System for PSQL , 1988, IEEE Trans. Software Eng..

[15]  Erland Jungert,et al.  Querying Multimedia Data Sources and Databases , 1999, VISUAL.

[16]  Erland Jungert,et al.  A Spatial/Temporal Query Language for Multiple Data Sources in a Heterogeneous Information System Environment , 1998, Int. J. Cooperative Inf. Syst..

[17]  Maria Francesca Costabile,et al.  Visual Interfaces to Multimedia Databases , 1997, Handbook of Multimedia Information Management.

[18]  Jean-Claude Martin,et al.  A Unified Framework for Constructing Multimodal Experiments and Applications , 1998, Cooperative Multimodal Communication.

[19]  Max J. Egenhofer,et al.  Spatial SQL: A Query and Presentation Language , 1994, IEEE Trans. Knowl. Data Eng..

[20]  Erland Jungert,et al.  A Spatial Query Language for Multiple Data Sources Based on s-Operator Sequences , 1998, Multimedia Information Analysis and Retrieval.

[21]  Shi-Kuo Chang,et al.  Toward a Theory of Active Index , 1995, J. Vis. Lang. Comput..