Contextual Augmentation of Ontology for Recognizing Sub-events

With the advances in technology and proliferation of cheap storage, high rate of digital multimedia interaction signifies the increasing need of computer users for a decent application to organize personal media in a meaningful way. In this paper, we want to organize personal media in terms of the sub-events they cover. A semantic gap exists between media, and people's perception of the events and memories associated with this media. A framework is needed to address such gap. This paper describes a novel model-based approach for partitioning and organizing personal photo archive in terms of high-level subevents that capture and represent human experience. Since photos are the most ubiquitous and prolific form of user generated content, we focus on the automatic annotation of personal photo collection in this paper. We introduce ROntology (Recognition-Ontology) that is a context-aware model with concrete contextual information for subevent recognition. Currently our approach utilizes the mereological, spatial and temporal properties of modeled-events in R-Ontology. Personal media will then populate R-Ontology. We tested this approach using our personal photo archive describing two different scenarios: Trip and Indianwedding.

[1]  Bin Zheng,et al.  Ontology for the Object Recognition in Images , 2009, 2009 International Conference on Multimedia Information Networking and Security.

[2]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[3]  Frank van Harmelen,et al.  Handbook of Knowledge Representation , 2008, Handbook of Knowledge Representation.

[4]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Steffen Staab,et al.  F--a model of events based on the foundational ontology dolce+DnS ultralight , 2009, K-CAP '09.

[6]  Sean Bechhofer,et al.  The OWL API: A Java API for Working with OWL 2 Ontologies , 2009, OWLED.

[7]  Ramesh C. Jain,et al.  Semantics In Digital Photos: A Contenxtual Analysis , 2008, 2008 IEEE International Conference on Semantic Computing.

[8]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[9]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.

[10]  Ramesh Jain,et al.  Toward a Common Event Model for Multimedia Applications , 2007, IEEE MultiMedia.

[11]  Balakrishnan Chandrasekaran,et al.  What are ontologies, and why do we need them? , 1999, IEEE Intell. Syst..

[12]  Jane Hunter,et al.  The ABC Ontology and Model , 2001, J. Digit. Inf..

[13]  Mieczyslaw M. Kokar,et al.  Using ontologies for recognition: an example , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[14]  Shih-Hung Wu,et al.  Domain Event Extraction and Representation with Domain Ontology , 2003, IIWeb.

[15]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[16]  Rama Chellappa,et al.  An ontology based approach for activity recognition from video , 2008, ACM Multimedia.

[17]  Mor Naaman,et al.  Context data in geo-referenced digital photo collections , 2004, MULTIMEDIA '04.