Semantic Multimedia

Multimedia constitutes an interesting field of application for Semantic Web and Semantic Web reasoning, as the access and management of multimedia content and context depends strongly on the semantic descriptions of both. At the same time, multimedia resources constitute complex objects, the descriptions of which are involved and require the foundation on sound modeling practice in order to represent findings of low- and high level multimedia analysis and to make them accessible via Semantic Web querying of resources. This tutorial aims to provide a red thread through these different issues and to give an outline of where Semantic Web modeling and reasoning needs to further contribute to the area of semantic multimedia for the fruitful interaction between these two fields of computer science.

[1]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[2]  Farshad Fotouhi,et al.  Workshop on multimedia information retrieval on The many faces of multimedia semantics , 2007, MM 2007.

[3]  C. Tsinaraki,et al.  Interoperability Support for Ontology-Based Video Retrieval Applications , 2004, CIVR.

[4]  Ermanno Bencivenga That Obscure Object of Desire , 1988 .

[5]  William K. Pratt,et al.  Digital Image Processing: PIKS Inside , 2001 .

[6]  Niko Popitsch,et al.  METIS: a flexible database foundation for unified media management , 2004, MULTIMEDIA '04.

[7]  Ramesh Jain,et al.  Event-centric media management , 2008, Electronic Imaging.

[8]  Peter Stanchev,et al.  MPEG-7: The Multimedia Content Description Interface , 2004 .

[9]  Peter Brusilovsky,et al.  From adaptive hypermedia to the adaptive web , 2002, CACM.

[10]  Horst Bischof,et al.  Dealing with occlusions in the eigenspace approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[12]  Chrisa Tsinaraki,et al.  Interoperability of XML Schema Applications with OWL Domain Knowledge and Semantic Web Tools , 2007, OTM Conferences.

[13]  Lynda Hardman,et al.  Denotative and connotative semantics in hypermedia: proposal for a semiotic-aware architecture , 2001, New Rev. Hypermedia Multim..

[14]  Haifeng Chen,et al.  Model based object recognition by robust information fusion , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  Krys J. Kochut,et al.  SPARQLeR: Extended Sparql for Semantic Association Discovery , 2007, ESWC.

[16]  Steffen Staab,et al.  Semantic Annotation of Images and Videos for Multimedia Analysis , 2005, ESWC.

[17]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[18]  Ansgar Scherp Semantics support for personalized multimedia content , 2008, EuroIMSA 2008.

[19]  Jane Hunter,et al.  Combining the CIDOC CRM and MPEG-7 to Describe Multimedia in Museums. , 2002 .

[20]  Frank Nack,et al.  Everything You Wanted to Know About MPEG-7: Part 2 , 1999, IEEE Multim..

[21]  Longin Jan Latecki,et al.  Optimal partial shape similarity , 2005, Image Vis. Comput..

[22]  Heinrich Niemann,et al.  Neural networks for the recognition and pose estimation of 3D objects from a single 2D perspective view , 2001, Image Vis. Comput..

[23]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[24]  Lloyd Rutledge,et al.  Towards a multimedia formatting vocabulary , 2003, WWW '03.

[25]  V. S. Subrahmanian,et al.  An algebra for creating and querying multimedia presentations , 2000, Multimedia Systems.

[26]  Bert Arnrich,et al.  Gabor filters for object localization and robot grasping , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[27]  Ben Shneiderman,et al.  Visualization methods for personal photo collections: browsing and searching in the PhotoFinder , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[28]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[29]  Marcin Grzegorzek,et al.  Statistical 3D object classification and localization with context modeling , 2007, 2007 15th European Signal Processing Conference.

[30]  Gultekin Özsoyoglu,et al.  Query Processing Techniques for Multimedia Presentations , 2004, Multimedia Tools and Applications.

[31]  Jane Hunter,et al.  Towards a Core Ontology for Information Integration , 2003, J. Digit. Inf..

[32]  Heinrich Niemann,et al.  Klassifikation von Mustern , 1983 .

[33]  Lynda Hardman,et al.  That obscure object of desire: multimedia metadata on the Web, Part-1 , 2004, IEEE MultiMedia.

[34]  Steffen Staab,et al.  COMM: Designing a Well-Founded Multimedia Ontology for the Web , 2007, ISWC/ASWC.

[35]  Steffen Staab,et al.  Methodology for development and employment of ontology based knowledge management applications , 2002, SGMD.

[36]  Ramesh Jain,et al.  Toward a Common Event Model for Multimedia Applications , 2007, IEEE MultiMedia.

[37]  Nicola Guarino,et al.  Sweetening Ontologies with DOLCE , 2002, EKAW.

[38]  Ben Shneiderman,et al.  Direct annotation: a drag-and-drop strategy for labeling photos , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[39]  Chrisa Tsinaraki,et al.  Interoperability Support between MPEG-7/21 and OWL in DS-MIRF , 2007, IEEE Transactions on Knowledge and Data Engineering.

[40]  Steffen Staab,et al.  Towards ontologies for formalizing modularization and communication in large software systems , 2006, Appl. Ontology.

[41]  Aldo Gangemi,et al.  Task taxonomies for knowledge content , 2004 .

[42]  Jae Won Lee,et al.  Content-based image classification using a neural network , 2004, Pattern Recognit. Lett..

[43]  Steffen Staab,et al.  Querying for meta knowledge , 2008, WWW.

[44]  Chrisa Tsinaraki,et al.  GraphOnto: OWL-Based Ontology Management and Multimedia Annotation in the DS-MIRF Framework , 2006, J. Digit. Inf. Manag..

[45]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[46]  H. Niemann,et al.  Continuous parametrization of normal distributions for improving the discrete statistical eigenspace approach for object recognition , 2003 .

[47]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[48]  Alfred Kobsa,et al.  Personalized Hypermedia Information Provision Through Adaptive and Adaptable System Features: User Modelling, Privacy and Security Issues , 1997, IS&N.

[49]  Ramesh C. Jain,et al.  Towards an ecosystem for semantics , 2007, MS '07.

[50]  Jürgen Umbrich,et al.  YARS2: A Federated Repository for Querying Graph Structured Data from the Web , 2007, ISWC/ASWC.

[51]  Lloyd Rutledge,et al.  SampLe: towards a framework for system-supported multimedia authoring , 2004, 10th International Multimedia Modelling Conference, 2004. Proceedings..

[52]  Alfred Kobsa,et al.  Personalised hypermedia presentation techniques for improving online customer relationships , 2001, The Knowledge Engineering Review.

[53]  H. L. Hardman,et al.  Requirements for practical multimedia annotation , 2005 .

[54]  Raphaël Troncy,et al.  MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? , 2007 .

[55]  Julian Kerr Toward Generic Model-Based Object Recognition by Knowledge Acquisition and Machine Learning , 2003 .

[56]  Edward Y. Chang,et al.  Fotofiti: web service for photo management , 2006, MM '06.

[57]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[58]  Rosa Gil,et al.  Facilitating Business Interoperability from the Semantic Web , 2007, BIS.

[59]  Joachim Hornegger,et al.  Statistische Modellierung, Klassifikation und Lokalisation von Objekten , 1996, Ausgezeichnete Informatikdissertationen.

[60]  Gordon Bell,et al.  Passive capture and ensuing issues for a personal lifetime store , 2004, CARPE'04.

[61]  Josef Pösl,et al.  Erscheinungsbasierte statistische Objekterkennung , 2002, Informatik Forschung und Entwicklung.

[62]  Mor Naaman,et al.  Leveraging context to resolve identity in photo albums , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[63]  Jun Yang,et al.  What Can Expressive Semantics Tell: Retrieval Model for a Flash-Movie Search Engine , 2005, CIVR.

[64]  Susanne Boll,et al.  Emergent Semantics in Personalized Multimedia Content , 2007, J. Digit. Inf. Manag..

[65]  Zahir Tari,et al.  On the Move to Meaningful Internet Systems 2007: CoopIS, DOA, ODBASE, GADA, and IS, OTM Confederated International Conferences CoopIS, DOA, ODBASE, GADA, and IS 2007, Vilamoura, Portugal, November 25-30, 2007, Proceedings, Part I , 2007, OTM Conferences.

[66]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[67]  Steffen Staab,et al.  Exploiting Spatial Context in Image Region Labelling Using Fuzzy Constraint Reasoning , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[68]  Gultekin Özsoyoglu,et al.  Querying Multimedia Presentations Based on Content , 1999, IEEE Trans. Knowl. Data Eng..

[69]  Lynda Hardman,et al.  Application-Specic Constraints for Multimedia Presentation Generation , 2001 .

[70]  Raphaël Troncy,et al.  Designing and Using an Audio-Visual Description Core Ontology , 2004 .

[71]  Lynda Hardman,et al.  Identifying Spatial and Temporal Media Fragments on the Web , 2007 .

[72]  Raphaël Troncy,et al.  Integrating Structure and Semantics into Audio-visual Documents , 2003, SEMWEB.

[73]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[74]  Raphaël Troncy,et al.  Enabling Multimedia Metadata Interoperability by Defining Formal Semantics of MPEG-7 Profiles , 2006, SAMT.

[75]  Roberto Brunelli,et al.  MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES , 2001 .

[76]  Jane Hunter,et al.  A framework to enable the semantic inferencing and querying of multimedia content , 2005, Int. J. Web Eng. Technol..

[77]  Frank-Michael Nack,et al.  AUTEUR : the application of video semantics and theme representation for automated film editing , 1996 .

[78]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[79]  Frank Nack,et al.  Everything You Wanted to Know About MPEG-7: Part 1 , 1999, IEEE Multim..

[80]  Steffen Staab,et al.  Networked graphs: a declarative mechanism for SPARQL rules, SPARQL views and RDF data integration on the web , 2008, WWW.

[81]  Bernd Neumann,et al.  On Scene Interpretation with Description Logics , 2006, Cognitive Vision Systems.

[82]  Adam Pease,et al.  The Suggested Upper Merged Ontology: A Large Ontology for the Semantic Web and its Applic ations , 2002 .

[83]  Miroslaw Bober,et al.  Curvature Scale Space Representation: Theory, Applications, and MPEG-7 Standardization , 2011, Computational Imaging and Vision.

[84]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Roberto García,et al.  Semantic Integration and Retrieval of Multimedia Metadata , 2005, SemAnnot@ISWC.

[86]  Kateryna Falkovych,et al.  Context aware guidance for multimedia authoring: harmonizing domain and discourse knowledge , 2006, Multimedia Systems.

[87]  Mor Naaman,et al.  World explorer: visualizing aggregate data from unstructured text in geo-referenced collections , 2007, JCDL '07.

[88]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[89]  François Scharffe,et al.  SPARQL++ for Mapping Between RDF Vocabularies , 2007, OTM Conferences.

[90]  Michael Reinhold Robuste, probabilistische, erscheinungsbasierte Objekterkennung , 2004 .

[91]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[92]  Umberto Straccia,et al.  Managing Uncertainty and Vagueness in Description Logics, Logic Programs and Description Logic Programs , 2008, Reasoning Web.

[93]  Jane Hunter,et al.  A Comparison of Schemas for Video Metadata Representation , 1999, Comput. Networks.

[94]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[95]  Abraham Kandel,et al.  Applied Pattern Recognition , 2008, Studies in Computational Intelligence.

[96]  Rosa Gil,et al.  A web ontologies framework for digital rights management , 2007, Artificial Intelligence and Law.

[97]  Jane Hunter,et al.  Enhancing the semantic interoperability of multimedia through a core ontology , 2003, IEEE Trans. Circuits Syst. Video Technol..