Case studies on context-aware mobile multimedia services

This paper explores the design, implementation and evaluation of context-aware mobile multimedia services by presenting six case studies on different application domains. The case studies highlight the opportunities that mobile devices equipped with wireless data transmission provide for context- aware and ubiquitous computing. Special emphasis is placed on empirical evaluation of the services in the field in form of a user evaluation with genuine end users in real environment of use. The paper concludes with a discussion on some important lessons learned from the case studies.

[1]  Yongmin Li,et al.  Video classification using spatial-temporal features and PCA , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[2]  Jean-Pierre Hubaux,et al.  A Survey of Research in Inter-Vehicle Communications , 2006 .

[3]  Matthias Baldauf,et al.  A survey on context-aware systems , 2007, Int. J. Ad Hoc Ubiquitous Comput..

[4]  Mohan S. Kankanhalli,et al.  Creating audio keywords for event detection in soccer video , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[5]  Tim Morris BSc Multimedia Systems , 2000, Applied Computing.

[6]  Robert E. Tarjan,et al.  Fibonacci heaps and their uses in improved network optimization algorithms , 1984, JACM.

[7]  Roy Want Build What You Use , 2006, IEEE Pervasive Comput..

[8]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Pauliina Ulkuniemi,et al.  Retailers' different value perceptions of mobile advertising service , 2007 .

[10]  Maria Grazia Scutellà,et al.  Minimum Time and Minimum Cost-Path Problems in Street Networks with Periodic Traffic Lights , 2002, Transp. Sci..

[11]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[12]  Alan F. Smeaton,et al.  Implementation and Analysis of Several Keyframe-Based Browsing Interfaces to Digital Video , 2000, ECDL.

[13]  Timo Ojala,et al.  Mobile Fair Diary: hybrid interface for taking, browsing and sharing context-aware notes , 2006, Personal and Ubiquitous Computing.

[14]  Werner Bailer,et al.  A Tool Supporting Annotation and Analysis of Videos , 2007 .

[15]  Timo Ojala,et al.  SmartRotuaari - Context-Aware Mobile Multimedia Services , 2003 .

[16]  Christian Becker,et al.  Sonderforschungsbereich 627: Nexus – Umgebungsmodelle für mobile kontextbezogene Systeme (Spatial World Models for Mobile Context-aware Systems) , 2003, it Inf. Technol..

[17]  Lars Kulik,et al.  Information Dissemination in Mobile Ad-Hoc Geosensor Networks , 2004, GIScience.

[18]  R. Musmanno,et al.  Label Correcting Methods to Solve Multicriteria Shortest Path Problems , 2001 .

[19]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[20]  Marlon Pierce,et al.  Managing Dynamic Metadata as Context , .

[21]  Jianping Fan,et al.  Access control, confidentiality and privacy for video surveillance databases , 2006, SACMAT '06.

[22]  Stefan M. Rüger,et al.  A Large Scale System for Searching and Browsing Images from the World Wide Web , 2006, CIVR.

[23]  Sven Siggelkow,et al.  Feature histograms for content-based image retrieval , 2002 .

[24]  G. Klyne,et al.  Composite Capability/Preference Profiles (CC/PP) : Structure and Vocabularies , 2001 .

[25]  Timo Ojala,et al.  Bluetooth and WAP push based location-aware mobile advertising system , 2004, MobiSys '04.

[26]  Rik Van de Walle,et al.  MPEG-21: goals and achievements , 2001 .

[27]  Matthias Jarke,et al.  Follow Me, Follow You - Spatiotemporal Community Context Modeling and Adaptation for Mobile Information Systems , 2008, The Ninth International Conference on Mobile Data Management (mdm 2008).

[28]  Henning Müller,et al.  Automated benchmarking in content-based image retrieval , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[29]  Martin Mauve,et al.  A comparison of routing strategies for vehicular ad-hoc networks , 2002, MobiCom 2002.

[30]  Liviu Iftode,et al.  A Comparative Study of Data Dissemination Models for VANETs , 2006, 2006 3rd Annual International Conference on Mobile and Ubiquitous Systems - Workshops.

[31]  Jan Stage,et al.  New techniques for usability evaluation of mobile systems , 2004, Int. J. Hum. Comput. Stud..

[32]  Liviu Iftode,et al.  TrafficView: traffic data dissemination using car-to-car communication , 2004, MOCO.

[33]  Bernard Mérialdo,et al.  Generic object tracking for fast video annotation , 2007, VISAPP.

[34]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[35]  Kimmo Koli,et al.  Usability issues in utilizing context metadata in content management of mobile devices , 2004, NordiCHI '04.

[36]  G. Clark,et al.  Reference , 2008 .

[37]  Andrew S. Tanenbaum,et al.  Operating systems: design and implementation , 1987, Prentice-Hall software series.

[38]  Remco C. Veltkamp,et al.  Content-based image retrieval systems: A survey , 2000 .

[39]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[40]  S. Pallottino,et al.  Shortest Path Algorithms in Transportation models: classical and innovative aspects , 1997 .

[41]  Erkki Oja,et al.  The PicSOM Retrieval System: Description and Evaluations , 2000 .

[42]  Nathaniel S. Borenstein,et al.  Multipurpose Internet Mail Extensions (MIME) Part Two: Media Types , 1996, RFC.

[43]  Marc Spaniol,et al.  LAS: A Lightweight Application Server for MPEG-7 Services in Community Engines , 2008 .

[44]  B. Scheuermann,et al.  The feasibility of information dissemination in vehicular ad-hoc networks , 2007, 2007 Fourth Annual Conference on Wireless on Demand Network Systems and Services.

[45]  Miguel de Icaza,et al.  GTK+ /Gnome Application Development , 1999 .

[46]  Leonardo Chiariglione 1 Introduction to MPEG-7 : Multimedia Content Description Interface , 2002 .

[47]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[48]  Remco C. Veltkamp,et al.  Efficient image retrieval through vantage objects , 1999, Pattern Recognition.

[49]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[50]  Matthieu Cord,et al.  Stochastic exploration and active learning for image retrieval , 2007, Image Vis. Comput..

[51]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[52]  Jaime Delgado,et al.  A New Type of Contextual Information Based on the Adaptation Authorisation , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[53]  R. Sharp,et al.  The 2005 UbiApp Workshop: What Makes Good Application-Led Research? , 2005, IEEE Pervasive Comput..

[54]  Hisashi Kobayashi,et al.  Signal strength based indoor geolocation , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[55]  Hung Keng Pung,et al.  A middleware for building context-aware mobile services , 2004, 2004 IEEE 59th Vehicular Technology Conference. VTC 2004-Spring (IEEE Cat. No.04CH37514).

[56]  Marc Spaniol,et al.  Virtual Campfire – A Mobile Social Software for Cross-Media Communities , 2007 .

[57]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[58]  Andrew S. Tanenbaum,et al.  Distributed systems: Principles and Paradigms , 2001 .

[59]  Albrecht Schmidt,et al.  Designing, Developing, and Evaluating Context-Aware Systems , 2007, 2007 International Conference on Multimedia and Ubiquitous Engineering (MUE'07).

[60]  Timo Ojala,et al.  Comparison of Mobile and Fixed Use of SmartLibrary , 2004, Mobile HCI.

[61]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[62]  Mark G. Sobell A Practical Guide to Linux Commands, Editors, and Shell Programming , 1984 .

[63]  Youssef Hadi,et al.  Video summarization by k-medoid clustering , 2006, SAC '06.

[64]  Jane Hunter,et al.  Combining RDF and XML schemas to enhance interoperability between metadata application profiles , 2001, WWW '01.

[65]  Raimondo Schettini,et al.  Quicklook2: An Integrated Multimedia System , 2001, J. Vis. Lang. Comput..

[66]  Yaser Mowafi,et al.  A User-centered Approach to Context-awareness in Mobile Computing , 2007, 2007 Fourth Annual International Conference on Mobile and Ubiquitous Systems: Networking & Services (MobiQuitous).

[67]  Graham Glass,et al.  Linux for programmers and users , 1992 .

[68]  Yong Wang,et al.  Utility-Based Video Adaptation for Universal Multimedia Access (UMA) and Content-Based Utility Function Prediction for Real-Time Video Transcoding , 2007, IEEE Transactions on Multimedia.

[69]  Gary Marchionini,et al.  Key frame preview techniques for video browsing , 1998, DL '98.

[70]  T. Delot,et al.  Estimating the Relevance of Information in Inter-Vehicle Ad Hoc Networks , 2008, 2008 Ninth International Conference on Mobile Data Management Workshops, MDMW.

[71]  Tomasz Imielinski,et al.  GeoCast—geographic addressing and routing , 1997, MobiCom '97.

[72]  Thierry Delot,et al.  Extraction de connaissances dans les réseaux ad hoc inter-véhicules , 2008, UbiMob.

[73]  Nitin H. Vaidya,et al.  Geocasting in mobile ad hoc networks: location-based multicast algorithms , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[74]  Mathias Lux,et al.  Lire: lucene image retrieval: an extensible java CBIR library , 2008, ACM Multimedia.

[75]  Harald Kosch,et al.  Distributed Multimedia Database Technologies Supported by MPEG-7 and MPEG-21 , 2003 .

[76]  Antti Nurminen,et al.  m-LOMA - a mobile 3D city map , 2006, Web3D '06.

[77]  Shih-Fu Chang,et al.  Event detection in baseball video using superimposed caption recognition , 2002, MULTIMEDIA '02.

[78]  Hermann Ney,et al.  FIRE - Flexible Image Retrieval Engine: ImageCLEF 2004 Evaluation , 2004, CLEF.

[79]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[80]  Bernard Mérialdo,et al.  Hyperlinked Video with Moving Objects in Digital Television , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[81]  Harald Kosch,et al.  The MPEG-7 Multimedia Database System (MPEG-7 MMDB) , 2008, J. Syst. Softw..

[82]  Joe Marshall,et al.  Experiments in 3D interaction for mobile phone AR , 2007, GRAPHITE '07.

[83]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[84]  Shu-Ching Chen,et al.  SMARXO: towards secured multimedia applications by adopting RBAC, XML and object-relational database , 2004, MULTIMEDIA '04.

[85]  C. Sørensen,et al.  Mobility: an extended perspective , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[86]  Moncef Gabbouj,et al.  AUDIO-VISUAL CONTENT-BASED MULTIMEDIA INDEXING AND RETRIEVAL – THE MUVIS FRAMEWORK , 2003 .

[87]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[88]  Timo Ojala,et al.  SmartLibrary - Location-Aware Mobile Library Service , 2003, Mobile HCI.

[89]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[90]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[91]  Matthieu Cord,et al.  RETIN: A Content-Based Image Indexing and Retrieval System , 2001, Pattern Analysis & Applications.

[92]  Timo Ojala,et al.  panOULU Luotsi: a location based information mash-up with XML aggregator and WiFi positioning , 2008, MUM '08.

[93]  Min Chen,et al.  MRBAC: Hierarchical Role Management and Security Access Control for Distributed Multimedia Systems , 2008, 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC).

[94]  Bernard Mérialdo,et al.  Fast annotation of video objects for interactive TV , 2007, ACM Multimedia.

[95]  Mathias Lux,et al.  Caliph & Emir : Semantic Annotation and Retrieval in Personal Digital Photo Libraries , 2004 .

[96]  Yannis Avrithis,et al.  USING CONTEXT AND FUZZY RELATIONS TO INTERPRET MULTIMEDIA CONTENT , 2003 .

[97]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[98]  B. S. Manjunath,et al.  Cortina: a system for large-scale, content-based web image retrieval , 2004, MULTIMEDIA '04.

[99]  T. Delot,et al.  Dissemination of information in inter-vehicle ad hoc networks , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[100]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[101]  Jadwiga Indulska,et al.  Modelling and using imperfect context information , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[102]  Athanasios K. Ziliaskopoulos,et al.  An intermodal optimum path algorithm for multimodal networks with dynamic arc travel times and switching delays , 2000, Eur. J. Oper. Res..

[103]  Steffen Staab,et al.  Semantic Annotation of Images and Videos for Multimedia Analysis , 2005, ESWC.

[104]  Ahmet M. Kondoz,et al.  Using context to assist the adaptation of protected multimedia content in virtual collaboration applications , 2007, 2007 International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2007).

[105]  Yiannis S. Boutalis,et al.  FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[106]  Timo Ojala,et al.  TimeMachine Oulu - Dynamic Creation of Cultural-Spatio-Temporal Models as a Mobile Service , 2003, Mobile HCI.

[107]  Jane Hunter,et al.  Adding Multimedia to the Semantic Web: Building an MPEG-7 ontology , 2001, SWWS.

[108]  Aris M. Ouksel,et al.  Opportunistic resource exchange in inter-vehicle ad-hoc networks , 2004, IEEE International Conference on Mobile Data Management, 2004. Proceedings. 2004.

[109]  Timo Ojala,et al.  Supporting Session and Access Point Mobility in a Large Multi-provider Multi-vendor Municipal WiFi Network , 2008, AccessNets.

[110]  Fernando Pereira,et al.  Using MPEG-7 for Generic Audiovisual Content Automatic Summarization , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[111]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[112]  Claudia Linnhoff-Popien,et al.  A Context Modeling Survey , 2004 .

[113]  Jitendra Malik,et al.  Blobworld: A System for Region-Based Image Indexing and Retrieval , 1999, VISUAL.

[114]  Christian Timmerer,et al.  Digital item adaptation: overview of standardization and research activities , 2005, IEEE Transactions on Multimedia.

[115]  Omar Choudary,et al.  Mobile guide applications using representative visualizations , 2008, ACM Multimedia.

[116]  Marcel Worring,et al.  Benchmarking image and video retrieval: an overview , 2006, MIR '06.

[117]  Luca Chittaro,et al.  Location-aware visualization of VRML models in GPS-based mobile guides , 2005, Web3D '05.

[118]  Ellen W. Zegura,et al.  V3: a vehicle-to-vehicle live video streaming architecture , 2005, Third IEEE International Conference on Pervasive Computing and Communications.

[119]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[120]  H. Scheepers,et al.  A comprehensive model incorporating mobile context to design for mobile use , 2006 .

[121]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[122]  Paolo Bellavista,et al.  Location-Based Services: Back to the Future , 2008, IEEE Pervasive Computing.

[123]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[124]  Otthein Herzog,et al.  Graphical Search for Images by PictureFinder , 2005, Multimedia Tools and Applications.

[125]  Carlo Curino,et al.  A data-oriented survey of context models , 2007, SGMD.

[126]  Cyril Concolato,et al.  GPAC: open source multimedia framework , 2007, ACM Multimedia.

[127]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[128]  José María Martínez Sanchez,et al.  Towards universal access to content using MPEG-7 , 2002, MULTIMEDIA '02.

[129]  Maria Ebling,et al.  The design and applications of a context service , 2002, MOCO.

[130]  Peter Ruppel,et al.  Combining GPS and GSM Cell-ID positioning for Proactive Location-based Services , 2007, 2007 Fourth Annual International Conference on Mobile and Ubiquitous Systems: Networking & Services (MobiQuitous).

[131]  J. Deigmöller Portivity : Object Based Interactive Mobile TV System Networked and Electronic Media , 2008 .

[132]  Marc Spaniol,et al.  Community Aware Content Adaptation for Mobile Technology Enhanced Learning , 2006, EC-TEL.

[133]  Werner Bailer,et al.  Detailed audiovisual profile: enabling interoperability between MPEG-7 based systems , 2006, 2006 12th International Multi-Media Modelling Conference.

[134]  James Ze Wang,et al.  IRM: integrated region matching for image retrieval , 2000, ACM Multimedia.

[135]  Gregory D. Abowd,et al.  Providing architectural support for building context-aware applications , 2000 .

[136]  Henning Müller User interaction and performance evaluation in content-based visual information retrieval , 2002 .

[137]  Jianping Fan,et al.  A hierarchical access control model for video database systems , 2003, TOIS.