Mobile Real-Time Collaboration for Semantic Multimedia

Advanced mobile applications that enable new ways of interaction with digital objects become increasingly important for on-site professional communities. These new ways of interaction, e.g. in Mobile Augmented Reality (MAR) via position and 3D movement, are real needs for fieldwork domains such as cultural heritage management and the construction industry. In addition, on-site professional communities generate shared knowledge bases with multimedia content and semantic annotations through collaboration. However, current MAR applications lack real-time collaboration features. In practice, blending multimedia semantics in mobile real-time collaboration is challenging due to the limitations of mobile devices, the lack of mature dedicated designed communication infrastructures and the constraints of the remote environments. This paper presents a mobile real-time collaboration system for semantic multimedia annotations with augmented reality features. We use XMPP as a real-time protocol for the secure, scalable and interoperable processing of XML-based semantic multimedia metadata described in MPEG-7. Our prototype was evaluated in the digital documentation of historical sites for cultural heritage management. The evaluation results indicate potential for increased productivity and enhanced mutual awareness in on-site professional communities.

[1]  Clarence A. Ellis,et al.  Groupware: some issues and experiences , 1991, CACM.

[2]  Denis Lugiez,et al.  Peer to Peer Optimistic Collaborative Editing on XML-like trees , 2009, ArXiv.

[3]  Petri Selonen,et al.  A Hybrid Content Delivery Approach for a Mixed Reality Web Service Platform , 2010, UIC.

[4]  Junwei Lu,et al.  Generalizing operational transformation to the standard general markup language , 2002, CSCW '02.

[5]  Dennis M. Wilkinson,et al.  Strong regularities in online peer production , 2008, EC '08.

[6]  Douglas C. Schmidt,et al.  Addressing Challenges with Augmented Reality Applications on Smartphones , 2010, MOBILWARE.

[7]  Ansgar R. S. Gerlicher,et al.  Developing collaborative XML editing systems , 2007 .

[8]  Jean Ferrié,et al.  Serialization of concurrent operations in a distributed collaborative environment , 1997, GROUP.

[9]  Alan B. Craig.  Mobile Augmented Reality , 2013 .

[10]  Harald Kosch,et al.  Distributed Multimedia Database Technologies Supported by MPEG-7 and MPEG-21 , 2003 .

[11]  Michael Dixon,et al.  High-latency, low-bandwidth windowing in the Jupiter collaboration system , 1995, UIST '95.

[12]  Marios C. Angelides,et al.  Experimenting with tagging and context for collaborative MPEG-7 metadata , 2012, Multimedia Tools and Applications.

[13]  Paul Benjamin Lowry,et al.  A Taxonomy of Collaborative Writing to Improve Empirical Research, Writing Practice, and Tool Development , 2004 .

[14]  Matthias Jarke,et al.  ACIS: intergenerational community learning supported by a hypermedia Afghan sites and monuments database , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[15]  Mathias Lux,et al.  Multimedia Metadata Standards , 2008, Encyclopedia of Multimedia.

[16]  Yochai Benkler,et al.  The wealth of networks: how social production transforms markets and freedom , 2006 .

[17]  Claudia-Lavinia Ignat,et al.  Customizable Collaborative Editor Relying on treeOPT Algorithm , 2003, ECSCW.

[18]  Susanne Boll,et al.  Supporting Mobile Collaboration in Spatially Distributed Workgroups with Digital Interactive Maps , 2012, Mob. Networks Appl..

[19]  Marc Spaniol,et al.  LAS: A Lightweight Application Server for MPEG-7 Services in Community Engines , 2008 .

[20]  Henry Been-Lirn Duh,et al.  A Collaborative Augmented Reality Networked Platform for Edutainment , 2011 .

[21]  Peter Saint-Andre,et al.  Extensible Messaging and Presence Protocol (XMPP): Instant Messaging and Presence , 2004, RFC.

[22]  Alexander Schill,et al.  Service-based development of mobile real-time collaboration applications for Social Networks , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[23]  Yanchun Zhang,et al.  Achieving convergence, causality preservation, and intention preservation in real-time cooperative editing systems , 1998, TCHI.

[24]  Don Tapscott,et al.  Wikinomics: How Mass Collaboration Changes Everything , 2006 .

[25]  Clarence A. Ellis,et al.  Concurrency control in groupware systems , 1989, SIGMOD '89.

[26]  Andreas Schmidt,et al.  At the boundaries of peer production: The organization of Internet security production in the cases of Estonia 2007 and Conficker , 2012 .

[27]  David Sun,et al.  Leveraging single-user applications for multi-user collaboration: the coword approach , 2004, CSCW.

[28]  Matthias Jarke,et al.  Mobile Access to MPEG-7 Based Multimedia Services , 2009, 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware.

[29]  P. Lowry,et al.  Building a Taxonomy and Nomenclature of Collaborative Writing to Improve Interdisciplinary Research and Practice , 2004 .

[30]  David Sun,et al.  Operation context and context-based operational transformation , 2006, CSCW '06.