A survey of software infrastructures and frameworks for ubiquitous computing

In this survey, we discuss 29 software infrastructures and frameworks which support the construction of distributed interactive systems. They range from small projects with one implemented prototype to large scale research efforts, and they come from the fields of Augmented Reality (AR), Intelligent Environments, and Distributed Mobile Systems. In their own way, they can all be used to implement various aspects of the ubiquitous computing vision as described by Mark Weiser [60]. This survey is meant as a starting point for new projects, in order to choose an existing infrastructure for reuse, or to get an overview before designing a new one. It tries to provide a systematic, relatively broad (and necessarily not very deep) overview, while pointing to relevant literature for in-depth study of the systems discussed.

[1]  P. Slusallek,et al.  Middleware Support for Seamless Multimedia Home Entertainment for Mobile Users and Heterogeneous Environments , 2003 .

[2]  Bernd Brügge,et al.  Design of a component-based augmented reality framework , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[3]  Steven K. Feiner,et al.  Enveloping users and computers in a collaborative 3D augmented reality , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[4]  Andy Hopper,et al.  The Anatomy of a Context-Aware Application , 1999, Wirel. Networks.

[5]  B. F. Castro.  Buschmann, Frank; Meunier, Regine; Rohnert, Hans; Sommerlad, Peter; Stal, Michael. Pattern-oriented software architecture: a system of patterns, John Wiley & Sons Ltd, 1996 , 1997 .

[6]  Peter Sommerlad,et al.  Pattern-Oriented Software Architecture , 1996 .

[7]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[8]  George Coulouris,et al.  Middleware Support for Context-Aware Multimedia Applications , 2001, DAIS.

[9]  David Ingram,et al.  Augmented reality in a wide area sentient environment , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[10]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[11]  Steven K. Feiner,et al.  Language-level support for exploratory programming of distributed virtual environments , 1996, UIST '96.

[12]  Philippe Debaty,et al.  Creating Web Representations for Places , 2000, HUC.

[13]  Bruce H. Thomas,et al.  An object-oriented software architecture for 3D mixed reality applications , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[14]  Bernhard Mitschang,et al.  A Model-Based, Open Architecture for Mobile, Spatially Aware Applications , 2001, SSTD.

[15]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[16]  Roberto Ierusalimschy,et al.  Dynamic component gluing across different componentware systems , 1999, Proceedings of the International Symposium on Distributed Objects and Applications.

[17]  Gerd Herzog,et al.  Large-scale software integration for spoken language and multimodal dialog systems , 2004, Natural Language Engineering.

[18]  Wouter Pasman,et al.  Distributed low-latency rendering for mobile AR , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[19]  Christoph Endres.  Towards a Software Architecture for Device Management in Instrumented Environments , 2003 .

[20]  David Garlan,et al.  The Aura software architecture : an infrastructure for ubiquitous computing , 2003 .

[21]  Michael H. Coen,et al.  Meeting the Computational Needs of Intelligent Environments: The Metaglue System , 2000 .

[22]  Alassane Ndiaye,et al.  Verbmobil From a Software Engineering Point of View: System Design and Software Integration , 2000 .

[23]  Dan R. Olsen,et al.  Join and capture: a model for nomadic interaction , 2001, UIST '01.

[24]  Brenton A. Phillips.  Metaglue: A Programming Language for Multi-Agent Systems by , 1999 .

[25]  Philipp Slusallek,et al.  Session Sharing as Middleware Service for Distributed Multimedia Applications , 2003, MIPS.

[26]  James Beck,et al.  Challenges: an application model for pervasive computing , 2000, MobiCom '00.

[27]  Gordon S. Blair,et al.  Limbo: a tuple space based platform for adaptive mobile applications , 1997 .

[28]  Klara Nahrstedt,et al.  Gaia: A Middleware Infrastructure to Enable Active Spaces1 , 2002 .

[29]  James A. Landay,et al.  An architecture for privacy-sensitive ubiquitous computing , 2004, MobiSys '04.

[30]  Peter Tandler,et al.  The BEACH application model and software framework for synchronous collaboration in ubiquitous computing environments , 2004, J. Syst. Softw..

[31]  Fan Xiao,et al.  ImageTclAR: A Blended Script and Compiled Code Development System For Augmented Reality , 2004 .

[32]  Dennis Saleh.  Zs , 2001 .

[33]  Peter Tandler.  Synchronous Collaboration in Ubiquitous Computing Environments , 2004 .

[34]  Wolfgang Wahlster,et al.  SmartKom: Foundations of Multimodal Dialogue Systems (Cognitive Technologies) , 2006 .

[35]  David Gelernter,et al.  Generative communication in Linda , 1985, TOPL.

[36]  Asa MacWilliams,et al.  Decentralized Coordination of Distributed Interdependent Services , 2003 .

[37]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[38]  Roberto Ierusalimschy,et al.  Lua—An Extensible Extension Language , 1996, Softw. Pract. Exp..

[39]  Tim Kindberg,et al.  A Web-based nomadic computing system , 2001, Comput. Networks.

[40]  Jack Dongarra,et al.  PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing , 1995 .

[41]  Dieter Schmalstieg,et al.  OpenTracker-an open software architecture for reconfigurable tracking based on XML , 2001, Proceedings IEEE Virtual Reality 2001.

[42]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[43]  C. Pichot,et al.  A Model-Based , 1991 .

[44]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[45]  Steven K. Feiner,et al.  A distributed 3D graphics library , 1998, SIGGRAPH.

[46]  Gerard Lacey,et al.  1ST International Workshop on Managing Interactions in Smart Environments (MANSE 99) , 1999 .

[47]  William G. Griswold,et al.  A component architecture for an extensible, highly integrated context-aware computing infrastructure , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[48]  David Garlan,et al.  Aura: an Architectural Framework for User Mobility in Ubiquitous Computing Environments , 2002, WICSA.

[49]  Gordon S. Blair,et al.  Extensions to ANSAware for advanced mobile applications , 1996 .

[50]  Wolfgang Wahlster,et al.  Verbmobil: Foundations of Speech-to-Speech Translation , 2000, Artificial Intelligence.

[51]  T. Kirste,et al.  SodaPop: a software infrastructure supporting self-organization in intelligent environments , 2004, 2nd IEEE International Conference on Industrial Informatics, 2004. INDIN '04. 2004.

[52]  Bill N. Schilit,et al.  The Parctab Ubiquitous Computing Experiment , 1994, Mobidata.

[53]  Martin Wagner,et al.  Herding Sheep: Live System Development for Distributed Augmented Reality , 2003 .

[54]  Klara Nahrstedt,et al.  A Middleware Infrastructure for Active Spaces , 2002, IEEE Pervasive Comput..

[55]  Philipp Slusallek,et al.  Dynamic Distributed Multimedia: Seamless Sharing and Reconfiguration of Multimedia Flow Graphs , 2003 .

[56]  Mehdi Hamadou,et al.  ARVIKA – Augmented Reality für Entwicklung, Produktion und Service (ARVIKA – Augmented Reality for Development, Production and Service) , 2002, i-com.

[57]  Michael Rohs,et al.  Toolkit support for interaction in the physical world , 2004 .

[58]  Wolfgang Wahlster,et al.  SmartKom: Foundations of Multimodal Dialogue Systems , 2006, SmartKom.

[59]  Gerd Herzog,et al.  MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems , 2003, HLT-NAACL 2003.

[60]  Peter Tandler.  Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices , 2001, UbiComp.

[61]  Thomas Kirste,et al.  Supporting goal based interaction with dynamic intelligent environments , 2002, ECAI.