Architectural Support for Building Automated Capture & Access Applications

Applications that automatically capture some details of a live experience and provide future access to that experience are increasingly common in the ubiquitous computing community. The exploration of this class of applications raises software engineering problems pertaining to proper software structuring and programming abstractions to support the design, development and evolution of these systems. In this paper, we present our experience in building a number of capture and access applications, sharing insights on relative successes and failures. These lessons learned are now embodied in a toolkit called Infrastructure for Capture and Access (INCA) which supports a distillation of the essential architectural features for this class of applications. We will demonstrate how this toolkit encourages a simplified model for designing, implementing, and evolving such applications —lowering the barrier for building automated capture and access applications and inspiring the construction of a larger variety of applications previously unexplored.

[1]  Debby Hindus,et al.  Ubiquitous audio: capturing spontaneous collaboration , 1992, CSCW '92.

[2]  Scott L. Minneman,et al.  Where were we: making and using near-synchronous, pre-narrative video , 1993, MULTIMEDIA '93.

[3]  R. Hill,et al.  Capturing and playing multimedia events with STREAMS , 1994, MULTIMEDIA '94.

[4]  K. Weber,et al.  Marquee: a tool for real-time video logging , 1994, CHI '94.

[5]  S. Whittaker,et al.  Filochat: handwritten notes provide access to recorded conversations , 1994, CHI Conference Companion.

[6]  Thomas P. Moran,et al.  Tivoli: an electronic whiteboard for informal workgroup meetings , 1993, INTERCHI.

[7]  Scott L. Minneman,et al.  A confederation of tools for capturing and accessing collaborative activity , 1995, MULTIMEDIA '95.

[8]  Leysia Palen,et al.  “I'll get that off the audio”: a case study of salvaging multimedia meeting records , 1997, CHI.

[9]  Ch. Bacher,et al.  Authoring on the Fly A new way of integrating telepresentation and courseware production , 1997 .

[10]  Gregory D. Abowd,et al.  Teaching and learning as multimedia authoring: the classroom 2000 project , 1997, MULTIMEDIA '96.

[11]  Gregory D. Abowd,et al.  Automated Capture and Retrieval of Architectural Rationale , 1998 .

[12]  Bill N. Schilit,et al.  Dynomite: a dynamically organized ink and audio notebook , 1998 .

[13]  Gregory D. Abowd,et al.  StuPad: integrating student notes with class lectures , 1999, CHI EA '99.

[14]  Gregory D. Abowd,et al.  Software engineering issues for ubiquitous computing , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[15]  Gregory D. Abowd,et al.  The Conference Assistant: combining context-awareness with wearable computing , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[16]  J. Landay,et al.  NotePals: lightweight note sharing by the group, for the group , 1999, CHI '99.

[17]  Jun Rekimoto,et al.  Time-machine computing: a time-centric approach for the information environment , 1999, UIST '99.

[18]  Brian Christopher Smith,et al.  Passive capture and structuring of lectures , 1999, MULTIMEDIA '99.

[19]  Gregory D. Abowd,et al.  Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment , 1999, IBM Syst. J..

[20]  Lynn Wilcox,et al.  NoteLook: taking notes in meetings with digital video and ink , 1999, MULTIMEDIA '99.

[21]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[22]  Gregory D. Abowd,et al.  Personalizing the capture of public experiences , 1999, UIST '99.

[23]  Gregory D. Abowd,et al.  Supporting Capture and Access Interfaces for Informal and Opportunistic Meetings , 1999 .

[24]  Mark Guzdial.  Supporting Learners as users , 1999, ASTR.

[25]  Paul Dourish,et al.  Using properties for uniform interaction in the Presto document system , 1999, UIST '99.

[26]  Andreas Girgensohn,et al.  A genetic algorithm for video segmentation and summarization , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[27]  Gregory D. Abowd,et al.  Providing architectural support for building context-aware applications , 2000 .

[28]  David Franklin,et al.  Jabberwocky: you don't have to be a rocket scientist to change slides for a hydrogen combustion lecture , 2000, IUI '00.

[29]  Gregory D. Abowd,et al.  Linking by interacting: a paradigm for authoring hypertext , 2000, HYPERTEXT '00.

[30]  G. Abowd,et al.  Interaction techniques for ambiguity resolution in recognition-based interfaces , 2000, UIST '00.

[31]  Gregory D. Abowd,et al.  Enriching everyday activities through the automated capture and access of live experiences. eclass: building, observing and understanding the impact of capture and access in an educational domain , 2001 .

[32]  Gregory D. Abowd,et al.  An architecture and interaction techniques for handling ambiguity in recognition-based input , 2001 .

[33]  Gregory D. Abowd,et al.  A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications , 2001, Hum. Comput. Interact..

[34]  Gregory D. Abowd,et al.  Integrating Meeting Capture within a Collaborative Team Environment , 2001, UbiComp.

[35]  Gregory D. Abowd,et al.  Who, What, When, Where, How: Design Issues of Capture & Access Applications , 2001, UbiComp.

[36]  Paul H. Dietz,et al.  Real-time audio buffering for telephone applications , 2001, UIST '01.

[37]  G. Abowd,et al.  Personal Audio Loop : Reminders from a PAL , 2002 .

[38]  Gregory D. Abowd,et al.  Vicariously Sharing Captured Web Experiences through an Automated Recommendation System , 2002 .

[39]  Khai N. Truong,et al.  Interactive Space-Time Maps for Document Visualization , 2002 .

[40]  Norbert A. Streitz,et al.  DOLPHIN: Integrated Meeting Support across LiveBoards, Local and Remote Desktop Environments , 2004 .

[41]  Li Ding,et al.  An Approach for Recording Multimedia Collaborative Sessions: Design and Implementation , 2004, Multimedia Tools and Applications.