A methodology and software platform for building wearable communities

In recent years, two innovative computing and communication technologies have emerged: wearable computers and wireless personal area networks. Wearable computers advance an innovative form of personal computing based on continuously worn, intelligent assistants that augment memory, intellect, communication, and physical senses. Wireless personal area networks (WPAN) are a new class of wireless networks that provide seamless ad hoc communication over short-range radio links. The convergence of these technologies creates new opportunities for technological support of social interactions and face-to-face communities. While past research has provided a partial understanding of the social potentials of wearable computers and wireless personal area networks, we know little about the software engineering aspects of such systems. This dissertation aims to remedy this situation by exploring software infrastructure and architectural support for co-present communities. In particular, the goal of this dissertation is to develop a generic wearable software platform that (1) enables spontaneous interactions in face-to-face settings, (2) aids developers in the implementation of ad hoc collaborative applications and (3) supports building of co-present communities. The contribution of this dissertation is a methodology and software platform for building wearable communities; that is, co-present communities that emerge when enough people use their wearable computers to form webs of personal relationships. Wearable communities are based upon embodied real-world human encounters augmented by wearable computers. The proposed methodology defines a conceptual framework for software support of wearable communities, and specifies a design language and development process. The software platform addresses the information needs of applications and provides developers with high-level programming abstractions. To address the utility and practicality of the methodology and software platform, the design and implementation of a number of wearable community applications are presented and experiences of using the methodology in software engineering education are reported.

[1]  Amy L. Murphy,et al.  LIME: a middleware for physical and logical mobility , 2001, Proceedings 21st International Conference on Distributed Computing Systems.

[2]  Johan Redström,et al.  People, places and the newspilot , 1999, CHI Extended Abstracts.

[3]  Allison Druin,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[4]  Gregory Alan Bolcer,et al.  Magi: An Architecture for Mobile and Disconnected Workflow , 2000, IEEE Internet Comput..

[5]  Anthony Ephremides,et al.  A distributed routing algorithm for mobile wireless networks , 1995, Wirel. Networks.

[6]  Chong-kwon Kim,et al.  Neighbor supporting ad hoc multicast routing protocol , 2000, 2000 First Annual Workshop on Mobile and Ad Hoc Networking and Computing. MobiHOC (Cat. No.00EX444).

[7]  Gerd Kortuem,et al.  When peer-to-peer comes face-to-face: collaborative peer-to-peer computing in mobile ad-hoc networks , 2001, Proceedings First International Conference on Peer-to-Peer Computing.

[8]  Bradley J. Rhodes,et al.  The wearable remembrance agent: A system for augmented memory , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[9]  D. Groten,et al.  Bluetooth-based mobile ad hoc networks: opportunities and challenges for a telecommunications operator , 2001, IEEE VTS 53rd Vehicular Technology Conference, Spring 2001. Proceedings (Cat. No.01CH37202).

[10]  Marvin Theimer,et al.  Designing and implementing asynchronous collaborative applications with Bayou , 1997, UIST '97.

[11]  E. Hall.  The Silent Language , 1959 .

[12]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[13]  Mitchel Resnick,et al.  Things that Blink: Computationally Augmented Name Tags , 1996, IBM Syst. J..

[14]  J. J. Garcia-Luna-Aceves,et al.  An efficient routing protocol for wireless networks , 1996, Mob. Networks Appl..

[15]  Henk L. Muller,et al.  The Shopping Jacket: Wearable Computing for the Consumer , 2000 .

[16]  Charles E. Perkins,et al.  Ad-hoc on-demand distance vector routing , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[17]  Alex Pentland,et al.  A Wearable Computer Based American Sign Language Recognizer , 1998, Assistive Technology and Artificial Intelligence.

[18]  Gerd Kortuem,et al.  "Where are you pointing at?" A study of remote collaboration in a wearable videoconference system , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[19]  Brad A. Myers,et al.  Collaboration using multiple PDAs connected to a PC , 1998, CSCW '98.

[20]  Howard Rheingold,et al.  The Virtual Community: Homesteading on the Electronic Frontier , 2000 .

[21]  Samir R. Das,et al.  On-demand multipath routing for mobile ad hoc networks , 1999, Proceedings Eight International Conference on Computer Communications and Networks (Cat. No.99EX370).

[22]  B. R. Badrinath,et al.  A framework for delivering multicast messages in networks with mobile hosts , 1996, Mob. Networks Appl..

[23]  Cecilia Mascolo,et al.  Use of context-awareness in mobile peer-to-peer networks , 2001, Proceedings Eighth IEEE Workshop on Future Trends of Distributed Computing Systems. FTDCS 2001.

[24]  Li Gong,et al.  Industry Report: JXTA: A Network Programming Environment , 2001, IEEE Internet Comput..

[25]  Steve Mann,et al.  Wearable Computing: A First Step Toward Personal Imaging , 1997, Computer.

[26]  Douglas B. Moran,et al.  The Open Agent Architecture: A Framework for Building Distributed Software Systems , 1999, Appl. Artif. Intell..

[27]  Jeffrey S. Rosenschein,et al.  Rules of Encounter - Designing Conventions for Automated Negotiation among Computers , 1994 .

[28]  R. W. Root,et al.  Informal Communication in Organizations: Form, Function, and Technology , 1990 .

[29]  Philippe Charas.  Peer-to-peer mobile network architecture , 2001, Proceedings First International Conference on Peer-to-Peer Computing.

[30]  Darren Leigh,et al.  Social net: using patterns of physical proximity over time to infer shared interests , 2002, CHI Extended Abstracts.

[31]  Michael Nidd.  Timeliness of service discovery in DEAPspace , 2000, Proceedings 2000. International Workshop on Parallel Processing.

[32]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[33]  StarnerThad.  The Challenges of Wearable Computing , 2001 .

[34]  Elizabeth D. Mynatt,et al.  Design for network communities , 1997, CHI.

[35]  Chai-Keong Toh,et al.  Associativity-Based Routing for Ad Hoc Mobile Networks , 1997, Wirel. Pers. Commun..

[36]  Sidney C. Sufrin,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups. , 1966 .

[37]  F.A. Tobagi,et al.  Issues in packet radio network design , 1987, Proceedings of the IEEE.

[38]  Robert E. Kraut,et al.  The VideoWindow system in informal communication , 1990, CSCW '90.

[39]  Gerd Kortuem,et al.  NETMAN: The design of a collaborative wearable computer system , 1999, Mob. Networks Appl..

[40]  Michael B. Pursley,et al.  Routing in frequency-hop packet radio networks with partial-band jamming , 1993, IEEE Trans. Commun..

[41]  David M. Nichols,et al.  Implicit Rating and Filtering , 1998 .

[42]  E. Hall,et al.  The Hidden Dimension , 1970 .

[43]  Gerd Kortuem,et al.  Multishelf: an experiment in peer-to-peer infomediation , 2002, Proceedings. Second International Conference on Peer-to-Peer Computing,.

[44]  Geraldine Fitzpatrick,et al.  Experience in Building a Cooperative Distributed Organization: Lessons for Cooperative Buildings , 1998, CoBuild.

[45]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[46]  Imrich Chlamtac,et al.  Bluetrees-scatternet formation to enable Bluetooth-based ad hoc networks , 2001, ICC 2001. IEEE International Conference on Communications. Conference Record (Cat. No.01CH37240).

[47]  Amy L. Murphy,et al.  Enabling the rapid development of dependable applications in the mobile environment , 2000 .

[48]  Stephen E. Deering,et al.  Multicast routing in datagram internetworks and extended LANs , 1990, TOCS.

[49]  Jeff Klann,et al.  Folk computing: revisiting oral tradition as a scaffold for co-present communities , 2001, CHI.

[50]  P. Kollock.  DESIGN PRINCIPLES FOR ONLINE COMMUNITIES , 1997 .

[51]  Marvin Theimer,et al.  The Bayou Architecture: Support for Data Sharing Among Mobile Users , 1994, 1994 First Workshop on Mobile Computing Systems and Applications.

[52]  Ronald E. Rice,et al.  Video as a technology for informal communication , 1993, CACM.

[53]  Jörg Roth.  Mobility Support for Replicated Real-Time Applications , 2002, IICS.

[54]  David Gelernter,et al.  Generative communication in Linda , 1985, TOPL.

[55]  Gerd Kortuem,et al.  A collaborative wearable system with remote sensing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[56]  Owen Daly-Jones,et al.  Informal workplace communication: what is it like and how might we support it? , 1994, CHI '94.

[57]  Gerd Kortuem,et al.  When Cyborgs meet: building communities of cooperating wearable agents , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[58]  Pat Hanrahan,et al.  ICrafter: A Service Framework for Ubiquitous Computing Environments , 2001, UbiComp.

[59]  Daniel P. Siewiorek,et al.  Very Rapid Prototyping of Wearable Computers: A Case Study of VuMan 3 Custom versus Off-the-Shelf Design Methodologies , 1998, Des. Autom. Embed. Syst..

[60]  Cecilia Mascolo,et al.  XMIDDLE: A Data-Sharing Middleware for Mobile Computing , 2002, Wirel. Pers. Commun..

[61]  Gerd Kortuem,et al.  Wearable Communities: Augmenting Social Networks with Wearable Computers , 2003, IEEE Pervasive Comput..

[62]  Michael R. Genesereth,et al.  Software agents , 1994, CACM.

[63]  Leonard J. Bass,et al.  Adtranz: a mobile computing system for maintenance and collaboration , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[64]  Alex Pentland,et al.  Wearable computing and contextual awareness , 1999 .

[65]  Gerd Kortuem,et al.  How to Host a Pervasive Game Supporting Face-to-Face Interactions in Live-Action Roleplaying , 2001 .

[66]  Amy L. Murphy,et al.  LIME: Linda meets mobility , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[67]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.

[68]  Asim Smailagic,et al.  Metronaut: a wearable computer with sensing and global communication capabilities , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[69]  Steve Mann.  Intelligent Image Processing , 2001 .

[70]  Leandros Tassiulas,et al.  Proximity Awareness and Ad Hoc Network Establishment in Bluetooth , 2001 .

[71]  Gerd Kortuem,et al.  Disseminating Trust Information in Wearable Communities , 2000 .

[72]  Mark Billinghurst,et al.  A wearable spatial conferencing space , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[73]  Gerd Kortuem.  Proem: a middleware platform for mobile peer-to-peer computing , 2002, MOCO.

[74]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[75]  Yasuyuki Sumi,et al.  AgentSalon: facilitating face-to-face knowledge exchange through conversations among personal agents , 2001, AGENTS '01.

[76]  J. J. Garcia-Luna-Aceves,et al.  Scalable link-state Internet routing , 1998, Proceedings Sixth International Conference on Network Protocols (Cat. No.98TB100256).

[77]  Jenny Preece,et al.  Online Communities: Designing Usability and Supporting Sociability , 2000 .

[78]  Xiaoyan Hong,et al.  LANMAR: landmark routing for large scale wireless ad hoc networks with group mobility , 2000, 2000 First Annual Workshop on Mobile and Ad Hoc Networking and Computing. MobiHOC (Cat. No.00EX444).

[79]  Mitchel Resnick,et al.  Meme tags and community mirrors: moving from conferences to collaboration , 1998, CSCW '98.

[80]  Ryan Moats,et al.  URN Syntax , 1997, RFC.

[81]  Hideyuki Nakanishi,et al.  FreeWalk: supporting casual meetings in a network , 1996, CSCW '96.

[82]  Pattie Maes,et al.  Hive: distributed agents for networking things , 1999, Proceedings. First and Third International Symposium on Agent Systems Applications, and Mobile Agents.

[83]  Mark Billinghurst,et al.  Wearable computers for three dimensional CSCW , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[84]  Mario Gerla,et al.  Fisheye state routing: a routing scheme for ad hoc wireless networks , 2000, 2000 IEEE International Conference on Communications. ICC 2000. Global Convergence Through Communications. Conference Record.

[85]  Steven K. Feiner,et al.  Situated documentaries: embedding multimedia presentations in the real world , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[86]  Mario Gerla,et al.  Global state routing: a new routing scheme for ad-hoc wireless networks , 1998, ICC '98. 1998 IEEE International Conference on Communications. Conference Record. Affiliated with SUPERCOMM'98 (Cat. No.98CH36220).

[87]  Yun Peng,et al.  An agent-based infrastructure for enterprise integration , 1999, Proceedings. First and Third International Symposium on Agent Systems Applications, and Mobile Agents.

[88]  Douglas C. Engelbart,et al.  Augmenting human intellect: a conceptual framework , 1962 .

[89]  Mahadev Satyanarayanan,et al.  Disconnected operation in the Coda File System , 1992, TOCS.

[90]  Ian Clarke,et al.  Freenet: A Distributed Anonymous Information Storage and Retrieval System , 2000, Workshop on Design Issues in Anonymity and Unobservability.

[91]  Robert E. Kraut,et al.  Internet paradox. A social technology that reduces social involvement and psychological well-being? , 1998, The American psychologist.

[92]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[93]  Paul Dourish,et al.  Portholes: supporting awareness in a distributed work group , 1992, CHI.

[94]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[95]  Cecilia Mascolo,et al.  An XML-based middleware for peer-to-peer computing , 2001, Proceedings First International Conference on Peer-to-Peer Computing.

[96]  Victoria Bellotti,et al.  Walking away from the desktop computer: distributed collaboration and mobility in a product design team , 1996, CSCW '96.

[97]  Philip R. Zimmermann,et al.  The official PGP user's guide , 1996 .

[98]  Christian Heath,et al.  Mobility in collaboration , 1998, CSCW '98.

[99]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[100]  Alan Kaminsky,et al.  Infrastructure for Distributed Applications in Ad Hoc Networks of Small Mobile Wireless Devices , 2001 .

[101]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[102]  Y. C. Tay,et al.  AMRIS: a multicast protocol for ad hoc wireless networks , 1999, MILCOM 1999. IEEE Military Communications. Conference Proceedings (Cat. No.99CH36341).

[103]  Ravi Prakash,et al.  Unidirectional links prove costly in wireless ad hoc networks , 1999, DIALM '99.

[104]  Jennifer Healey,et al.  Affective wearables , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[105]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[106]  Andy Oram,et al.  Peer-to-Peer: Harnessing the Power of Disruptive Technologies , 2001 .

[107]  Timothy W. Finin,et al.  KQML as an agent communication language , 1994, CIKM '94.

[108]  J. Nash.  THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[109]  David P. Anderson,et al.  SETI@home-massively distributed computing for SETI , 2001, Comput. Sci. Eng..

[110]  Hans-Peter Bischof,et al.  Many-to-Many Invocation: a new object oriented paradigm for ad hoc collaborative systems , 2002, OOPSLA '02.

[111]  David A. Maltz,et al.  Dynamic Source Routing in Ad Hoc Wireless Networks , 1994, Mobidata.

[112]  Leandros Tassiulas,et al.  Distributed topology construction of Bluetooth personal area networks , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[113]  R. Hinde,et al.  The Possibility of Cooperation@@@Cooperation: The Basis of Sociability.@@@Cooperation and Prosocial Behavior.@@@Governing the Commons: The Evolution of Institutions for Collective Action. , 1990 .

[114]  J. Jubin,et al.  The DARPA packet radio network protocols , 1987, Proceedings of the IEEE.

[115]  Kori Inkpen Quinn,et al.  GeneyTM: designing a collaborative activity for the palmTM handheld computer , 2001, CHI.

[116]  Charles E. Perkins,et al.  Highly Dynamic Destination-Sequenced Distance-Vector Routing (DSDV) for mobile computers , 1994, SIGCOMM.

[117]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[118]  Stephen Gordon Batsell,et al.  A reservation-based multicast (RBM) routing protocol for mobile networks: initial route construction phase , 1995, Wirel. Networks.

[119]  David A. Maltz,et al.  The effects of on-demand behavior in routing protocols for multihop wireless ad hoc networks , 1999, IEEE J. Sel. Areas Commun..

[120]  Daniel P. Siewiorek,et al.  The CMU mobile computers: a new generation of computer systems , 1994, Proceedings of COMPCON '94.

[121]  J. J. Garcia-Luna-Aceves,et al.  Source-tree routing in wireless networks , 1999, Proceedings. Seventh International Conference on Network Protocols.

[122]  石田 亨,et al.  Community computing : collaboration over global information networks , 1998 .