On Lions, Impala, and Bigraphs

While HCI has a long tradition of formally modelling task-based interactions with graphical user interfaces, there has been less progress in modelling emerging ubiquitous computing systems due in large part to their highly contextual nature and dependence on unreliable sensing systems. We present an exploration of modelling an example ubiquitous system, the Savannah game, using the mathematical formalism of bigraphs, which are based on a universal process algebra that encapsulates both dynamic and spatial behaviour of autonomous agents that interact and move among each other, or within each other. We establish a modelling approach based on four perspectives on ubiquitous systems—Computational, Physical, Human, and Technology—and explore how these interact with one another. We show how our model explains observed inconsistencies in user trials of Savannah, and then, how formal analysis reveals an incompleteness in design and guides extensions of the model and/or possible system re-design to resolve this.

[1]  E. Hall,et al.  The Hidden Dimension , 1970 .

[2]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[3]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[4]  Thomas P. Moran,et al.  The Command Language Grammar: A Representation for the User Interface of Interactive Computer Systems , 1981, Int. J. Man Mach. Stud..

[5]  Bernard Sufrin.  Formal Specification of a Display-Oriented Text Editor , 1982, Sci. Comput. Program..

[6]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[7]  B. Hillier,et al.  The Social Logic of Space , 1984 .

[8]  Peter Johnson,et al.  People and Computers: Designing the Interface , 1985 .

[9]  Heather Alexander.  Formally-based tools and techniques for human-computer dialogues , 1986 .

[10]  Jakob Nielsen,et al.  A Virtual Protocol Model for Computer-Human Interaction , 1984, Int. J. Man Mach. Stud..

[11]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[12]  D. Norman.  The psychology of everyday things", Basic Books Inc , 1988 .

[13]  Alan J. Dix,et al.  Abstract, Generic Models of Interactive Systems , 1988, British Computer Society Conference on Human-Computer Interaction.

[14]  Susan Leigh Star,et al.  Institutional Ecology, `Translations' and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39 , 1989 .

[15]  Jonathan Grudin,et al.  The computer reaches out: the historical continuity of interface design , 1989, CHI '90.

[16]  Gregory D. Abowd,et al.  Giving Undo Attention , 1992, Interact. Comput..

[17]  James D. Hollan,et al.  Pad++: a zooming graphical interface for exploring alternate interface physics , 1994, UIST '94.

[18]  Nick Hammond,et al.  Transferring HCI Modelling and Design Techniques to Practitioners: A Framework and Empirical Work , 1994, BCS HCI.

[19]  Human Factors in Computing Systems, CHI '95 Conference Companion: Mosaic of Creativity, Denver, Colorado, USA, May 7-11, 1995 , 1995, CHI Conference Companion.

[20]  Nick Hammond,et al.  Multidisciplinary modelling in HCI design…in theory and in practice , 1995, CHI '95.

[21]  Steve Benford,et al.  MASSIVE: a collaborative virtual environment for teleconferencing , 1995, TCHI.

[22]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[23]  Bob Fields,et al.  Distributed information resources: a new approach to interaction modelling , 1996 .

[24]  Natarajan Shankar,et al.  PVS: Combining Specification, Proof Checking, and Model Checking , 1996, FMCAD.

[25]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[26]  Muffy Calder,et al.  What Use are Formal Design and Analysis Methods to Telecommunications Services? , 1998, FIW.

[27]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[28]  Bob Fields,et al.  ANALYSING HUMAN-COMPUTER INTERACTION AS DISTRIBUTED COGNITION: THE RESOURCES MODEL , 1999 .

[29]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[30]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[31]  Sriram K. Rajamani,et al.  SLAM and Static Driver Verifier: Technology Transfer of Formal Methods inside Microsoft , 2004, IFM.

[32]  Harold W. Thimbleby,et al.  MAUI: An Interface Design Tool Based on Matrix Algebra , 2004, CADUI.

[33]  Duncan Rowland,et al.  Life on the edge: supporting collaboration in location-based experiences , 2005, CHI.

[34]  Vladimiro Sassone,et al.  Spatial Logics for Bigraphs , 2005, ICALP.

[35]  Paul Dourish,et al.  Re-space-ing place: "place" and "space" ten years on , 2006, CSCW '06.

[36]  Emmanuel Dubois,et al.  A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model , 2007, EHCI/DS-VIS.

[37]  John M. Rushby.  What Use is Verified Software? , 2007, 12th IEEE International Conference on Engineering Complex Computer Systems (ICECCS 2007).

[38]  P. Calistri,et al.  Geographic information systems: introduction. , 2007, Veterinaria italiana.

[39]  David Lorge Parnas.  Connecting Good Theory to Good Practice: Software Documentation: A Case Study , 2008, Software Engineering.

[40]  Robin Milner,et al.  Stochastic Bigraphs , 2008, MFPS.

[41]  Robin Milner,et al.  The Space and Motion of Communicating Agents , 2009 .

[42]  Denis Lalanne,et al.  Tools for designing and prototyping activity-based pervasive applications , 2009, MoMM.

[43]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[44]  Sophie Dupuy-Chessa,et al.  A Software Engineering Method for the Design of Mixed Reality Systems , 2010, The Engineering of Mixed Reality Systems.

[45]  Yvonne Rogers,et al.  Using F-formations to analyse spatial patterns of interaction in physical environments , 2011, CSCW.

[46]  Saul Greenberg.  Opportunities for proxemic interactions in ubicomp , 2011 .

[47]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .

[48]  Yvonne Rogers,et al.  HCI Theory: Classical, Modern, and Contemporary , 2012, HCI Theory.

[49]  Kristina Höök,et al.  Strong concepts: Intermediate-level knowledge in interaction design research , 2012, TCHI.

[50]  Muffy Calder,et al.  Modelling IEEE 802.11 CSMA/CA RTS/CTS with stochastic bigraphs with sharing , 2012, Formal Aspects of Computing.

[51]  Ellen J. Bass,et al.  Using Formal Verification to Evaluate Human-Automation Interaction: A Review , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[52]  Ann Blandford,et al.  Using PVS to support the analysis of distributed cognition systems , 2013, Innovations in Systems and Software Engineering.

[53]  Muffy Calder,et al.  Real-time verification of wireless home networks using bigraphs with sharing , 2014, Sci. Comput. Program..

[54]  Muffy Calder,et al.  Probabilistic Model Checking of DTMC Models of User Activity Patterns , 2014, QEST.

[55]  Christophe Bortolaso,et al.  An MDE-based framework to support the development of Mixed Interactive Systems , 2014, Sci. Comput. Program..

[56]  Harold W. Thimbleby.  Safer User Interfaces: A Case Study in Improving Number Entry , 2015, IEEE Transactions on Software Engineering.

[57]  Muffy Calder,et al.  Bigraphs with sharing , 2015, Theor. Comput. Sci..

[58]  C. Newcombe,et al.  How Amazon web services uses formal methods , 2015, Commun. ACM.

[59]  Monika Richter,et al.  Cognition In The Wild , 2016 .