User-centred design and evaluation of ubiquitous services

Theoretical and technological progress has revived the interest in the design of services for the support of co-located human-human communication and collaboration, witnessing the start of several large-scale projects over the last few years. Most of these projects focus on meetings and/or lecture situations. However, user-centred design and evaluation frameworks for co-located communication and collaboration are a major concern. In this paper, we summarise the prevalent approaches towards user-centred design and evaluation, and we develop two different services. In one service, participants in a small-group meeting receive real-time feedback about observable properties of the meeting that are directly related to the social dynamics, such as individual amount of speaking time or eye-gaze patterns. In the other service, teachers in a classroom receive real-time feedback about the activities and attention level of participants in the lecture. We also propose ways to address the different dimensions that are relevant to the design and evaluation of these services (the individual, the social and the organisational dimension), bringing together methods from different disciplines.

[1]  Carl Gutwin,et al.  A comparison of usage evaluation and inspection methods for assessing groupware usability , 2001, GROUP.

[2]  Harold Fox The eFacilitator : a meeting capture application and infrastructure , 2003 .

[3]  Mary Beth Rosson,et al.  Evaluating computer-supported cooperative work: models and frameworks , 2004, CSCW.

[4]  Gregory D. Abowd,et al.  Lessons learned from eClass: Assessing automated capture and access in the classroom , 2004, TCHI.

[5]  Jakob E. Bardram,et al.  Scenario-Based Design of Cooperative Systems Re-designing an Hospital Information System in Denmark , 2000 .

[6]  Bill N. Schilit,et al.  Dynomite: a dynamically organized ink and audio notebook , 1998 .

[7]  M. Weiser,et al.  THE COMING AGE OF CALM TECHNOLOGY[1] , 1996 .

[8]  Jonathan Grudin,et al.  Groupware and social dynamics: eight challenges for developers , 1994, CACM.

[9]  Magnus Ramage,et al.  Developing a methodology for the evaluation of cooperative systems , 1997 .

[10]  Gregory D. Abowd,et al.  Enriching everyday activities through the automated capture and access of live experiences. eclass: building, observing and understanding the impact of capture and access in an educational domain , 2001 .

[11]  Carl Gutwin,et al.  Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration , 2003, TCHI.

[12]  W. Buxton Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[13]  Walter Bender,et al.  Influencing group participation with a shared display , 2004, CSCW.

[14]  Lin Wu,et al.  MeetingManager: A Collaborative Tool in the Intelligent Room , 2007 .

[15]  A. M. Pejtersen,et al.  Information seeking and sharing in design teams , 2003, GROUP.

[16]  Kate Ehrlich,et al.  Designing Groupware Applications: A Work-Centered Design Approach , 2000 .

[17]  Daniel P. W. Ellis,et al.  Audio information access from meeting rooms , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[18]  Mike Flynn,et al.  Browsing Recorded Meetings with Ferret , 2004, MLMI.

[19]  M. van Welie,et al.  Modeling Complex Processes in GTA. , 1999 .

[20]  Peter J. Denning,et al.  Beyond calculation - the next fifty years of computing , 1997 .

[21]  Eric Horvitz,et al.  Models of attention in computing and communication , 2003, Commun. ACM.

[22]  Dennis H. Rouvray,et al.  Beyond calculation: The next fifty years of computing , 1997 .

[23]  Gregory D. Abowd,et al.  Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment , 1999, IBM Syst. J..

[24]  Joseph A. Goguen,et al.  Techniques for requirements elicitation , 1993, [1993] Proceedings of the IEEE International Symposium on Requirements Engineering.

[25]  Takeo Igarashi,et al.  Flatland: new dimensions in office whiteboards , 1999, CHI '99.

[26]  Yasuhiro Katagiri Capturing Conversational Participation in a Ubiquitous Sensor Environment , 2004 .

[27]  Ian Alexander Designing Collaborative Systems. A Practical Guide to Ethnography , 2003, Eur. J. Inf. Syst..

[28]  Armando Fox,et al.  The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms , 2002, IEEE Pervasive Comput..

[29]  Samy Bengio,et al.  Towards Computer Understanding of Human Interactions , 2003, EUSAI.

[30]  C R Paris,et al.  Teamwork in multi-person systems: a review and analysis , 2000, Ergonomics.

[31]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[32]  Gregory D. Abowd,et al.  Charting past, present, and future research in ubiquitous computing , 2000, TCHI.