Issues in evaluating ambient displays in the wild: two case studies

In this paper we discus the complex task of evaluating ambient displays, concentrating on issues within in-situ deployments. We start by describing how these technologies have been evaluated in lab settings, where the focus has been primarily on issues of usability, and argue strongly for the necessity of in-situ evaluation. We then present two case studies involving in-situ evaluations, and from these derive issues that hindered the researchers from being able to delve more deeply into the overall impact of their implementations. We conclude with our own suggestions on possible alternatives to explore for evaluating ambient displays, which are based on the issues derived from our case studies.

[1]  Scott E. Hudson,et al.  The information percolator: ambient information display in a decorative object , 1999, UIST '99.

[2]  Bill Moggridge,et al.  Designing interactions , 2006 .

[3]  Peter Eades,et al.  Intrusive and Non-intrusive Evaluation of Ambient Displays , 2007, Ambient Information Systems.

[4]  Hiroshi Ishii,et al.  Pinwheels: visualizing information flow in an architectural space , 2001, CHI Extended Abstracts.

[5]  Hiroshi Ishii,et al.  Water lamp and pinwheels: ambient projection of digital information into architectural space , 1998, CHI Conference Summary.

[6]  Yvonne Rogers,et al.  Ambient influence: can twinkly lights lure and abstract representations trigger behavioral change? , 2010, UbiComp.

[7]  Hiroshi Ishii,et al.  ambientROOM: integrating ambient media with architectural space , 1998, CHI Conference Summary.

[8]  E. Coiera.  Interaction Design , 2002 .

[9]  Johan Redström,et al.  Slow Technology – Designing for Reflection , 2001, Personal and Ubiquitous Computing.

[10]  Ernesto Arroyo,et al.  Waterbot: exploring feedback and persuasive techniques at the sink , 2005, CHI.

[11]  Anind K. Dey,et al.  Heuristic evaluation of ambient displays , 2003, CHI '03.

[12]  Elizabeth D. Mynatt,et al.  Designing audio aura , 1998, CHI.

[13]  Jennifer Mankoff,et al.  Challenges for Ubicomp Evaluation , 2004 .

[14]  Pattie Maes,et al.  eye-q: eyeglass peripheral display for subtle intimate notifications , 2006, Mobile HCI.

[15]  Shaowen Bardzell,et al.  Interaction criticism: a proposal and framework for a new discipline of hci , 2008, CHI Extended Abstracts.

[16]  Tom White,et al.  An interactive poetic garden , 1998, CHI Conference Summary.

[17]  Richard Saul Wurman,et al.  Information Anxiety 2 , 1989 .

[18]  Yvonne Rogers,et al.  Bricolage and consultation: addressing new design challenges when building large-scale installations , 2010, Conference on Designing Interactive Systems.

[19]  Mark Weiser,et al.  Designing Calm Technology , 2004 .

[20]  Ann Close,et al.  From the source. , 2008, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[21]  Lars Erik Holmquist.  Evaluating the comprehension of ambient displays , 2004, CHI EA '04.

[22]  Hiroshi Ishii,et al.  LumiTouch: an emotional communication device , 2001, CHI Extended Abstracts.

[23]  Johan Redström,et al.  Informative art: using amplified artworks as information displays , 2000, DARE '00.

[24]  Patrick Olivier,et al.  Crossmodal Ambient Displays , 2007 .