Exploring End User Programming Needs in Home Automation

Home automation faces the challenge of providing ubiquitous, unobtrusive services while empowering users with approachable configuration interfaces. These interfaces need to provide sufficient expressiveness to support complex automation, and notations need to be devised that enable less tech-savvy users to express such scenarios. Rule-based and process-oriented paradigms have emerged as opposing ends of the spectrum; however, their underlying concepts have not been studied comparatively. We report on a contextual inquiry study in which we collected qualitative data from 18 participants in 12 households on the current potential and acceptance of home automation, as well as explored the respective benefits and drawbacks of these two notation paradigms for end users. Results show that rule-based notations are sufficient for simple automation tasks but not flexible enough for more complex use cases. The resulting insights can inform the design of interfaces for smart homes to enable usable real-world home automation for end users.

[1]  Mark W. Newman.  Now We're Cooking: Recipes for End-User Service Composition in the Digital Home , 2006 .

[2]  Alan F. Blackwell,et al.  The fuzzy felt ethnography—understanding the programming patterns of domestic appliances , 2004, Personal and Ubiquitous Computing.

[3]  Tiina Kymäläinen,et al.  A User-Centric View of Intelligent Environments: User Expectations, User Experience and User Role in Building Intelligent Environments , 2012, Comput..

[4]  Timothy Sohn,et al.  iCAP: Interactive Prototyping of Context-Aware Applications , 2006, Pervasive.

[5]  Tom Rodden,et al.  "Playing with the Bits" User-Configuration of Ubiquitous Domestic Environments , 2003, UbiComp.

[6]  Antonio F. Gómez-Skarmeta,et al.  An Integral and Networked Home Automation Solution for Indoor Ambient Intelligence , 2010, IEEE Pervasive Computing.

[7]  Eric Paulos,et al.  Beyond energy monitors: interaction, energy, and emerging energy systems , 2012, CHI.

[8]  Jiyun Lee,et al.  Trigger-Action Programming in the Wild: An Analysis of 200,000 IFTTT Recipes , 2016, CHI.

[9]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[10]  Stefan Saroiu,et al.  An Operating System for the Home , 2012, NSDI.

[11]  René Mayrhofer,et al.  A Survey of User Interaction for Spontaneous Device Association , 2014, CSUR.

[12]  Elaine M. Huang,et al.  Hacking the Natural Habitat: An In-the-Wild Study of Smart Homes, Their Development, and the People Who Live in Them , 2012, Pervasive.

[13]  F. Aldrich.  Smart Homes: Past, Present and Future , 2003 .

[14]  Michael Weber,et al.  homeBLOX: introducing process-driven home automation , 2013, UbiComp.

[15]  Blase Ur,et al.  Practical trigger-action programming in the smart home , 2014, CHI.

[16]  Kaisa Väänänen,et al.  Home Is Where Your Phone Is: Usability Evaluation of Mobile Phone UI for a Smart Home , 2004, Mobile HCI.

[17]  Johnny Rodgers,et al.  Smart Homes or Smart Occupants? Supporting Aware Living in the Home , 2011, INTERACT.

[18]  Mark W. Newman,et al.  Learning from a learning thermostat: lessons for intelligent systems for the home , 2013, UbiComp.

[19]  Guy Pyrzak,et al.  Breaking the fidelity barrier: an examination of our current characterization of prototypes and an example of a mixed-fidelity success , 2006, CHI.

[20]  Mark W. Newman,et al.  Providing an Integrated User Experience of Networked Media, Devices, and Services through End-User Composition , 2009, Pervasive.

[21]  Fulvio Corno,et al.  HomeRules: A Tangible End-User Programming Interface for Smart Homes , 2015, CHI Extended Abstracts.

[22]  Blase Ur,et al.  The Current State of Access Control for Smart Devices in Homes , 2013 .

[23]  Stefan Saroiu,et al.  Home automation in the wild: challenges and opportunities , 2011, CHI.

[24]  Asa MacWilliams,et al.  Smart Home Challenges and Approaches to Solve Them: A Practical Industrial Perspective , 2009 .

[25]  Paul Müller,et al.  Ambient Intelligence in Assisted Living: Enable Elderly People to Handle Future Interfaces , 2007, HCI.

[26]  Richard Harper,et al.  Inside the Smart Home: Ideas, Possibilities and Methods , 2003 .

[27]  Sarvapali D. Ramchurn,et al.  Doing the laundry with agents: a field trial of a future smart energy system in the home , 2014, CHI.

[28]  Jesse Hoey,et al.  Smart Home, The Next Generation: Closing the Gap between Users and Technology , 2012, AAAI Fall Symposium: Artificial Intelligence for Gerontechnology.

[29]  John Zimmerman,et al.  Principles of Smart Home Control , 2006, UbiComp.

[30]  Jo Vermeulen,et al.  From today's augmented houses to tomorrow's smart homes: new directions for home automation research , 2014, UbiComp.

[31]  Eric Campo,et al.  A review of smart homes - Present state and future challenges , 2008, Comput. Methods Programs Biomed..

[32]  W. Keith Edwards,et al.  More than meets the eye: transforming the user experience of home network management , 2008, DIS '08.

[33]  Pablo A. Haya,et al.  Towards a Ubiquitous End-User Programming System for Smart Spaces , 2010, J. Univers. Comput. Sci..

[34]  Bin Zhang,et al.  Design and evaluation of smart home user interface: effects of age, tasks and intelligence level , 2009, Behav. Inf. Technol..

[35]  Michael Weber,et al.  homeBLOX: making home automation usable , 2013, UbiComp.

[36]  Leila Takayama,et al.  Making technology homey: finding sources of satisfaction and meaning in home automation , 2012, UbiComp.

[37]  Enrico Costanza,et al.  Connecting the things to the internet: an evaluation of four configuration strategies for wi-fi devices with minimal user interfaces , 2015, UbiComp.

[38]  Abigail Sellen,et al.  User sketches: a quick, inexpensive, and effective way to elicit more reflective user feedback , 2006, NordiCHI '06.

[39]  Volker Wulf,et al.  Supporting End-User Articulations in Evolving Business Processes: a Case Study to Explore Intuitive Notations and Interaction Designs , 2012, Int. J. Cooperative Inf. Syst..

[40]  Kaisa Väänänen,et al.  Evolution towards smart home environments: empirical evaluation of three user interfaces , 2004, Personal and Ubiquitous Computing.

[41]  Tom Rodden,et al.  At home with agents: exploring attitudes towards future smart energy infrastructures , 2013, IJCAI.

[42]  Jason Pascoe,et al.  The stick-e note architecture: extending the interface beyond the user , 1997, IUI '97.

[43]  Yngve Dahl,et al.  End-User Composition Interfaces for Smart Environments: A Preliminary Study of Usability Factors , 2011, HCI.

[44]  Tom Rodden,et al.  Pattern-based support for interactive design in domestic settings , 2002, DIS '02.

[45]  Alan F. Blackwell,et al.  The domestic economy: a broader unit of analysis for end user programming , 2005, CHI EA '05.

[46]  Gerhard Leitner,et al.  End Users Programming Smart Homes - A Case Study on Scenario Programming , 2013, CHI-KDD.

[47]  Gregory D. Abowd,et al.  CAMP: A Magnetic Poetry Interface for End-User Programming of Capture Applications for the Home , 2004, UbiComp.