Framework for evaluating usability problems: a case study low-cost interfaces for thermostats

When an evaluation for detecting usability problems is conducted in low-cost thermostat interfaces, several usability problems can show up in one evaluation, and sometimes results are difficult to interpret to correct those problems. If an expert is not implementing, evaluating, and analyzing the test, part of the information could be lost. In addition, designers of interfaces need support in order to provide the most important usability problems. On the other hand, it is important that consumers of low-cost thermostat interfaces use the interface in a correct manner to save energy and time when they are installing and programming the thermostat. Therefore, the usability problems must be eliminated in interfaces before the consumer uses the interface. Thus, the critical usability problems, which drive thermostats to a catastrophe usability problem in the interfaces, have to be found and solved during the design stage to get a successful interface design in the early stages. This paper presents a framework based on information from experts and consumers to solve usability problems. Moreover, it gives a structure and guidelines for designing and evaluating thermostat interfaces. This proposal assumes that it is possible to use information from experts and consumers for detecting and solving usability problems. The framework includes information from experts who rank the usability problems, and then this information is used to design the time on task and success rate evaluations for end users during the design process.

[1]  Mark W. Newman,et al.  Living with an intelligent thermostat: advanced control for heating and cooling systems , 2012, UbiComp.

[2]  Therese Peffer,et al.  Facilitating energy savings with programmable thermostats: evaluation and guidelines for the thermostat user interface , 2013, Ergonomics.

[3]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[4]  Derek B. Ingham,et al.  Performance prediction of a proton exchange membrane fuel cell using the ANFIS model , 2009 .

[5]  Changxu Wu,et al.  Saving energy when using air conditioners in offices—Behavioral pattern and design indications , 2014 .

[6]  Robert D. Macredie,et al.  The assessment of usability of electronic shopping: A heuristic evaluation , 2005, Int. J. Inf. Manag..

[7]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[8]  Jakob Nielsen,et al.  Severity Ratings for Usability Problems , 2006 .

[9]  J.-S.R. Jang,et al.  Input selection for ANFIS learning , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[10]  Therese Peffer,et al.  Usability of residential thermostats: Preliminary investigations , 2011 .

[11]  Guy R. Newsham,et al.  The effect of utility time-varying pricing and load control strategies on residential summer peak electricity use: A review , 2010 .

[12]  Therese Peffer,et al.  Making energy savings easier: usability metrics for thermostats , 2011 .

[13]  Cigdem Altin Gumussoy,et al.  Usability guideline for banking software design , 2016, Comput. Hum. Behav..

[14]  Carole A. George Usability testing and design of a library website: an iterative approach , 2005, OCLC Syst. Serv..

[15]  Gregor P. Henze,et al.  Evaluation of automatic priced based thermostat control for peak energy reduction under residential time-of-use utility tariffs , 2012 .

[16]  Therese Peffer,et al.  Original research articleEnergy efficiency and the misuse of programmable thermostats: The effectiveness of crowdsourcing for understanding household behavior , 2015 .

[17]  H. Dale,et al.  Ergonomic aspects of heating controls , 1983 .

[18]  Therese Peffer,et al.  How people use thermostats in homes: A review , 2011, Building and Environment.