User Experience Evaluation Methods: Lessons Learned from an Interactive TV Case-Study

Evaluating user experience (UX) is a complicated endeavour due to the multitude of existing factors, dimensions and concepts that all contribute to UX. We report lessons learned from conducting a user study that was adapted to not only evaluate usability but also several aspects of the user experience. In this study we evaluated some of the most important factors of user experience including aesthetics, emotions, meaning and value as well as naturalness. Based on these experiences we propose a set of possible improvements to enhance existing user study approaches. These improvements aim at incorporating a variety of methods to support the various aspects of user experience including all experiences before, during and after interaction with a product.