Towards automatic personalization of device controls

People are increasingly using customizable remotes to interact with devices in new and interesting ways that are influenced by the idiosyncrasies of their behaviors and environments. With the growing use of advanced processors in small consumer electronics, it is becoming more practical to have such remotes execute machine-learning algorithms that can automatically specify the idiosyncrasies. This paper addresses two especially useful and common types of features of personalizable remotes: "task based button grouping" and macros. "Task-based button grouping" addresses clutter and frequent screen switching by only presenting the commands (or buttons) a user needs to accomplish a given active task. Macros allow users to efficiently invoke a sequence of commands across multiple devices that are used in the task. The contributions of this work include: (a) an identification of several usage patterns that show limitations of previous work in task and macro based commands, (b) a set of new algorithms that apply these patterns to address these limitations, and (c) an evaluation of each algorithm using real-world interaction data. We show that our algorithms, which uniquely apply fuzzy techniques and time-based heuristics, can offer a significant improvement from the state-of-the-art in automation and accuracy.

[1]  James F. Allen,et al.  TRAINS-95: Towards a Mixed-Initiative Planning Assistant , 1996, AIPS.

[2]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[3]  Richard Han,et al.  Automated Selection of Remote Control User Interfaces In Pervasive Smart Spaces , 2001 .

[4]  Forrest W. Young,et al.  Introduction to Multidimensional Scaling: Theory, Methods, and Applications , 1981 .

[5]  Prasun Dewan,et al.  Comparing end-user and intelligent remote control interface generation , 2005, Personal and Ubiquitous Computing.

[6]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[7]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[8]  Eric Horvitz,et al.  Conversation as Action Under Uncertainty , 2000, UAI.

[9]  Gerard Salton,et al.  The SMART Retrieval System—Experiments in Automatic Document Processing , 1971 .

[10]  John Zimmerman,et al.  Vio: a mixed-initiative approach to learning and automating procedural update tasks , 2007, CHI.

[11]  Jeffrey S. Pierce,et al.  From devices to tasks: automatic task prediction for personalized appliance control , 2004, Personal and Ubiquitous Computing.

[12]  Mark H Burstein.  ARPA/Rome laboratory knowledge-based planning and scheduling initiative workshop proceedings , 1994 .

[13]  Cristina Conati,et al.  Supporting interface customization using a mixed-initiative approach , 2007, IUI '07.

[14]  James C. Bezdek,et al.  Fuzzy mathematics in pattern classification , 1973 .

[15]  Analía Amandi,et al.  User - interface agent interaction: personalization issues , 2004, Int. J. Hum. Comput. Stud..

[16]  Krzysztof Z. Gajos,et al.  Automatically generating personalized user interfaces with Supple , 2010, Artif. Intell..

[17]  Peter Stone,et al.  A social reinforcement learning agent , 2001, AGENTS '01.