An Information and Control Framework for Optimizing User-Compliant Human–Computer Interfaces

We consider a general framework for a human–computer interface whereby the human's knowledge is represented as a point in Euclidean space, the intention of the human is signaled to the computer over a noisy channel, and the computer queries the human in a manner that is amenable to human operation. With these constraints at hand, we demonstrate a class of systems that are nonetheless information-theoretically optimal in that the computer very rapidly hones in on the intent of the human. Much recent work on feedback information theory has been dedicated to the exploration of methods by which optimal feedback may be derived for the purpose of expediting the communication of a message point between an inanimate encoder and decoder. Our framework not only takes advantage of previous work to demonstrate its communication optimality from this perspective as well as from an information-theoretic perspective but also contributes two distinct advantages. First, our framework provides a simplified method based on optimal transport theory to generate optimal feedback signals between the computer and human in high dimension, while still preserving communication optimality. Second, our framework specifically lends itself to the integration of a human user by attempting to moderate the difficulty of the task presented to the user, while still preserving optimality. We demonstrate applications of our framework within the context of multi-agent brain-computer interfaces.

[1]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[2]  Alfred O. Hero,et al.  Collaborative 20 Questions for Target Localization , 2013, IEEE Transactions on Information Theory.

[3]  Rui Ma,et al.  Generalizing the Posterior Matching Scheme to higher dimensions via optimal transportation , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  Rui Ma,et al.  A Stochastic Control Approach to Optimally Designing Hierarchical Flash Sets in P300 Communication Prostheses , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Manuela M. Veloso,et al.  Complementary humanoid behavior shaping using corrective demonstration , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[6]  Twenty Questions with Noise: Bayes Optimal Policies for Entropy Loss , 2012, Journal of Applied Probability.

[7]  Todd P. Coleman,et al.  Information-Theoretic Viewpoints on Optimal Causal Coding-Decoding Problems , 2011, ArXiv.

[8]  Javier Ruiz-del-Solar,et al.  Interactive Learning of Continuous Actions from Corrective Advice Communicated by Humans , 2015, RoboCup.

[9]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[10]  Lei Ding,et al.  Motor imagery classification by means of source analysis for brain–computer interface applications , 2004, Journal of neural engineering.

[11]  Yu-Chi Ho,et al.  Team decision theory and information structures , 1980 .

[12]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[13]  Todd P. Coleman,et al.  A stochastic control viewpoint on ‘Posterior Matching’-style feedback communication schemes , 2009, 2009 IEEE International Symposium on Information Theory.

[14]  Michael Horstein,et al.  Sequential transmission using noiseless feedback , 1963, IEEE Trans. Inf. Theory.

[15]  Abdullah Akce,et al.  A Feedback Information-Theoretic Approach to the Design of Brain–Computer Interfaces , 2010, Int. J. Hum. Comput. Interact..

[16]  Todd P. Coleman,et al.  An Optimizer's Approach to Stochastic Control Problems With Nonclassical Information Structures , 2013, IEEE Transactions on Automatic Control.

[17]  P. Stone,et al.  TAMER: Training an Agent Manually via Evaluative Reinforcement , 2008, 2008 7th IEEE International Conference on Development and Learning.

[18]  Meir Feder,et al.  Optimal Feedback Communication Via Posterior Matching , 2009, IEEE Transactions on Information Theory.

[19]  TaeChoong Chung,et al.  Learning via human feedback in continuous state and action spaces , 2013, Applied Intelligence.

[20]  Rui Ma,et al.  Efficient Bayesian inference methods via convex optimization and optimal transport , 2013, 2013 IEEE International Symposium on Information Theory.

[21]  Tamer Basar,et al.  Simultaneous design of measurement and control strategies for stochastic systems with feedback , 1989, Autom..

[22]  Rui Ma,et al.  An analytic spatial filter and a hidden Markov model for enhanced information transfer rate in EEG-based brain computer interfaces , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Todd P. Coleman,et al.  Dynamic and Succinct Statistical Analysis of Neuroscience Data , 2014, Proceedings of the IEEE.

[24]  G Pfurtscheller,et al.  Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.