Active Lezi: an Incremental Parsing Algorithm for Sequential Prediction

Prediction is an important component in a variety of domains in Artificial Intelligence and Machine Learning, in order that Intelligent Systems may make more informed and reliable decisions. Certain domains require that prediction be performed on sequences of events that can typically be modeled as stochastic processes. This work presents Active LeZi (ALZ), a sequential prediction algorithm that is founded on an Information Theoretic approach, and is based on the acclaimed LZ78 family of data compression algorithms. The efficacy of this algorithm in a typical Smart Environment – the Smart Home, is demonstrated by employing this algorithm to predict device usage in the home. The performance of this algorithm is tested on synthetic data sets that are representative of typical interactions between a Smart Home and the inhabitant. In addition, for the Smart Home environment, we introduce a method of learning a measure of the relative time between actions using ALZ, and demonstrate the efficacy of this approach on synthetic Smart Home data.

[1]  Diane J. Cook,et al.  The role of prediction algorithms in the MavHome smart home architecture , 2002, IEEE Wirel. Commun..

[2]  P. Krishnan,et al.  Optimal prefetching via data compression , 1991, [1991] Proceedings 32nd Annual Symposium of Foundations of Computer Science.

[3]  Neri Merhav,et al.  Correction to 'Universal prediction of individual sequences' (Jul 92 1258-1270) , 1994, IEEE Trans. Inf. Theory.

[4]  Sajal K. Das,et al.  LeZi-Update: An Information-Theoretic Framework for Personal Mobility Tracking in PCS Networks , 2002, Wirel. Networks.

[5]  Diane J. Cook,et al.  Learning to Control a Smart Home Environment , 2003 .

[6]  Ian H. Witten,et al.  Text Compression , 1990, 125 Problems in Text Algorithms.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Meir Feder,et al.  Branch prediction based on universal data compression algorithms , 1998, ISCA.

[9]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[10]  Neri Merhav,et al.  Universal prediction of individual sequences , 1992, IEEE Trans. Inf. Theory.