Inferring ECA-based rules for ambient intelligence using evolutionary feature extraction

One of the goals in Ambient Intelligence is to enable Intelligent Environments to take decisions based on the perceived context. In our previous work, we successfully explored how the inhabitants can communicate their own preferences with the environment using Event-Condition-Action ECA rules. The easiness of the communication language combined with an appropriate explanation mechanism gives trust to the Intelligent Environment actions. However, defining every preference, and maintaining them up-to-date can be cumbersome. Therefore, a complementary mechanism is required to learn from user behavior and adapt to small changes without being explicitly requested for. Inferring behaviors effectively from data collected from sensors in an Intelligent Environment is a challenging problem. The main issues include primitive representation of data, the necessity of a high number of sensors, and dealing with few training data collected in a short time. We present MFE3/GADR, an evolutionary constructive induction method to ease inferring inhabitants' preferences from data collected from simple sensors. We show that this method detects successfully relevant sensors and constructs highly informative features that abstract relations among them. The constructed features, in addition to improving significantly the learning accuracy, break down and encapsulate the performance of inhabitants into decision trees that can easily be converted to ECA rules for further use in the Intelligent Environment. Comparing the empirical results show that our method can reduce a large set of complex ECA rules that represent the preferences to a smaller set of simple ECA rules.

[1]  Lukasz A. Kurgan,et al.  CAIM discretization algorithm , 2004, IEEE Transactions on Knowledge and Data Engineering.

[2]  Eduardo Pérez,et al.  Evolutionary multi-feature construction for data reduction: A case study , 2009, Appl. Soft Comput..

[3]  Larry A. Rendell,et al.  Using Multidimensional Projection to Find Relations , 1995, ICML.

[4]  Yoram Reich,et al.  Strengthening learning algorithms by feature discovery , 2012, Inf. Sci..

[5]  M. Pazzani Constructive Induction of Cartesian Product Attributes , 1998 .

[6]  Rayner Alfred,et al.  DARA: Data Summarisation with Feature Construction , 2008, 2008 Second Asia International Conference on Modelling & Simulation (AMS).

[7]  Fabien L. Gandon,et al.  Ambient Intelligence: The MyCampus Experience , 2005 .

[8]  Geoffrey I. Webb,et al.  # 2001 Kluwer Academic Publishers. Printed in the Netherlands. Machine Learning for User Modeling , 1999 .

[9]  Robert C. Holte,et al.  Very Simple Classification Rules Perform Well on Most Commonly Used Datasets , 1993, Machine Learning.

[10]  Eduardo Pérez,et al.  Feature Construction and Feature Selection in Presence of Attribute Interactions , 2009, HAIS.

[11]  Marc Boullé,et al.  Khiops: A Statistical Discretization Method of Continuous Attributes , 2004, Machine Learning.

[12]  Politecnica Superior,et al.  Easing the Smart Home: a rule-based language and multi-agent structure for end user development in Intelligent Environments , 2009 .

[13]  Pablo A. Haya,et al.  Managing Pervasive Environment Privacy Using the "fair trade" Metaphor , 2007, OTM Workshops.

[14]  Pablo A. Haya,et al.  Towards a Ubiquitous End-User Programming System for Smart Spaces , 2010, J. Univers. Comput. Sci..

[15]  Dr. Alex A. Freitas Data Mining and Knowledge Discovery with Evolutionary Algorithms , 2002, Natural Computing Series.

[16]  Fernando E. B. Otero,et al.  Genetic Programming for Attribute Construction in Data Mining , 2002, EuroGP.

[17]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (2nd, extended ed.) , 1994 .

[18]  Ryszard S. Michalski,et al.  Pattern Recognition as Knowledge-Guided Computer Induction , 1978 .

[19]  Yang Zhang,et al.  Domain-independent feature extraction for multi-classification using multi-objective genetic programming , 2010, Pattern Analysis and Applications.

[20]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[21]  Pablo A. Haya,et al.  Exploitational Interaction , 2009, Instinctive Computing Workshop.

[22]  P. Grünwald The Minimum Description Length Principle (Adaptive Computation and Machine Learning) , 2007 .

[23]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[24]  M.C. Mozer An Intelligent Environment Must Be Adaptive , 1999, IEEE Intelligent Systems and their Applications.

[25]  José María Valls,et al.  GPPE: a method to generate ad-hoc feature extractors for prediction in financial domains , 2008, Applied Intelligence.

[26]  Ivan Bratko,et al.  Testing the significance of attribute interactions , 2004, ICML.

[27]  Brad A. Myers,et al.  Natural programming languages and environments , 2004, Commun. ACM.

[28]  Larry Bull,et al.  Feature Construction and Selection Using Genetic Programming and a Genetic Algorithm , 2003, EuroGP.

[29]  Larry A. Rendell,et al.  Learning hard concepts through constructive induction: framework and rationale , 1990, Comput. Intell..

[30]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[31]  Kuan-Rong Lee,et al.  A flexible sequence alignment approach on pattern mining and matching for human activity recognition , 2010, Expert Syst. Appl..

[32]  George D. Smith,et al.  Evolutionary constructive induction , 2005, IEEE Transactions on Knowledge and Data Engineering.

[33]  Bill N. Schilit,et al.  An overview of the PARCTAB ubiquitous computing experiment , 1995, IEEE Wirel. Commun..

[34]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[35]  Pablo A. Haya,et al.  Easing the Smart Home: Translating Human Hierarchies to Intelligent Environments , 2009, IWANN.

[36]  Zijian Zheng,et al.  Constructing X-of-N Attributes for Decision Tree Learning , 2000, Machine Learning.

[37]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[38]  Larry A. Rendell,et al.  Lookahead Feature Construction for Learning Hard Concepts , 1993, International Conference on Machine Learning.

[39]  Diane J. Cook,et al.  The role of prediction algorithms in the MavHome smart home architecture , 2002, IEEE Wirel. Commun..

[40]  Ivan Bratko,et al.  Attribute Interactions in Medical Data Analysis , 2003, AIME.

[41]  P. Grünwald The Minimum Description Length Principle (Adaptive Computation and Machine Learning) , 2007 .

[42]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 2000, Springer Berlin Heidelberg.

[43]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[44]  Victor R. Lesser,et al.  The UMASS intelligent home project , 1999, AGENTS '99.

[45]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[46]  Oliver Brdiczka,et al.  Supervised learning of an abstract context model for an intelligent environment , 2005, sOc-EUSAI '05.

[47]  Donghai Guan,et al.  Activity Recognition Based on Semi-supervised Learning , 2007, 13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA 2007).

[48]  Mitja Lustrek,et al.  Fall Detection and Activity Recognition with Machine Learning , 2009, Informatica.

[49]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[50]  Antonio F. Gómez-Skarmeta,et al.  Information and Hybrid Architecture Model of the OCP Contextual Information Management System , 2006, J. Univers. Comput. Sci..

[51]  Alex Alves Freitas,et al.  Attribute Selection with a Multi-objective Genetic Algorithm , 2002, SBIA.

[52]  Anind K. Dey,et al.  a CAPpella: programming by demonstration of context-aware applications , 2004, CHI.

[53]  Larry A. Rendell,et al.  Constructive Induction On Decision Trees , 1989, IJCAI.

[54]  Ashwin Srinivasan,et al.  Feature construction with Inductive Logic Programming: A Study of Quantitative Predictions of Biological Activity Aided by Structural Attributes , 1999, Data Mining and Knowledge Discovery.

[55]  Juan Carlos Augusto,et al.  The Use of Temporal Reasoning and Management of Complex Events in Smart Homes , 2004, ECAI.

[56]  Pablo A. Haya,et al.  A Prototype of a Context-Based Architecture for Intelligent Home Environments , 2004, CoopIS/DOA/ODBASE.

[57]  Jake K. Aggarwal,et al.  Human motion analysis: a review , 1997, Proceedings IEEE Nonrigid and Articulated Motion Workshop.

[58]  Alex Alves Freitas,et al.  Understanding the Crucial Role of Attribute Interaction in Data Mining , 2001, Artificial Intelligence Review.

[59]  Pablo A. Haya,et al.  Easing the Smart Home: A rule-based language and multi-agent structure for end user development in Intelligent Environments , 2010, J. Ambient Intell. Smart Environ..

[60]  Vasant Dhar,et al.  Discovering Interesting Patterns for Investment Decision Making with GLOWER ☹—A Genetic Learner Overlaid with Entropy Reduction , 2000, Data Mining and Knowledge Discovery.

[61]  L. S. Shafti Multi-feature construction based on genetic algorithms and non-algebraic feature representation to facilitate learning concepts with complex interactions , 2008 .

[62]  Pablo A. Haya,et al.  Personal Ambient Intelligent Reminder for People with Cognitive Disabilities , 2012, IWAAL.

[63]  Lawrence B. Holder,et al.  Managing Adaptive Versatile Environments , 2005, Third IEEE International Conference on Pervasive Computing and Communications.

[64]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[65]  Ryszard S. Michalski,et al.  Data-Driven Constructive Induction: A Methodology and its Applications , 1998 .

[66]  Pablo A. Haya,et al.  Easing the Smart Home: Semi-automatic Adaptation in Perceptive Environments , 2008, J. Univers. Comput. Sci..

[67]  Diane J. Cook,et al.  Keeping the Resident in the Loop: Adapting the Smart Home to the User , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[68]  Niall Rooney,et al.  Temporal Data Mining for Smart Homes , 2006, Designing Smart Homes.

[69]  Gwenn Englebienne,et al.  UvA-DARE ( Digital Academic Repository ) Activity recognition using semi-Markov models on real world smart home datasets , 2010 .

[70]  Huan Liu,et al.  Searching for interacting features in subset selection , 2009, Intell. Data Anal..

[71]  Minkoo Kim,et al.  An intelligent agent for ubiquitous computing environments: smart home UT-AGENT , 2004 .

[72]  Emmanuel,et al.  Activity recognition in the home setting using simple and ubiquitous sensors , 2003 .

[73]  Jennifer Healey,et al.  A Long-Term Evaluation of Sensing Modalities for Activity Recognition , 2007, UbiComp.

[74]  Juan Carlos Augusto,et al.  Learning about preferences and common behaviours of the user in an intelligent environment , 2009, BMI Book.

[75]  Tao Gu,et al.  Ontology based context modeling and reasoning using OWL , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[76]  Juan Carlos Augusto,et al.  Learning patterns in ambient intelligence environments: a survey , 2010, Artificial Intelligence Review.

[77]  Luis Ángel San Martín,et al.  Environmental user-preference learning for smart homes: An autonomous approach , 2010, J. Ambient Intell. Smart Environ..

[78]  Ivan Bratko,et al.  Function Decomposition in Machine Learning , 2001, Machine Learning and Its Applications.

[79]  Michael C. Mozer,et al.  The Neural Network House: An Environment that Adapts to its Inhabitants , 1998 .

[80]  Foster J. Provost,et al.  Small Disjuncts in Action: Learning to Diagnose Errors in the Local Loop of the Telephone Network , 1993, ICML.

[81]  Grigoris Antoniou,et al.  Rule-Based Contextual Reasoning in Ambient Intelligence , 2010, RuleML.

[82]  Huan Liu,et al.  Discretization: An Enabling Technique , 2002, Data Mining and Knowledge Discovery.

[83]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.