Discovering Underlying Plans Based on Shallow Models

Plan recognition aims to discover target plans (i.e., sequences of actions) behind observed actions, with history plan libraries or action models in hand. Previous approaches either discover plans by maximally “matching” observed actions to plan libraries, assuming target plans are from plan libraries, or infer plans by executing action models to best explain the observed actions, assuming that complete action models are available. In real-world applications, however, target plans are often not from plan libraries, and complete action models are often not available, since building complete sets of plans and complete action models are often difficult or expensive. In this article, we view plan libraries as corpora and learn vector representations of actions using the corpora; we then discover target plans based on the vector representations. Specifically, we propose two approaches, DUP and RNNPlanner, to discover target plans based on vector representations of actions. DUP explores the EM-style (Expectation Maximization) framework to capture local contexts of actions and discover target plans by optimizing the probability of target plans, while RNNPlanner aims to leverage long-short term contexts of actions based on RNNs (Recurrent Neural Networks) framework to help recognize target plans. In the experiments, we empirically show that our approaches are capable of discovering underlying plans that are not from plan libraries without requiring action models provided. We demonstrate the effectiveness of our approaches by comparing its performance to traditional plan recognition approaches in three planning domains. We also compare DUP and RNNPlanner to see their advantages and disadvantages.

[1]  Felipe Meneguzzi,et al.  Landmark-Enhanced Heuristics for Goal Recognition in Incomplete Domain Models , 2019, ICAPS.

[2]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002 .

[3]  Jun Zhang,et al.  Simlarity Search for Web Services , 2004, VLDB.

[4]  Qiang Yang,et al.  Action-model acquisition for planning via transfer learning , 2014, Artif. Intell..

[5]  Hung Hai Bui,et al.  A General Model for Online Probabilistic Plan Recognition , 2003, IJCAI.

[6]  Subbarao Kambhampati,et al.  Model-Lite Case-Based Planning , 2012, AAAI.

[7]  Shlomo Zilberstein,et al.  Plan and Activity Recognition from a Topic Modeling Perspective , 2014, ICAPS.

[8]  Charles J. Petrie,et al.  Constrained Decision Revision , 1992, AAAI.

[9]  Qiang Yang,et al.  User-Dependent Aspect Model for Collaborative Activity Recognition , 2011, IJCAI.

[10]  Brian Charles Williams,et al.  Watching and Acting Together: Concurrent Plan Recognition and Adaptation for Human-Robot Teams , 2018, J. Artif. Intell. Res..

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Mongi A. Abidi,et al.  Survey and analysis of multimodal sensor planning and integration for wide area surveillance , 2009, CSUR.

[13]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[14]  Peter Stone,et al.  Autonomous agents modelling other agents: A comprehensive survey and open problems , 2017, Artif. Intell..

[15]  Qiang Yang,et al.  Adaptive Localization in a Dynamic WiFi Environment through Multi-view Learning , 2007, AAAI.

[16]  Henry A. Kautz,et al.  Interactive activity recognition and prompting to assist people with cognitive disabilities , 2012, J. Ambient Intell. Smart Environ..

[17]  VenkateshSvetha,et al.  Policy recognition in the abstract hidden Markov model , 2002 .

[18]  Ya'akov Gal,et al.  Plan Recognition in Virtual Laboratories , 2011, IJCAI.

[19]  Qiang Yang,et al.  Activity Recognition through Goal-Based Segmentation , 2005, AAAI.

[20]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[21]  Alex S. Fukunaga,et al.  Classical Planning in Deep Latent Space: Bridging the Subsymbolic-Symbolic Boundary , 2017, AAAI.

[22]  Felipe Meneguzzi,et al.  Landmark-Based Heuristics for Goal Recognition , 2017, AAAI.

[23]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[24]  Mark Steedman,et al.  On Natural Language Processing and Plan Recognition , 2007, IJCAI.

[25]  Subbarao Kambhampati,et al.  Synthesizing Robust Plans under Incomplete Domain Models , 2011, NIPS.

[26]  Robert P. Goldman,et al.  A probabilistic plan recognition algorithm based on plan tree grammars , 2009, Artif. Intell..

[27]  Hector Geffner,et al.  Plan Recognition as Planning , 2009, IJCAI.

[28]  Lina Yao,et al.  Multi-agent Attentional Activity Recognition , 2019, IJCAI.

[29]  Cornelia Caragea,et al.  Bi-LSTM-CRF Sequence Labeling for Keyphrase Extraction from Scholarly Documents , 2019, WWW.

[30]  Qiang Yang,et al.  Learning complex action models with quantifiers and logical implications , 2010, Artif. Intell..

[31]  Qiang Yang,et al.  Learning action models from plan examples using weighted MAX-SAT , 2007, Artif. Intell..

[32]  Subbarao Kambhampati,et al.  Model-lite Planning for the Web Age Masses: The Challenges of Planning with Incomplete and Evolving Domain Models , 2007, AAAI.

[33]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[34]  Martha E. Pollack,et al.  Autominder: an intelligent cognitive orthotic system for people with memory impairment , 2003, Robotics Auton. Syst..

[35]  Susanne Biundo-Stephan,et al.  Plan and Goal Recognition as HTN Planning , 2018, 2018 IEEE 30th International Conference on Tools with Artificial Intelligence (ICTAI).

[36]  Felipe Meneguzzi,et al.  LSTM-Based Goal Recognition in Latent Space , 2018, ArXiv.

[37]  Subbarao Kambhampati,et al.  Model-lite planning: Case-based vs. model-based approaches , 2017, Artif. Intell..

[38]  Hankui Zhuo Human-Aware Plan Recognition , 2017, AAAI.

[39]  Chen Chen,et al.  Memory Attention Networks for Skeleton-Based Action Recognition , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Yoshua Bengio,et al.  Hierarchical Probabilistic Neural Network Language Model , 2005, AISTATS.

[41]  Hector Geffner,et al.  Probabilistic Plan Recognition Using Off-the-Shelf Classical Planners , 2010, AAAI.

[42]  Matthew Richardson,et al.  Towards Decision Support and Goal Achievement: Identifying Action-Outcome Relationships From Social Media , 2015, KDD.

[43]  Subbarao Kambhampati,et al.  AI-MIX: Using Automated Planning to Steer Human Workers Towards Better Crowdsourced Plans , 2014, HCOMP.

[44]  Raymond J. Mooney,et al.  Abductive Markov Logic for Plan Recognition , 2011, Proceedings of the AAAI Conference on Artificial Intelligence.

[45]  Hankz Hankui Zhuo,et al.  Recognizing Multi-Agent Plans When Action Models and Team Plans Are Both Incomplete , 2019, ACM Trans. Intell. Syst. Technol..

[46]  Froduald Kabanza,et al.  Controlling the Hypothesis Space in Probabilistic Plan Recognition , 2013, IJCAI.

[47]  Subbarao Kambhampati,et al.  Action-Model Based Multi-agent Plan Recognition , 2012, NIPS.

[48]  Dana S. Nau,et al.  On the Complexity of Blocks-World Planning , 1992, Artif. Intell..

[49]  Qiang Yang,et al.  Online Co-Localization in Indoor Wireless Networks by Dimension Reduction , 2007, AAAI.

[50]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[51]  Martha E. Pollack,et al.  An 'Object-Use Fingerprint': The Use of Electronic Sensors for Human Identification , 2007, UbiComp.

[52]  Subbarao Kambhampati,et al.  Discovering Underlying Plans Based on Distributed Representations of Actions , 2016, AAMAS.

[53]  Philip R. Cohen,et al.  Sketch-Thru-Plan , 2015, Commun. ACM.

[54]  Jörg Hoffmann,et al.  Ordered Landmarks in Planning , 2004, J. Artif. Intell. Res..

[55]  Regina Barzilay,et al.  Learning High-Level Planning from Text , 2012, ACL.

[56]  Qiang Yang,et al.  Adaptive Temporal Radio Maps for Indoor Location Estimation , 2005, Third IEEE International Conference on Pervasive Computing and Communications.

[57]  Yu Zhang,et al.  Capability Models and Their Applications in Planning , 2015, AAMAS.

[58]  Ya'akov Gal,et al.  SLIM: Semi-Lazy Inference Mechanism for Plan Recognition , 2016, IJCAI.

[59]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[60]  Hector Muñoz-Avila,et al.  Learning hierarchical task network domains from partially observed plan traces , 2014, Artif. Intell..

[61]  Gal A. Kaminka,et al.  Keyhole Adversarial Plan Recognition for Recognition of Suspicious and Anomalous Behavior , 2014 .

[62]  David E. Smith,et al.  A Fast Goal Recognition Technique Based on Interaction Estimates , 2015, IJCAI.

[63]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[64]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[65]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[66]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[67]  S. Shankar Sastry,et al.  Autonomous Helicopter Flight via Reinforcement Learning , 2003, NIPS.

[68]  Weng-Keen Wong,et al.  Physical Activity Recognition from Accelerometer Data Using a Multi-Scale Ensemble Method , 2013, IAAI.

[69]  Suchi Saria,et al.  Probabilistic Plan Recognition in Multiagent Systems , 2004, ICAPS.

[70]  Oren Etzioni,et al.  A Sound and Fast Goal Recognizer , 1995, IJCAI.

[71]  Shirin Sohrabi,et al.  Plan Recognition as Planning Revisited , 2016, IJCAI.

[72]  Shirin Sohrabi,et al.  IBM Scenario Planning Advisor: Plan Recognition as AI Planning in Practice , 2018, IJCAI.

[73]  Lei Li,et al.  Multi-Agent Plan Recognition with Partial Team Traces and Plan Libraries , 2011, IJCAI.

[74]  Yu Zhang,et al.  Plan explicability and predictability for robot task planning , 2015, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[75]  Jean Massardi,et al.  Error-Tolerant Anytime Approach to Plan Recognition Using a Particle Filter , 2019, ICAPS.

[76]  Chunyan Miao,et al.  Distribution-Based Semi-Supervised Learning for Activity Recognition , 2019, AAAI.

[77]  Subramanian Ramamoorthy,et al.  Are You Doing What I Think You Are Doing? Criticising Uncertain Agent Models , 2015, UAI.

[78]  Felipe Meneguzzi,et al.  Goal Recognition in Latent Space , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).