Navigate like a cabbie: probabilistic reasoning from observed context-aware behavior

We present PROCAB, an efficient method for Probabilistically Reasoning from Observed Context-Aware Behavior. It models the context-dependent utilities and underlying reasons that people take different actions. The model generalizes to unseen situations and scales to incorporate rich contextual information. We train our model using the route preferences of 25 taxi drivers demonstrated in over 100,000 miles of collected data, and demonstrate the performance of our model by inferring: (1) decision at next intersection, (2) route to known destination, and (3) destination given partially traveled route.

[1]  E. Jaynes.  Information Theory and Statistical Mechanics , 1957 .

[2]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[3]  Aaron Steinfeld,et al.  DESTINATION ENTRY AND RETRIEVAL WITH THE ALI-SCOUT NAVIGATION SYSTEM , 1996 .

[4]  Michael C. Mozer,et al.  The Neural Network House: An Environment that Adapts to its Inhabitants , 1998 .

[5]  D. Hennessy,et al.  Traffic congestion, driver stress, and driver aggression , 1999 .

[6]  Andrew Y. Ng,et al.  Pharmacokinetics of a novel formulation of ivermectin after administration to goats , 2000, ICML.

[7]  Andreas Butz,et al.  Location-Aware Shopping Assistance: Evaluation of a Decision-Theoretic Approach , 2002, Mobile HCI.

[8]  Sajal K. Das,et al.  LeZi-Update: An Information-Theoretic Framework for Personal Mobility Tracking in PCS Networks , 2002, Wirel. Networks.

[9]  Thad Starner,et al.  Using GPS to learn significant locations and predict movement across multiple users , 2003, Personal and Ubiquitous Computing.

[10]  Henry A. Kautz,et al.  Inferring High-Level Behavior from Low-Level Sensors , 2003, UbiComp.

[11]  Rene Mayrhofer,et al.  An architecture for context prediction , 2004 .

[12]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[13]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[14]  Matthai Philipose,et al.  Unsupervised Activity Recognition Using Automatically Mined Common Sense , 2005, AAAI.

[15]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors , 2005, TCHI.

[16]  Bo Egardt,et al.  Assessing the Potential of Predictive Control for Hybrid Vehicle Powertrains Using Stochastic Dynamic Programming , 2005, IEEE Transactions on Intelligent Transportation Systems.

[17]  Brett Browning,et al.  Learning to Predict Driver Route and Destination Intent , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[18]  Eric Horvitz,et al.  Trip Router with Individualized Preferences (TRIP): Incorporating Personalization into Route Planning , 2006, AAAI.

[19]  Eric Horvitz,et al.  Predestination: Inferring Destinations from Partial Trajectories , 2006, UbiComp.

[20]  James A. Landay,et al.  Personalizing routes , 2006, UIST.

[21]  Yang Zhang,et al.  CarTel: a distributed mobile sensor computing system , 2006, SenSys '06.

[22]  Andreas Krause,et al.  Robust, low-cost, non-intrusive sensing and recognition of seated postures , 2007, UIST.

[23]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[24]  Mike Y. Chen,et al.  Tracking Free-Weight Exercises , 2007, UbiComp.

[25]  Harry Zhang,et al.  Traffic Advisories Based on Route Prediction , 2007 .

[26]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.