Time-delayed Collective Flow Diffusion Models for Inferring Latent People Flow from Aggregated Data at Limited Locations

Abstract The rapid adoption of wireless sensor devices has made it easier to record location information of people in a variety of spaces (e.g., exhibition halls). Location information is often aggregated due to privacy and/or cost concerns. The aggregated data we use as input consist of the numbers of incoming and outgoing people at each location and at each time step. Since the aggregated data lack tracking information of individuals, determining the flow of people between locations is not straightforward. In this article, we address the problem of inferring latent people flows, that is, transition populations between locations, from just aggregated population data gathered from observed locations. Existing models assume that everyone is always in one of the observed locations at every time step; this, however, is an unrealistic assumption, because we do not always have a large enough number of sensor devices to cover the large-scale spaces targeted. To overcome this drawback, we propose a probabilistic model with flow conservation constraints that incorporate travel duration distributions between observed locations. To handle noisy settings, we adopt noisy observation models for the numbers of incoming and outgoing people, where the noise is regarded as a factor that may disturb flow conservation, e.g., people may appear in or disappear from the predefined space of interest. We develop an approximate expectation-maximization (EM) algorithm that simultaneously estimates transition populations and model parameters. Our experiments demonstrate the effectiveness of the proposed model on real-world datasets of pedestrian data in exhibition halls, bike trip data and taxi trip data in New York City.

[1]  Brian L. Sullivan,et al.  eBird: A citizen-based bird observation network in the biological sciences , 2009 .

[2]  Jure Leskovec,et al.  The dynamics of viral marketing , 2005, EC '06.

[3]  Thomas G. Dietterich,et al.  Approximate Inference in Collective Graphical Models , 2013, ICML.

[4]  Tomoharu Iwata,et al.  Travel route recommendation using geotags in photo sharing sites , 2010, CIKM.

[5]  Tomoharu Iwata,et al.  Inferring Latent Triggers of Purchases with Consideration of Social Effects and Media Advertisements , 2016, WSDM '16.

[6]  Jieping Ye,et al.  Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction , 2018, AAAI.

[7]  Tomoharu Iwata,et al.  Discovering latent influence in online social activities via shared cascade poisson processes , 2013, KDD.

[8]  Tao Sun,et al.  Message Passing for Collective Graphical Models , 2015, ICML.

[9]  Naonori Ueda,et al.  Estimating People Flow from Spatiotemporal Population Data via Collective Graphical Mixture Models , 2017, ACM Trans. Spatial Algorithms Syst..

[10]  Hiroyuki Toda,et al.  A Fast and Accurate Method for Estimating People Flow from Spatiotemporal Population Data , 2018, IJCAI.

[11]  Bernhard Schölkopf,et al.  Uncovering the Temporal Dynamics of Diffusion Networks , 2011, ICML.

[12]  Anna Monreale,et al.  WhereNext: a location predictor on trajectory pattern mining , 2009, KDD.

[13]  Tomoharu Iwata,et al.  Neural Collective Graphical Models for Estimating Spatio-Temporal Population Flow from Aggregated Data , 2019, AAAI.

[14]  Pradeep Varakantham,et al.  On understanding diffusion dynamics of patrons at a theme park , 2014, AAMAS.

[15]  Biplav Srivastava,et al.  Collective Diffusion Over Networks: Models and Inference , 2013, UAI.

[16]  Éva Tardos,et al.  Maximizing the Spread of Influence through a Social Network , 2015, Theory Comput..

[17]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[18]  Tomoharu Iwata,et al.  Probabilistic latent network visualization: inferring and embedding diffusion networks , 2014, KDD.

[19]  Georg Gartner,et al.  A Survey of Mobile Indoor Navigation Systems , 2009 .

[20]  Xiaoming Fu,et al.  Trajectory Recovery From Ash: User Privacy Is NOT Preserved in Aggregated Mobility Data , 2017, WWW.

[21]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[22]  Yusuke Tanaka,et al.  Exact and Efficient Inference for Collective Flow Diffusion Model via Minimum Convex Cost Flow Algorithm , 2020, AAAI.

[23]  Ambuj K. Singh,et al.  FCCF: forecasting citywide crowd flows based on big data , 2016, SIGSPATIAL/GIS.

[24]  Chi-Yin Chow,et al.  Trajectory privacy in location-based services and data publication , 2011, SKDD.

[25]  Dino Pedreschi,et al.  Trajectory pattern mining , 2007, KDD '07.

[26]  Naonori Ueda,et al.  Estimating Latent People Flow without Tracking Individuals , 2018, IJCAI.

[27]  Dexter Kozen,et al.  Collective Inference on Markov Models for Modeling Bird Migration , 2007, NIPS.

[28]  Rogério Schmidt Feris,et al.  Video analytics for retail , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[29]  Junbo Zhang,et al.  Flow Prediction in Spatio-Temporal Networks Based on Multitask Deep Learning , 2020, IEEE Transactions on Knowledge and Data Engineering.

[30]  Stephen J. Wright Coordinate descent algorithms , 2015, Mathematical Programming.

[31]  Upkar Varshney,et al.  Challenges and business models for mobile location-based services and advertising , 2011, Commun. ACM.

[32]  Thomas G. Dietterich,et al.  Collective Graphical Models , 2011, NIPS.

[33]  Thomas G. Dietterich,et al.  Gaussian Approximation of Collective Graphical Models , 2014, ICML.

[34]  Xianfeng Tang,et al.  Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction , 2018, AAAI.

[35]  Xing Xie,et al.  A Flexible Spatio-Temporal Indexing Scheme for Large-Scale GPS Track Retrieval , 2008, The Ninth International Conference on Mobile Data Management (mdm 2008).

[36]  Xing Xie,et al.  Discovering regions of different functions in a city using human mobility and POIs , 2012, KDD.

[37]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Xuan Song,et al.  Prediction of human emergency behavior and their mobility following large-scale disaster , 2014, KDD.