A Distance-Window Based Real-Time Processing of Spatial Data Streams

Real-time and continuous processing of citywide spatial data is an essential requirement of smart cities to guarantee the delivery of basic life necessities to its residents and to maintain law and order in it. With the availability of low cost 3D scanners recently, citywide 3D spatial data can be obtained easily. 3D spatial data contains a wealth of information including images, point-cloud, GPS/IMU measurements, etc., and can be of potential use if integrated, processed and analyzed in real-time. The 3D spatial data is generated as continuous data stream, however traditionally it is processed offline. Many smart city applications require real-time integration, processing, and analysis of spatial stream, for-instance, forest fire management, real-time road traffic analysis, disaster engulfed areas monitoring, people flow analysis, etc., however they suffer from slow offline processing of traditional systems. To make the most of this wealthy data resource, it must be processed and analyzed in real-time. This paper presents a framework for the continuous and real-time processing and analysis of 3D spatial streams. Furthermore, we propose a distance-based window for the continuous queries over 3D spatial streams. An experimental evaluation is also presented to prove the effectiveness of the proposed framework and the distance-based window.

[1]  Marina Papatriantafilou,et al.  Lisco: A Continuous Approach in LiDAR Point-cloud Clustering , 2017, ArXiv.

[2]  Peter van Oosterom,et al.  Massive point cloud data management: Design, implementation and execution of a point cloud benchmark , 2015, Comput. Graph..

[3]  Dieter Pfoser,et al.  Novel Approaches in Query Processing for Moving Object Trajectories , 2000, VLDB 2000.

[4]  Steven Lake Waslander,et al.  Joint 3D Proposal Generation and Object Detection from View Aggregation , 2017, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Wei-Ying Ma,et al.  Geolife GPS trajectory dataset - User Guide , 2011 .

[6]  Martin Buss,et al.  Realtime segmentation of range data using continuous nearest neighbors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Beng Chin Ooi,et al.  Distributed data management using MapReduce , 2014, CSUR.

[8]  Jennifer Widom,et al.  STREAM: The Stanford Data Stream Management System , 2016, Data Stream Management.

[9]  Kyle Fox,et al.  Massively parallel algorithms for computing TIN DEMs and contour trees for large terrains , 2016, SIGSPATIAL/GIS.

[10]  Achintya K. Bhowmik,et al.  35‐3: Invited Paper: Industrial Deployment of a Full‐featured Head‐mounted Augmented‐reality System and the Incorporation of a 3D‐sensing Platform , 2016 .

[11]  Jennifer Widom,et al.  Memory-Limited Execution of Windowed Stream Joins , 2004, VLDB.

[12]  Zhenlong Li,et al.  A general-purpose framework for parallel processing of large-scale LiDAR data , 2016, Int. J. Digit. Earth.

[13]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[14]  Lukasz Golab,et al.  Sliding Window Query Processing over Data Streams , 2006 .

[15]  Philip S. Yu,et al.  GrubJoin: An Adaptive, Multi-Way, Windowed Stream Join with Time Correlation-Aware CPU Load Shedding , 2007, IEEE Transactions on Knowledge and Data Engineering.

[16]  Jeffrey F. Naughton,et al.  Evaluating window joins over unbounded streams , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[17]  Ki-Joune Li,et al.  Continuous Perspective Query Processing for 3-D Objects on Road Networks , 2007, W2GIS.