Spark-Based Iterative Spatial Overlay Analysis Method

For the spatial overlay analysis of vector data on the condition of mass data and confined memory, the paper proposes spark-based iterative spatial overlay analysis algorithm. The algorithm builds multi-level grid index structure combining the first-level grid with quartering ,designs memory space data structure and implements spatial overlay analysis of mass vector data based on Spark distributed computation platform. The experimental result indicates that the algorithm, compared with spatial overlay analysis algorithm in ArcGIS and spatial database PostGIS and Spark-based quad tree index algorithm, enhances the efficiency of spatial overlay analysis obviously. Therefore, it is more suitable for spatial overlay analysis of vector data on the condition of mass data and confined memory. Keywords-Spark; overlay analysis; vector data; multi-level grid index

[1]  Guihai Chen,et al.  Towards Parallel Spatial Query Processing for Big Spatial Data , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum.

[2]  Zhou Chenghu Accelerating polygon overlay analysis by GPU , 2013 .