A Model of Parallel Mosaicking for Massive Remote Sensing Images Based on Spark

Image mosaicking is an important part of remote sensing image processing and plays a vital role in the analysis of trans-regional remote sensing images. In order to solve the problems of low utilization of nodes and frequent data I/O in traditional parallel mosaicking algorithms, we propose a parallel mosaicking algorithm based on Apache Spark. First, multi-nodes parallel computation for image overlapping region estimation are implemented in the algorithm. Then, we self-define the Resilient Distributed Data sets (RDD) for remote sensing image processing, and use the three key steps of the image mosaicking, including overlapping region estimation, image registration, and image fusion, which are as the transformation-type operators of the self-defined RDD (the self-defined RDD is what we get by extending the functionality of RDD in Spark). Finally, the parallel processing of image mosaicking is realized by calling the operators of self-defined RDD with the method of implicit conversion. Experimental results show that the parallel mosaicking algorithm of massive remote sensing image based on Spark can effectively improve the mass data image mosaicking efficiency on the basis of guaranteeing the image mosaicking effect.

[1]  Pierre Soille,et al.  Automated morphological image composition for mosaicing large image data sets , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Yujie Zhang,et al.  Spark: A Big Data Processing Platform Based on Memory Computing , 2015, 2015 Seventh International Symposium on Parallel Architectures, Algorithms and Programming (PAAP).

[3]  Scott Shenker,et al.  Shark: SQL and rich analytics at scale , 2012, SIGMOD '13.

[4]  Scott Shenker,et al.  Discretized Streams: An Efficient and Fault-Tolerant Model for Stream Processing on Large Clusters , 2012, HotCloud.

[5]  Sun Ming-wei Parallel processing of mass aerial digital images based on cluster computer——The application of parallel computing in aerial digital photogrammetry , 2008 .

[6]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[7]  Michael S. Ramsey,et al.  Radiometric normalization and image mosaic generation of ASTER thermal infrared data: An application to extensive sand sheets and dune fields , 2008 .

[8]  Wenyi Zhao,et al.  Flexible Image Blending for Image Mosaicing with Reduced Artifacts , 2006, Int. J. Pattern Recognit. Artif. Intell..

[9]  An Xinghua Fine-grained parallel algorithm for remote sensing image mosaics for cluster system , 2002 .

[10]  Albert Y. Zomaya,et al.  Task-Tree Based Large-Scale Mosaicking for Massive Remote Sensed Imageries with Dynamic DAG Scheduling , 2014, IEEE Transactions on Parallel and Distributed Systems.

[11]  Wang Yan-ying Optimization of Image Mosaic Algorithm Based on Parallel I/O and Dynamic Grouping , 2012 .

[12]  Gu Hai-yan A Fast and Automatic Parallel Algorithm of Remote Sensing Image Mosaic , 2011 .

[13]  Michael J. Franklin,et al.  Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing , 2012, NSDI.

[14]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Scott Shenker,et al.  Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[16]  Liu Zhen,et al.  Study on image automatic registration based on layered multi-template matching , 2005 .

[17]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[18]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[19]  Zhu Shu The Seam-line Removal under Mosaicking of Remotely Sensed Images , 2002 .

[20]  Michael A. Wulder,et al.  Remote sensing methods in medium spatial resolution satellite data land cover classification of large areas , 2002 .

[21]  Sergio Ramírez-Gallego,et al.  Distributed Entropy Minimization Discretizer for Big Data Analysis under Apache Spark , 2015, 2015 IEEE Trustcom/BigDataSE/ISPA.

[22]  Scott Shenker,et al.  Shark: fast data analysis using coarse-grained distributed memory , 2012, SIGMOD Conference.

[23]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  Y. Afek,et al.  Mosaicking of orthorectified aerial images , 1998 .