High performance cluster system design for remote sensing data processing

During recent years, cluster systems have played a more important role in the architecture design of high-performance computing area which is cost-effective and efficient parallel computing system able to satisfy specific computational requirements in the earth and space sciences communities. This paper presents a powerful cluster system built by Satellite Environment Center, Ministry of Environment Protection of China that is designed to process massive remote sensing data of HJ-1 satellites automatically everyday. The architecture of this cluster system including hardware device layer, network layer, OS/FS layer, middleware layer and application layer have been given. To verify the performance of our cluster system, image registration has been chose to experiment with one scene of HJ-1 CCD sensor. The experiments of imagery registration shows that it is an effective system to improve the efficiency of data processing, which could provide a response rapidly in applications that certainly demand, such as wild land fire monitoring and tracking, oil spill monitoring, military target detection, etc. Further work would focus on the comprehensive parallel design and implementations of remote sensing data processing.

[1]  Torsten Hoefler,et al.  Scalable High Performance Message Passing over InfiniBand for Open MPI , 2007 .

[2]  Chao-Tung Yang,et al.  USING A BEOWULF CLUSTER FOR A REMOTE SENSING APPLICATION , 2001 .

[3]  Sayantan Sur,et al.  High performance MPI design using unreliable datagram for ultra-scale InfiniBand clusters , 2007, ICS '07.

[4]  M. S. Moran,et al.  Remote Sensing for Crop Management , 2003 .

[5]  Chein-I Chang,et al.  High Performance Computing in Remote Sensing , 2007, HiPC 2007.

[6]  Guoqing Li,et al.  Key Technologies Research on Building a Cluster-Based Parallel Computing System for Remote Sensing , 2005, International Conference on Computational Science.

[7]  P. Anandan,et al.  Mosaic based representations of video sequences and their applications , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  Alex Rapaport,et al.  Mpi-2: extensions to the message-passing interface , 1997 .

[9]  P. Anandan,et al.  Video compression using mosaic representations , 1995, Signal Process. Image Commun..

[10]  Stanley R. Herwitz,et al.  Collection of Ultra High Spatial and Spectral Resolution Image Data over California Vineyards with a Small UAV , 2003 .

[11]  Tarek A. El-Ghazawi,et al.  Prototyping automatic cloud cover assessment (ACCA) algorithm for remote sensing on-board processing on a reconfigurable computer , 2005, Proceedings. 2005 IEEE International Conference on Field-Programmable Technology, 2005..

[12]  Kristin J. Dana,et al.  Real-time scene stabilization and mosaic construction , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.