Impact of platform heterogeneity on the design of parallel algorithms for morphological processing of high-dimensional image data

Abstract The main objective of this paper is to describe a realistic framework to understand parallel performance of high-dimensional image processing algorithms in the context of heterogeneous networks of workstations (NOWs). As a case study, this paper explores techniques for mapping hyperspectral image analysis techniques onto fully heterogeneous NOWs. Hyperspectral imaging is a new technique in remote sensing that has gained tremendous popularity in many research areas, including satellite imaging and aerial reconnaissance. The automation of techniques able to transform massive amounts of hyperspectral data into scientific understanding in valid response times is critical for space-based Earth science and planetary exploration. Using an evaluation strategy which is based on comparing the efficiency achieved by an heterogeneous algorithm on a fully heterogeneous NOW with that evidenced by its homogeneous version on a homogeneous NOW with the same aggregate performance as the heterogeneous one, we develop a detailed analysis of parallel algorithms that integrate the spatial and spectral information in the image data through mathematical morphology concepts. For comparative purposes, performance data for the tested algorithms on Thunderhead (a large-scale Beowulf cluster at NASA’s Goddard Space Flight Center) are also provided. Our detailed investigation of the parallel properties of the proposed morphological algorithms provides several intriguing findings that may help image analysts in selection of parallel techniques and strategies for specific applications.

[1]  Martin Cuma,et al.  A general framework to understand parallel performance in heterogeneous clusters: analysis of a new adaptive parallel genetic algorithm , 2005, J. Parallel Distributed Comput..

[2]  Francisco Tirado,et al.  Data Locality Exploitation in the Decomposition of Regular Domain Problems , 2000, IEEE Trans. Parallel Distributed Syst..

[3]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[4]  Yves Robert,et al.  Matrix Multiplication on Heterogeneous Platforms , 2001, IEEE Trans. Parallel Distributed Syst..

[5]  David S. Greenberg,et al.  Massively parallel computing using commodity components , 2000, Parallel Comput..

[6]  Dharma P. Agrawal,et al.  Optimal Scheduling Algorithm for Distributed-Memory Machines , 1998, IEEE Trans. Parallel Distributed Syst..

[7]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[8]  Anoop Gupta,et al.  Parallel computer architecture - a hardware / software approach , 1998 .

[9]  Dennis Koelma,et al.  P-3PC: A Point-to-Point Communication Model for Automatic and Optimal Decomposition of Regular Domain Problems , 2002, IEEE Trans. Parallel Distributed Syst..

[10]  Antonio J. Plaza,et al.  Spatial/spectral endmember extraction by multidimensional morphological operations , 2002, IEEE Trans. Geosci. Remote. Sens..

[11]  Kenneth A. Hawick,et al.  Distributed frameworks and parallel algorithms for processing large-scale geographic data , 2003, Parallel Comput..

[12]  Antonio J. Plaza,et al.  Commodity cluster-based parallel processing of hyperspectral imagery , 2006, J. Parallel Distributed Comput..

[13]  Bharadwaj Veeravalli,et al.  Theoretical and experimental study on large size image processing applications using divisible load paradigm on distributed bus networks , 2002, Image Vis. Comput..

[14]  Alexey L. Lastovetsky,et al.  On performance analysis of heterogeneous parallel algorithms , 2004, Parallel Comput..

[15]  Alexey Lastovetsky Parallel Computing on Heterogeneous Networks: Lastrovetsky/Parallel Computing Networks , 2003 .

[16]  Dennis Koelma,et al.  A software architecture for user transparent parallel image processing , 2002, Parallel Comput..

[17]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[18]  Larry Carter,et al.  Scheduling strategies for master-slave tasking on heterogeneous processor platforms , 2004, IEEE Transactions on Parallel and Distributed Systems.

[19]  Alexey Lastovetsky Parallel computing on heterogeneous networks , 2003 .

[20]  Chao Lin,et al.  Heuristic Contention-Free Broadcast in Heterogeneous Networks of Workstations with Multiple Send and Receive Speeds , 2003, The Journal of Supercomputing.

[21]  Chein-I Chang,et al.  High Performance Computing in Remote Sensing , 2007, HiPC 2007.

[22]  Henri Casanova,et al.  Stochastic Performance Prediction for Iterative Algorithms in Distributed Environments , 1999, J. Parallel Distributed Comput..

[23]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[24]  Massimo Cafaro,et al.  A dynamic earth observation system , 2003, Parallel Comput..

[25]  Hélène Renard,et al.  Static Load-Balancing Techniques for Iterative Computation on Heterogeneous Clusters , 2003, Euro-Par.

[26]  Antonio J. Plaza,et al.  Parallel implementation of endmember extraction algorithms from hyperspectral data , 2006, IEEE Geoscience and Remote Sensing Letters.

[27]  Antonio J. Plaza,et al.  A new approach to mixed pixel classification of hyperspectral imagery based on extended morphological profiles , 2004, Pattern Recognit..