DiFX: A Software Correlator for Very Long Baseline Interferometry Using Multiprocessor Computing Environments

We describe the development of an FX-style correlator for very long baseline interferometry (VLBI), implemented in software and intended to run in multiprocessor computing environments, such as large clusters of commodity machines (Beowulf clusters) or computers specifically designed for high-performance computing, such as multiprocessor shared-memory machines. We outline the scientific and practical benefits for VLBI correlation, these chiefly being due to the inherent flexibility of software and the fact that the highly parallel and scalable nature of the correlation task is well suited to a multiprocessor computing environment. We suggest scientific applications where such an approach to VLBI correlation is most suited and will give the best returns. We report detailed results from the Distributed FX (DiFX) software correlator running on the Swinburne supercomputer (a Beowulf cluster of ∼300 commodity processors), including measures of the performance of the system. For example, to correlate all Stokes products for a 10 antenna array with an aggregate bandwidth of 64 MHz per station, and using typical time and frequency resolution, currently requires an order of 100 desktop- class compute nodes. Due to the effect of Moore's law on commodity computing performance, the total number and cost of compute nodes required to meet a given correlation task continues to decrease rapidly with time. We show detailed comparisons between DiFX and two existing hardware-based correlators: the Australian Long Baseline Array S2 correlator and the NRAO Very Long Baseline Array correlator. In both cases, excellent agreement was found between the correlators. Finally, we describe plans for the future operation of DiFX on the Swinburne supercomputer for both astrophysical and geodetic science.

[1]  Andrew Wilson,et al.  Planetary probe atmospheric entry and descent trajectory analysis and science , 2004 .

[2]  B. R. Carlson,et al.  The S2 VLBI Correlator: A Correlator for Space VLBI and Geodetic Signal Processing , 1999, astro-ph/9908314.

[3]  A. Hewish,et al.  Quasi-periodic scintillation patterns of the pulsars PSR 1133+16 and PSR 1642−03 , 1985 .

[4]  M H Cohen,et al.  Interferometer Experiment with Independent Local Oscillators , 1967, Science.

[5]  Edward B. Fomalont,et al.  Imaging capability of the Mitaka VSOP correlator , 2000 .

[6]  James M. Moran,et al.  Detection of a Subparsec Diameter Disk in the Nucleus of NGC 4258 , 1995 .

[7]  C C Counselman,et al.  Very-Long-Baseline Radio Interferometry: The Mark III System for Geodesy, Astrometry, and Aperture Synthesis , 1983, Science.

[8]  D. L. Jauncey,et al.  Angular Size of 3c 273B , 1967 .

[9]  Jacqueline van Gorkom.  Radio interferometry : the saga and the science : proceedings of a symposium honoring Barry Clark at 60, held at Socorro, New Mexico, June 25-26, 1998 , 2000 .

[10]  William T. Faricy.  A.A.R. , 1951 .

[11]  B. Clark,et al.  The NRAO tape-recorder interferometer system , 1973 .

[12]  Harry H. Tan,et al.  The S2 very long baseline interferometry tape recorder , 1996 .

[13]  P. C. van Haren,et al.  PuMa, a digital Pulsar Machine , 2002 .

[14]  Hilton Lewis,et al.  Advanced Telescope and Instrumentation Control Software II , 2002 .

[15]  M. Bellanger,et al.  TDM-FDM Transmultiplexer: Digital Polyphase and FFT , 1974, IEEE Trans. Commun..

[16]  Vincent L. Fish,et al.  A very high spectral resolution study of ground-state oh masers in W3(OH) , 2006 .

[17]  Ivan I. Mueller,et al.  Book-Review - Developments in Astrometry and Their Impact on Astrophysics and Geodynamics , 1993 .

[18]  J. M. Moran,et al.  Spectral Line Interferometry with Independent Time Standards at Stations Separated by 845 Kilometers , 1967, Science.

[19]  Alan R. Whitney.  The Mark IV VLBI Data-Acquisition and Correlation System , 1993 .

[20]  P. P. Roberts.  Calculating quantization correction formulae for digital correlators with digital fringe rotation , 1997 .

[21]  C. Carilli,et al.  Synthesis Imaging in Radio Astronomy II , 1999 .

[22]  J. L Casse.  The European VLBI Network MkIV Data Processor , 1999 .

[23]  Sara Sulis,et al.  On the Measurement of Power Quality Indexes for Harmonic Distorsion in the Presence of Capacitors”, IEEE Transactions on Instrumentation and Measurement , 2007 .

[24]  K I Kellermann,et al.  The very long baseline array. , 1994, Science.

[25]  Eduardo Ros,et al.  Proceedings of the 6th European VLBI Network Symposium , 2002 .

[26]  Commonwealth Scientific,et al.  Australian journal of physics , 1948 .