GridFTP based real-time data movement architecture for x-ray photon correlation spectroscopy at the Advanced Photon Source

X-ray photon correlation spectroscopy (XPCS) is a unique tool to study the dynamical properties in a wide range of materials over a wide spatial and temporal range. XPCS measures the correlated changes in the speckle pattern, produced when a coherent x-ray beam is scattered from a disordered sample, over a time series of area detector images. The technique rides on “Big Data” and relies heavily on high performance computing (HPC) techniques. In this paper, we propose a highspeed data movement architecture for moving data within the Advanced Photon Source (APS) as well as between APS and the users' institutions. We describe the challenges involved in the internal data movement and a GridFTP-based solution that enables more efficient usage of the APS beam time. The implementation of GridFTP plugin as part of the data acquisition system at the Advanced Photon Source for real time data transfer to the HPC system for data analysis is discussed.

[1]  Yin Zhang,et al.  On individual and aggregate TCP performance , 1999, Proceedings. Seventh International Conference on Network Protocols.

[2]  Marcin Sikorski,et al.  MPICorrelator: A parallel code for performing time correlations , 2011 .

[3]  Johannes Buchner,et al.  The eye lens chaperone α-crystallin forms defined globular assemblies , 2009, Proceedings of the National Academy of Sciences.

[4]  Mark Sutton,et al.  Nanoparticle motion within glassy polymer melts. , 2009, Physical review letters.

[5]  Steven Tuecke,et al.  GridFTP: Protocol Extensions to FTP for the Grid , 2001 .

[6]  M Sikorski,et al.  Depletion-induced structure and dynamics in bimodal colloidal suspensions. , 2011, Physical review letters.

[7]  Steven Tuecke,et al.  An online credential repository for the Grid: MyProxy , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[8]  Simon G. J. Mochrie,et al.  Fast CCD camera for x-ray photon correlation spectroscopy and time-resolved x-ray scattering and imaging , 2004 .

[9]  Robert Elz,et al.  Feature negotiation mechanism for the File Transfer Protocol , 1998, RFC.

[10]  Ian T. Foster,et al.  Software as a service for data scientists , 2012, Commun. ACM.

[11]  G. B. Stephenson,et al.  Observation of speckle by diffraction with coherent X-rays , 1991, Nature.

[12]  William E. Allcock,et al.  The Globus Striped GridFTP Framework and Server , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[13]  Ian T. Foster,et al.  Globus Online: Accelerating and Democratizing Science through Cloud-Based Services , 2011, IEEE Internet Computing.

[14]  Jon Postel,et al.  File Transfer Protocol , 1985, RFC.

[15]  H. L. Dryden,et al.  Investigations on the Theory of the Brownian Movement , 1957 .

[16]  M A Borthwick,et al.  Absence of scaling for the intermediate scattering function of a hard-sphere suspension: static and dynamic x-ray scattering from concentrated polystyrene latex spheres. , 2000, Physical review letters.

[17]  R. Larson.  The Structure and Rheology of Complex Fluids , 1998 .

[18]  Brian D. Noble,et al.  The end-to-end performance effects of parallel TCP sockets on a lossy wide-area network , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[19]  Michael Sprung,et al.  Beyond simple exponential correlation functions and equilibrium dynamics in x-ray photon correlation spectroscopy , 2010 .

[20]  Marc Horowitz,et al.  FTP Security Extensions , 1997, RFC.