Virtual Memory Management in Data Parallel Applications

The PaLaDiN (PArallel LArge Data set In Network of workstations) project is concerned with parallel out-of-core application running on cluster of workstations or PCs. In such architectures, each node has a virtual memory manager and a first idea is to use this feature to run “parallel out-of-core” application as a parallel in-core one. The out-of-core part of the problem, i.e. the schedule of data fetch and data write-back, is relegated to the operating system.

[1]  Yoonho Park,et al.  Virtual Memory versus File Interface for Large, Memory-Intensive Scientific Applications , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[2]  Rajeev Thakur,et al.  I/O characterization of a portable astrophysics application on the IBM SP and Intel Paragon , 1996 .

[3]  Lawrence Lau,et al.  Parallel Run Length Encoding Compression: Reducing I/o in dYnamic Environmental Simulations , 1998, Int. J. High Perform. Comput. Appl..

[4]  Ted G. Lewis.  Where is computing headed? , 1994, Computer.

[5]  Gil Utard,et al.  Automatic Data Layout and Code Restructuring for Out-of-core Programs Jean-Fran , 1998 .

[6]  Guy Lonsdale,et al.  Performance Issues of the Parallel Pam-Crash Code , 1997, Int. J. High Perform. Comput. Appl..

[7]  John K. Ousterhout.  Scheduling Techniques for Concurrebt Systems. , 1982, ICDCS 1982.

[8]  Amin Vahdat,et al.  Tools for the development of application-specific virtual memory management , 1993, OOPSLA '93.

[9]  Alok N. Choudhary,et al.  Communication strategies for out-of-core programs on distributed memory machines , 1995, ICS '95.

[10]  Dan C. Marinescu,et al.  An Analysis of the Paging Activity of Parallel Programs , 1994 .

[11]  M.I.T. Press,et al.  The International Journal of Supercomputer Applications and High Performance Computing— , 1994 .

[12]  Dan C. Marinescu,et al.  Characterization of the Paging Activity of NAS Benchmark Programs on the Intel Paragon , 1995 .

[13]  Alok Choudhary,et al.  for- Massively Parallel Computers Problems and Prospects , 1994 .

[14]  Marc Shapiro,et al.  Generic Memory Management for Operating System Ker-nels , 1989, SOSP 1989.

[15]  John K. Ousterhout,et al.  Scheduling Techniques for Concurrent Systems , 1982, ICDCS.

[16]  Todd C. Mowry,et al.  Automatic compiler-inserted I/O prefetching for out-of-core applications , 1996, OSDI '96.

[17]  Alok N. Choudhary,et al.  High-performance I/O for massively parallel computers: problems and prospects , 1994, Computer.

[18]  Dan C. Marinescu,et al.  On Gang Scheduling and Demand Paging , 1996 .