Modern Scientific Software Management Using EasyBuild and Lmod

HPC user support teams invest a lot of time and effort in installing scientific software for their users. A well-established practice is providing environment modules to make it easy for users to set up their working environment. Several problems remain, however: user support teams lack appropriate tools to manage a scientific software stack easily and consistently, and users still struggle to set up their working environment correctly. In this paper, we present a modern approach to installing (scientific) software that provides a solution to these common issues. We show how EasyBuild, a software build and installation framework, can be used to automatically install software and generate environment modules. By using a hierarchical module naming scheme to offer environment modules to users in a more structured way, and providing Lmod, a modern tool for working with environment modules, we help typical users avoid common mistakes while giving power users the flexibility they demand.

[1]  Morris Riedel,et al.  DEISA—Distributed European Infrastructure for Supercomputing Applications , 2011, Journal of Grid Computing.

[2]  Roberto Ierusalimschy,et al.  Programming in Lua , 2003 .

[3]  Victor Hazlewood,et al.  Methods For Creating XSEDE Compatible Clusters , 2014, XSEDE '14.

[4]  G. Powers,et al.  A Description of the Advanced Research WRF Version 3 , 2008 .

[5]  Mark R. Fahey,et al.  Design, Implementation, and Experiences of Third-Party Software Administration at the ORNL NCCS , 2008 .

[6]  Andy Georges,et al.  EasyBuild: Building Software with Ease , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[7]  Tommy Minyard,et al.  Best practices for the deployment and management of production HPC clusters , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[8]  Thomas Epperly,et al.  Why Johnny can't build [portable scientific software] , 2003, Comput. Sci. Eng..

[9]  I Collier,et al.  CernVM-FS – beyond LHC computing , 2014 .

[10]  Roberto Ierusalimschy Programming in Lua, Third Edition , 2013 .

[11]  Peter W. Osel,et al.  Abstract Yourself With Modules , 1996, LISA.