MIT SuperCloud portal workspace: Enabling HPC web application deployment

The MIT SuperCloud Portal Workspace enables the secure exposure of web services running on high performance computing (HPC) systems. The portal allows users to run any web application as an HPC job and access it from their workstation while providing authentication, encryption, and access control at the system level to prevent unintended access. This capability permits users to seamlessly utilize existing and emerging tools that present their user interface as a website on an HPC system creating a portal workspace. Performance measurements indicate that the MIT SuperCloud Portal Workspace incurs marginal overhead when compared to a direct connection of the same service.

[1]  Jay Boisseau,et al.  Development of Web toolkits for computational science portals: the NPACI HotPage , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[2]  Jeremy Kepner,et al.  Achieving 100,000,000 database inserts per second using Accumulo and D4M , 2014, 2014 IEEE High Performance Extreme Computing Conference (HPEC).

[3]  Daniel A. Reed,et al.  NCSA's World Wide Web Server: Design and Performance , 1995, Computer.

[4]  Jeremy Kepner,et al.  Enabling on-demand database computing with MIT SuperCloud database management system , 2015, 2015 IEEE High Performance Extreme Computing Conference (HPEC).

[5]  Dirk Husmeier,et al.  TOPALi v2: a rich graphical interface for evolutionary analyses of multiple alignments on HPC clusters and multi-core desktops , 2008, Bioinform..

[6]  Jeremy Kepner,et al.  Enhancing HPC security with a user-based firewall , 2016, 2016 IEEE High Performance Extreme Computing Conference (HPEC).

[7]  Jeremy Kepner,et al.  HPC-VMs: Virtual machines in high performance computing systems , 2012, 2012 IEEE Conference on High Performance Extreme Computing.

[8]  Bernd Schuller,et al.  IV . IMPROVEMENTS INTRODUCED IN UNICORE 7 A . Lightweight RESTful Interfaces , 2016 .

[9]  Jeremy Kepner,et al.  Scalable cryptographic authentication for high performance computing , 2012, 2012 IEEE Conference on High Performance Extreme Computing.

[10]  Carl Kesselman,et al.  Web access to supercomputing , 2001, Comput. Sci. Eng..

[11]  Jeremy Kepner,et al.  LLSuperCloud: Sharing HPC systems for diverse rapid prototyping , 2013, 2013 IEEE High Performance Extreme Computing Conference (HPEC).

[12]  Jeremy Kepner,et al.  Benchmarking SciDB data import on HPC systems , 2016, 2016 IEEE High Performance Extreme Computing Conference (HPEC).

[13]  J. Bottomley,et al.  VirtFS — A virtualization aware File System pass-through , 2010 .

[14]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[15]  Mahadev Satyanarayanan,et al.  Quantifying interactive user experience on thin clients , 2006, Computer.

[16]  Lisa Dusseault,et al.  HTTP Extensions for Web Distributed Authoring and Versioning (WebDAV) , 2007, RFC.

[17]  Hsiao-Keng Jerry Chu,et al.  Transmission of IP over InfiniBand (IPoIB) , 2006, RFC.

[18]  Joshua A. Calahan,et al.  Secure Web-Based Access for Productive Supercomputing , 2016, Computing in Science & Engineering.

[19]  Shreyas Cholia,et al.  NEWT: A RESTful service for building High Performance Computing web applications , 2010, 2010 Gateway Computing Environments Workshop (GCE).

[20]  Renzo Davoli.  VDE: virtual distributed Ethernet , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.