TY - GEN
T1 - Interactive HPC gateways with jupyter and jupyterhub
AU - Milligan, Michael
PY - 2017/7/9
Y1 - 2017/7/9
N2 - MSI at the University of Minnesota has adopted a goal of supporting Interactive HPC as a first class service. This paper describes the implementation of a gateway for user-friendly, reproducible computing in an HPC environment using the Jupyter notebook server and Jupyterhub. For this project, we developed novel components and techniques enabling interoperability of Jupyter with the distinct requirements of an institutional HPC center. These include modules providing integration with batch job scheduling, control of job profiles, and integration with a central authentication service. To achieve software sustainability, we designed these elements for generic applicability, and several have now been accepted as components of the Jupyterhub open source project.
AB - MSI at the University of Minnesota has adopted a goal of supporting Interactive HPC as a first class service. This paper describes the implementation of a gateway for user-friendly, reproducible computing in an HPC environment using the Jupyter notebook server and Jupyterhub. For this project, we developed novel components and techniques enabling interoperability of Jupyter with the distinct requirements of an institutional HPC center. These include modules providing integration with batch job scheduling, control of job profiles, and integration with a central authentication service. To achieve software sustainability, we designed these elements for generic applicability, and several have now been accepted as components of the Jupyterhub open source project.
KW - High performance computing
KW - Interfaces
KW - Jupyter
KW - Management
UR - http://www.scopus.com/inward/record.url?scp=85025810834&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85025810834&partnerID=8YFLogxK
U2 - 10.1145/3093338.3104159
DO - 10.1145/3093338.3104159
M3 - Conference contribution
AN - SCOPUS:85025810834
T3 - ACM International Conference Proceeding Series
BT - PEARC 2017 - Practice and Experience in Advanced Research Computing 2017
PB - Association for Computing Machinery
T2 - 2017 Practice and Experience in Advanced Research Computing, PEARC 2017
Y2 - 9 July 2017 through 13 July 2017
ER -