notebook.community

Edit and run

HPC via HTTP: Portable, Scalable Computing using App Containers and the Agave API

Date: Monday, Nov 13th
Time: 8:30am - 12:00pm
Location: Colorado Convention Center, Room 203
Registration Registration SC Tutorial Website

Preview

Abstract

Supercomputing matters. So does user experience. Standing between the mainstream adoption of supercomputing and a new generation of users is the reality that the entry cost to using these systems, both in terms of dollars and in time spent learning the technology, has not significantly changed in the last 20 years. The rise of cloud computing only complicates the learning curve further. Over the last 6 years, the authors have been addressing this gap through the development of a Science-as-a-Service platform enabling users to go from their desktop, to their local data center, to the cloud, and back without sacrificing their existing tool chain or user experience.

In this tutorial, we combine best practices and lessons learned while on-boarding the last 70k new users to TACC’s data center through the Agave Platform. Participants will walk through the process of scaling their application from a local environment to the Jetstream academic cloud and to a high performance computing system at the Texas Advanced Computing Center. They will learn to use multiple container technologies to harmonize app execution between cloud and HPC resources, and they will learn to use modern APIs to orchestrate job execution, capture provenance information, and foster collaboration.

Schedule

Time Presenterr Topic
08:30 - 08:45 John, Steve [Introductions](00%20-%20Introduction.ipynb)
08:45 - 09:05 Rion [Agave Overview](https://docs.google.com/presentation/d/1cKXnmUFuGULlSMWsixtitLywcuD9pY7pWaqwdG2FjnI/edit)
09:05 - 09:15 Kathy [Jupyter, Sanbox, and Logging In](01%20-%20Jupyter%2C%20Sandboxes%2C%20and%20Logging%20In.ipynb)
09:15 - 09:30 Steve [Code, Build, and Test](02%20-%20Code,%20Build,%20and%20Test.ipynb)
09:30 - 10:00 Rion, John [Hands on with Agave](03%20-%20Hands%20on%20with%20Agave.ipynb)
10:00 - 10:30 -- Break
10:30 - 11:00 Steve,John [Docker and Singularity](04%20-%20Docker%20and%20Singularity.ipynb)
11:00 - 11:15 Rion [Automation and Benchmarking](05%20-%20Automation%20and%20Benchmarking.ipynb)
11:15 - 11:45 Kathy, Rion [Packaging, Publishing, and Portability](06%20-%20Packaging%2C%20publishing%2C%20and%20Portability.ipynb)

Presenters

Steven Brandt
Louisiana State University

Biography
Steven Brandt obtained his Ph.D. from the University of Illinois at Champaign-Urbana for his research in numerical simulations of rotating black holes. He currently serves as an adjunct faulty member in the Department of Computer Science & Engineering and is involved in research into making parallel programming more effective. He works with the STEllAR team led by Dr. Hartmut Kaiser, and helps lead the Cactus Frameworks effort. He is PI on grants relating to Cactus Frameworks development and cyberinfrastructure for the Coastal Hazards Collaboratory.

Kathy Traxler
Louisiana State University

Biography
Kathy Traxler is an Education, Outreach and Training coordinator for CCT. She now works with professors, who secured grants needing EOT programs, to develop and implement these programs. Kathy received her B.S. in Computer Science from Southeastern LA University in 1988. She then went to University of Southern MS and received a M.S. in Computer Science in 1991. She taught and was undergraduate advisor in LSU's Computer Science department from June of 1993 through May of 2003. when she moved to CCT to work with students and develop EOT activities.

John Fonner
Texas Advanced Computing Center

Biography
John Fonner earned a Ph.D. in Biomedical Engineering at the University of Texas at Austin, where he used a blend of experimental and computational techniques to study binding interactions between peptides and conducting polymers for implant applications in the nervous system. He joined the Life Sciences Computing group at TACC in 2011 and has served on a number of projects that help life sciences researchers leverage advanced computing resources, both through training and through the development of better tools and cyberinfrastructure.

Rion Dooley
Texas Advanced Computing Center

Biography
Rion Dooley is principal investigator on the Agave Project a Science-as-a-Service API platform allowing researchers worldwide to manage data, run code, collaborate freely, and integrate their science anywhere. His previous projects span areas of identity management, distributed web security, full-stack application development, data management, cloud services, and high performance computing. He earned his Ph.D. in computer science from Louisiana State University. Rion actively puts his wife and two daughters at the top of his list of accomplishments. He hopes his work can someday edge out dancing teddy bears and smear-proof lipstick on their lists of favorite inventions.

Acknowledgement

This material is based upon work supported by the National Science Foundation Plant Cyberinfrastructure Program (DBI-0735191), the National Science Foundation Plant Genome Research Program (IOS-1237931 and IOS-1237931), the National Science Foundation Division of Biological Infrastructure (DBI-1262414), the National Science Foundation Division of Advanced CyberInfrastructure (1127210), the National Science Foundation Computing and Communication Foundations (1539567), and the National Institute of Allergy and Infectious Diseases (1R01A1097403).

Special thanks

Special thanks go out to Shuai Yuan for his help on the Jupyter GUI notebook.





In [ ]:

Content source: agaveapi/SC17-container-tutorial

Similar notebooks:

notebook.community | gallery | about