HDF5 is a data model, file format, and I/O library that has become a de-facto standard for HPC applications to achieve scalable I/O and the storage and management of big data from computer modeling. This workshop will be geared toward the ALCF Polaris system. It will give an overview of its parallel file system and its possible effects on HDF5 performance and will provide a summary of tools useful for performance investigations. It will use examples from well-known codes and use cases from HPC science applications in hands-on demonstrations. It will discuss HDF5 tuning techniques such as collective metadata I/O, data aggregation, parallel compression, and other HDF5 tuning parameters and features. Finally, the workshop will allow for a review of attendees' HDF5 I/O implementations targeting the Polaris system.
The workshop will target intermediate and advanced users of HDF5 since it will cover the best practices, supporting analysis tools, and tuning techniques for users already using parallel HDF5. New users to HDF5 are encouraged to attend the precursor talk: https://www.alcf.anl.gov/events/introduction-hdf5-hpc-data-models-analysis-and-performance
Speaker Bio:
Scot Breitenfeld received his B.S. in Aerospace Engineering from the University of Arizona and his M.S. degree in Aerospace Engineering from the University of Illinois at Urbana-Champaign. The focus of his master's thesis was modeling elastodynamic failure in bi-material interfaces using a spectral method. He has worked for the National Center for Supercomputing Applications (NCSA)on parallel structural code development and evaluation of the parallel performance of commercial finite element software. Additionally, he worked on a DARPA-funded smart mesoflaps for an aeroelastic transpiration project parallelizing the CFD solver and parallel coupling of the fluid and structural solvers. He also worked for the Center for Simulation of Advanced Rockets (CSAR) at the University of Illinois at Urbana-Champaign. He was the principal developer of the explicit parallel 3D ALE fracture and structural/thermal finite element solver, Rocfrac, within the center's multi-physics code RocStar. He received his Ph.D. in Aerospace Engineering from the University of Illinois at Urbana-Champaign, working on modeling quasi-static fracture using Non-Ordinary State-based peridynamics. He is currently an HDF application support specialist and software engineer at The HDF Group.
Agenda:
- Overview of Parallel HDF5 design
- Parallel Consistency Semantics
- PHDF5 Programming Model
- Performance Analysis
- Parallel Performance Analysis Tools
- Cutting-edge HDF5 features
- System Specific Considerations
- Hands-on and/or walkthroughs
REGISTRATION DEADLINE is Monday, August 15 2022.
STEPS TO REGISTER:
Step 1:
a. Request an ALCF Computer User Account if you do not currently have one*
b. If you have an ALCF Account that is currently inactive, submit an account reactivation request*.
c. If you have an active ALCF account, click Join Project to submit a membership request*.
*Specify the following in your request:
- Project Name: alcf_training
- Principal Investigator (PI): Yasaman Ghadar
Note, your event registration cannot be processed until you complete your ALCF account/reactivation request and submit all documentation requested. You must complete Step 1 before the registration deadline of August 15, 2022.
STEP 2:
COMPLETE this event registration by clicking the "Register now" button below. Note, your participation is not confirmed until you receive an acceptance email from ALCF staff.
FOREIGN NATIONALS: ELIGIBILITY
The following restrictions apply to foreign nationals.
1. Foreign nationals from countries that appear on a restricted foreign country in section 15 CFR 740.7 License Exceptions for Computers (namely Cuba, Iran, North Korea and Syria) require very lengthy approval process for access to DOE supercomputers, which will not complete in time for this workshop.
2. Foreign nationals from countries other than those listed above will need a valid passport, visa and supporting documents with an expiration date beyond the end of the training program. Department of Energy policy now require a CV/resume including educational and employment history.
IMPORTANT NOTE:
Your attendance is not confirmed until you receive the "Attendance Confirmed" email from the ACLF staff. Please contact [email protected] if you have any questions.
