PUMPS+AI became an ACM Seasonal School since 2023
(This year's ACM sponsorship is still to be confirmed)
Note this is a fully in-person summer school in wonderful Barcelona city!
On its 15th edition, the Programming and tUning Massively Parallel Systems + Artificial Intelligence summer school (PUMPS+AI) offers researchers and graduate students a unique opportunity to improve their skills with cutting-edge techniques and hands-on experience in developing and tuning applications for many-core processors with massively parallel computing resources like GPU accelerators, with a special focus on AI.
This year's PUMPS+AI provides a sneak peak of new material to be released in the upcoming 5th edition of the textbook Programming Massively Parallel Processors. This material covers topics such as large language models, matrix multiplication optimization techniques, wavefront algorithms, and the latest multi-GPU libraries.
- PUMPS 2025 Distinguished Lecturer: Wen-mei Hwu (NVIDIA)
The summer school is oriented towards advanced programming and optimizations, and thus previous experience in basic GPU programming will be considered in the selection process. We will also consider the current parallel applications and numerical methods you are familiar with, and the specific optimizations you would like to discuss.
Some of the topics that will be covered during the course are:
- DEEP Learning / AI engine internals
- High-level programming models
- CUDA Algorithmic Optimization Strategies
- Dealing with Sparse and Dynamic data
- Efficiency in Large Data Traversal
- Reducing Output Interference
- Controlling Load Imbalance and Divergence
- Acceleration of Collective Operations
- Dynamic Parallelism and HyperQ
- Debugging and Profiling CUDA Code
- Multi-GPU Execution
- Architecture Trends and Implications
- Introduction to OmpSs and to the Paraver analysis tools
- OmpSs: Leveraging GPU Programming
- Hands-on Labs
Participants will have access to GPU servers and will learn to program and optimize applications and AI techniques in languages such as CUDA and OmpSs. Teaching Assistants will be available to help with your hands-on lab assignments. At poster and hackathon sessions you may show your current work and applications you are optimizing. NVIDIA will award the best poster presentation.
Important Dates:
- Applications due: May 4, 2025
- Notification of acceptance: May 12, 2025
- Summer school: July 14-18, 2025
Early application is strongly recommended. You may also be suggested to attend an online prerequisite training on basic CUDA programming before joining PUMPS+AI.
- Location: Barcelona, Spain
- Complete information, program and registration: http://pumps.bsc.es
PUMPS is organized by the Barcelona Supercomputing Center, the University of Illinois Urbana-Champaign, and the Universitat Politècnica de Catalunya.
PUMPS Co-Directors: Mateo Valero (BSC/UPC) and Wen-mei Hwu (NVIDIA/UIUC)
Local Organizers: Antonio J. Peña (Chair, BSC and UPC), Marc Jordà (BSC), Mar Bonet (BSC)
Contact: pumps@bsc.es
