Introduction to High Performance Computing
from
Monday 15 August 2016 (08:00)
to
Friday 26 August 2016 (15:00)
Monday 15 August 2016
08:30
Registration - room E3 at KTH Main campus
Registration - room E3 at KTH Main campus
08:30 - 09:15
Room: E3 at KTH Main campus
09:15
Welcome to PDC and the Summer School
-
Erwin Laure
(
PDC-HPC
)
Welcome to PDC and the Summer School
Erwin Laure
(
PDC-HPC
)
09:15 - 10:15
Room: E3
10:15
Coffee Break
Coffee Break
10:15 - 10:30
10:30
High-Performance Computer Architecture
-
Erik Hagersten
High-Performance Computer Architecture
Erik Hagersten
10:30 - 12:15
Room: E3
12:15
Picnic - KTH garden
Picnic - KTH garden
12:15 - 14:00
14:00
High-Performance Computer Architecture
-
Erik Hagersten
High-Performance Computer Architecture
Erik Hagersten
14:00 - 15:00
Room: E3
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
High-Performance Computer Architecture
-
Erik Hagersten
High-Performance Computer Architecture
Erik Hagersten
15:15 - 17:00
Room: E3
Tuesday 16 August 2016
09:15
Concepts and Algorithms for Scientific Computing
-
Michael Hanke
Concepts and Algorithms for Scientific Computing
Michael Hanke
09:15 - 10:00
Room: E3
In this talk we will present of what Scientific Computing is and what the challenges are. In particular, we will discuss the "simulation pipeline". The present and future of Scientific Computing is massively parallel. Consequences for modelling and examples for algorithm contruction for scalable computing are given.
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
Concepts and Algorithms for Scientific Computing
-
Michael Hanke
Concepts and Algorithms for Scientific Computing
Michael Hanke
10:15 - 12:15
Room: E3
12:15
Individual Lunch
Individual Lunch
12:15 - 13:30
13:30
Introduction to PDC's Environment
Introduction to PDC's Environment
13:30 - 14:30
Room: E3
14:30
Coffee Break
Coffee Break
14:30 - 14:45
14:45
Lab: Introduction to PDC's Environment
Lab: Introduction to PDC's Environment
14:45 - 16:45
Room: Röd and Ora Lab-rooms
PDC Machine Room Tour
PDC Machine Room Tour
14:45 - 16:45
Wednesday 17 August 2016
09:15
Shared memory programming, OpenMP
-
Christoph Kessler
Shared memory programming, OpenMP
Christoph Kessler
09:15 - 10:00
Room: E3
Two common ways of speeding up programs are to use processes or threads executing in parallel. The second week of the Summer School presents process-based parallel computing using MPI. In this lecture parallelization using threads will be discussed. Threads can be managed in different ways, e.g. using a low level library, like the POSIX threads library. The lecture deals with OpenMP, which is a more convenient way to use threads. OpenMP is a specification for a set of compiler directives, library routines, and environment variables that can be used to specify shared memory parallelism in Fortran and C/C++ programs. The threaded program can be executed on a shared memory computer (e.g. a multi- core processor). Typically, the iterations of a time consuming loop are shared among a team of threads, each thread working on part of the iterations. The loop is parallelized by writing a directive in the code and a compiler or a pre- processor will generate parallel code. Using short code examples, the lecture covers the most important OpenMP-constructs, how to use them and how not to use them. A few more realistic examples are presented as well.
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
Shared memory programming, OpenMP
-
Christoph Kessler
Shared memory programming, OpenMP
Christoph Kessler
10:15 - 12:00
Room: E3
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
Shared memory programming, OpenMP
-
Christoph Kessler
Shared memory programming, OpenMP
Christoph Kessler
13:15 - 14:00
Room: E3
14:15
Lab: Programming Exercises on OpenMP
-
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
Lab: Programming Exercises on OpenMP
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
14:15 - 15:00
Room: Röd and Ora Lab-rooms
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: Programming Exercises on OpenMP
-
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
Lab: Programming Exercises on OpenMP
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Thursday 18 August 2016
09:15
Shared memory programming, OpenMP
-
Christoph Kessler
Shared memory programming, OpenMP
Christoph Kessler
09:15 - 10:00
Room: E3
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
Shared memory programming, OpenMP
-
Christoph Kessler
Shared memory programming, OpenMP
Christoph Kessler
10:15 - 12:00
Room: E3
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
Lab: OpenMP Advanced Project
-
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
Lab: OpenMP Advanced Project
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
13:15 - 15:00
Room: Röd and Ora Lab-rooms
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: OpenMP Advanced Project
-
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
Lab: OpenMP Advanced Project
Stefano Markidis
Niclas Jansson
(
CSC/NA
)
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Friday 19 August 2016
09:15
GPU Architectures
-
Szilard Pall
GPU Architectures
Szilard Pall
09:15 - 10:00
Room: E3
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
Introduction to CUDA
Introduction to CUDA
10:15 - 12:00
Room: E3
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
Lab: CUDA
-
Szilard Pall
Lab: CUDA
Szilard Pall
13:15 - 15:00
Room: Röd and Ora Lab-rooms
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: CUDA
-
Szilard Pall
Lab: CUDA
Szilard Pall
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Saturday 20 August 2016
Sunday 21 August 2016
Monday 22 August 2016
09:15
Wrap up: GPU Programming
-
Szilard Pall
Wrap up: GPU Programming
Szilard Pall
09:15 - 10:00
Room: E3
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
MPI: Introduction, Basic Concepts, Point-to-Point Communication
-
Erwin Laure
(
PDC-HPC
)
MPI: Introduction, Basic Concepts, Point-to-Point Communication
Erwin Laure
(
PDC-HPC
)
10:15 - 12:00
Room: E3
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
MPI - Point-to-Point Communication
-
Erwin Laure
(
PDC-HPC
)
MPI - Point-to-Point Communication
Erwin Laure
(
PDC-HPC
)
13:15 - 14:00
Room: E3
14:00
Lab: MPI Part 1
Lab: MPI Part 1
14:00 - 15:00
Room: Röd and Ora Lab-rooms
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: MPI Part 1
Lab: MPI Part 1
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Tuesday 23 August 2016
09:15
MPI - Collective Communication
-
Erwin Laure
(
PDC-HPC
)
MPI - Collective Communication
Erwin Laure
(
PDC-HPC
)
09:15 - 10:00
Room: E3
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
MPI - Intermediate MPI
-
Erwin Laure
(
PDC-HPC
)
MPI - Intermediate MPI
Erwin Laure
(
PDC-HPC
)
10:15 - 12:00
Room: E3
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
Lab: MPI Part 2
Lab: MPI Part 2
13:15 - 15:00
Room: Röd and Ora Lab-rooms
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: MPI Part 2
Lab: MPI Part 2
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Project Work
Project Work
15:15 - 17:00
Wednesday 24 August 2016
09:15
Performance Engineering
-
Pekka Manninen
Performance Engineering
Pekka Manninen
09:15 - 10:00
Room: E3
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
Performance Engineering
-
Pekka Manninen
Performance Engineering
Pekka Manninen
10:15 - 12:00
Room: E3
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
Lab: Performance Engineering
Lab: Performance Engineering
13:15 - 15:00
Room: Röd and Ora Lab-rooms
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: Performance Engineering
Lab: Performance Engineering
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Thursday 25 August 2016
08:30
Wrap up: Performance Engineering
-
Pekka Manninen
Wrap up: Performance Engineering
Pekka Manninen
08:30 - 09:15
Room: E3
09:15
MPI: Advanced Concepts
-
Erwin Laure
(
PDC-HPC
)
MPI: Advanced Concepts
Erwin Laure
(
PDC-HPC
)
09:15 - 10:00
Room: E3
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
MPI: Advanced Concepts
-
Erwin Laure
(
PDC-HPC
)
MPI: Advanced Concepts
Erwin Laure
(
PDC-HPC
)
10:15 - 11:00
Room: E3
11:15
Case Study: Energy Efficiency in Scientific Computing
-
Enrique Quintana Ortí
Case Study: Energy Efficiency in Scientific Computing
Enrique Quintana Ortí
11:15 - 12:00
Room: E3
Energy consumption is a crucial challenge that the high performance computing community will have to face to efficiently leverage the Exascale systems that will be available at the end of this decade. In this talk we will motivate the roots of the power wall, and introduce a "recipe" of measures that are being implemented in hardware as well as scientific applications in order to reduce energy consumption: 1) Selection of energy efficient hardware 2) Dynamic voltage-frequency scaling 3) Dynamic concurrency throttling 4) Suppression of polling 5) Approximate computing 6) Near threshold voltage computing 7) Use of energy proportional hardware 8) Virtualization of computational resources
12:00
Individual Lunch
Individual Lunch
12:00 - 13:00
13:15
Lab: MPI Part 3
Lab: MPI Part 3
13:15 - 15:00
15:00
Coffee Break
Coffee Break
15:00 - 15:15
15:15
Lab: MPI Part 3
Lab: MPI Part 3
15:15 - 17:00
Room: Röd and Ora Lab-rooms
Project Work
Project Work
15:15 - 17:00
18:00
Social Dinner at Cypern Restaurant
Social Dinner at Cypern Restaurant
18:00 - 21:00
Room: Cypern Restaurant
Friday 26 August 2016
09:15
The Future of Computing - Towards the Post Moore’s Law Era
-
Stefano Markidis
The Future of Computing - Towards the Post Moore’s Law Era
Stefano Markidis
09:15 - 10:00
Room: E3
This lecture presents the Moore's law and discusses its future focusing on future emerging technologies in computing.
10:00
Coffee Break
Coffee Break
10:00 - 10:15
10:15
The Future of Computing - Towards the Post Moore’s Law Era
-
Stefano Markidis
The Future of Computing - Towards the Post Moore’s Law Era
Stefano Markidis
10:15 - 11:00
Room: E3
11:00
Case Study: State of the Art Parallel Computing enables new Science breakthroughs
-
Alison Lowndes
(
Nvidia
)
Case Study: State of the Art Parallel Computing enables new Science breakthroughs
Alison Lowndes
(
Nvidia
)
11:00 - 12:00
Room: E3
NVIDIAs Alison Lowndes will provide an overview of NVIDIA's latest hardware and software offering and how this enables discovery and insight via parallel scientific visual computing. She will also cover recent progress in algorithms and papers that should be of great interest Alison Lowndes Deep Learning Solutions Architect & Community Manager EMEA| NVIDIA (UK) Recent mature graduate in Artificial Intelligence (University of Leeds), combining technical and theoretical computer science with a physics background. Completed a thorough empirical study of deep learning, specifically with GPU technology, covering the entire history and technical aspects of GPGPU with underlying mathematics. After 25+ years in international project management and entrepreneurship, Alison now manages the Deep Learning and AI developer community across EMEAI and advises on a wide range of applications of deep learning.
12:00
Course Evaluation
Course Evaluation
12:00 - 12:10
Room: E3
In class course evaluation
12:10
Individual Lunch
Individual Lunch
12:10 - 13:00
13:00
Open Lab and Project Work
Open Lab and Project Work
13:00 - 17:00
Room: Röd and Ora Lab-rooms