Introduction to High-Performance Computing

Europe/Stockholm
KTH main campus

KTH main campus

KTH main campus Valhallavägen 79
Description

The PDC- Center for High-Performance Computing and the KTH School of Computer Science and Communication (CSC) welcome you to our summer school introductory course on high-performance computing. This course is part of the Swedish National Graduate School in Scientific Computing (NGSSC) and is endorsed by the KTH Computational Science and Engineering Centre (KCSE) Graduate School, both of whom help to sponsor the summer school.

Interested students and researchers (with academic or industrial backgrounds) from all over the world are invited to apply to attend the course, which will be held at the KTH main campus in Stockholm during late August. (Please note that for KTH Masters students, the summer school is available as course number DN2258.)

This course provides the skills needed to utilize high-performance computing (HPC) resources, and includes an introduction to a range of important topics, such as:

  • HPC programming languages, libraries and tools,
  • modern computer architectures,
  • parallel algorithms, and
  • optimizing serial and parallel programs.
Case studies in various scientific disciplines will be used to help illustrate these topics. The course consists of both lectures and guided hands-on lab sessions. Participants who successfully complete the course (including the associated programming project) will be awarded 7.5 ECTS (European Credit Transfer and Accumulation System).

The course is suitable for scientists and graduate students who are interested in high-performance computing. Applicants must be able to communicate in English, and have previous programming experience.

2013 will be the 18th year that the course has been held – participants will become part of the long tradition of the PDC Summer School, which you can read about in the course pages for all the previous years.

Please note that there are a limited number of places available in the summer school, so be sure to register early! Course registration opens on March 15, and closes on June 1, 2013.

document
    • 8:30 AM 9:15 AM
      Registration 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
    • 9:15 AM 10:15 AM
      Welcome to PDC and the Summer School 1h E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erwin Laure (PDC-HPC)
      Slides
    • 10:15 AM 10:30 AM
      Coffee break 15m
    • 10:30 AM 12:15 PM
      Concepts and Algorithms for Scientific Computing 1h 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Björn ENGQUIST
      Slides
    • 12:15 PM 2:00 PM
      Picnic 1h 45m
    • 2:00 PM 3:00 PM
      Introduction to PDC's Environment 1h E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Izhar UL HASSAN
      Slides
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 4:45 PM
      Lab: Introduction to PDC's Environment 1h 30m Room: 4V2Röd, 4V3Ora

      Room: 4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Izhar UL HASSAN
    • 9:15 AM 10:00 AM
      High-Performance Computer Architecture 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erik HAGERSTEN
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 12:00 PM
      High-Performance Computer Architecture 1h 45m
      Speaker: Erik HAGERSTEN
      Slides
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:00 PM 3:00 PM
      High-Performance Computer Architecture 2h E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erik HAGERSTEN
      Slides
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 5:00 PM
      Lab: Introduction to PDC's Environment 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Izhar UL HASSAN
    • 3:15 PM 5:00 PM
      PDC Machine Room Tour 1h 45m
    • 9:15 AM 10:00 AM
      Shared memory programming, OpenMP 45m
      Two common ways of speeding up programs are to use processes or threads executing in parallel. The second week of the Summer School presents process-based parallel computing using MPI. In this lecture parallelization using threads will be discussed. Threads can be managed in different ways, e.g. using a low level library, like the POSIX threads library. The lecture deals with OpenMP, which is a more convenient way to use threads. OpenMP is a specification for a set of compiler directives, library routines, and environment variables that can be used to specify shared memory parallelism in Fortran and C/C++ programs. The threaded program can be executed on a shared memory computer (e.g. a multi- core processor). Typically, the iterations of a time consuming loop are shared among a team of threads, each thread working on part of the iterations. The loop is parallelized by writing a directive in the code and a compiler or a pre- processor will generate parallel code. Using short code examples, the lecture covers the most important OpenMP-constructs, how to use them and how not to use them. A few more realistic examples are presented as well.
      Speaker: Thomas ERICSSON
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 12:00 PM
      Shared memory programming, OpenMP 1h 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Thomas ERICSSON
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 2:00 PM
      Shared memory programming, OpenMP 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      T
      Speaker: Thomas ERICSSON
    • 2:15 PM 3:00 PM
      Lab: Programming Exercises on OpenMP 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speakers: Niclas JANSSON, Stefano MARKIDIS
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 4:00 PM
      Lab: Programming Exercises on OpenMP 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speakers: Niclas JANSSON, Stefano MARKIDIS
    • 9:15 AM 10:00 AM
      Code optimization 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      In this lecture techniques for speeding up code on a uniprocessor are presented. The lecture covers basic optimization principles such as using the memory hierarchy in an efficient way. Using short code examples, the lecture covers stride minimization, blocking, loop- fusion, loop- splitting and other approaches. The choice of programming language (Fortran or C), and compiler will be discussed. There are some hints of how to tune Matlab programs. Other topics are vector arithmetic for floating point and elementary functions, virtual memory, files and the LAPACK and BLAS libraries.
      Speaker: Thomas ERICSSON
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 12:00 PM
      Code optimization 1h 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Thomas ERICSSON
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 3:00 PM
      Lab: OpenMP Advanced Project 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speakers: Niclas JANSSON, Stefano MARKIDIS
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 5:00 PM
      Lab: OpenMP Advanced Project 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speakers: Niclas JANSSON, Stefano MARKIDIS
    • 8:30 AM 9:00 AM
      Wrap up: OpenMP Advanced Project 30m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speakers: Niclas JANSSON, Stefano MARKIDIS
    • 9:15 AM 10:00 AM
      GPU Architectures for Non-Graphics People 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Today everyone is positioning GPUs for general purpose computing. They claim that you can get 10-100x speedups over conventional CPUs, and sometimes they're even right. However, to get the most out of current- (and next-) generation GPUs, one needs to understand the architectural differences and how they effect your choice of algorithm. In this talk I will cover GPU architecture in comparison to current CPUs, discuss the implications for getting good performance, and introduce OpenCL as a general-purpose programming language for accessing GPUs and CPUs today.
      Speaker: David BLACK-SCHAFFER
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 11:00 AM
      GPUs: The Hype, The Reality, and The Future 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      We'll take a look at the promise and the results of porting applications to GPUs and try to distinguish the hype from the reality. We'll take a closer look at where GPUs fit into HPC today and in the near future, and try to do a fair comparison of GPU optimized programs, CPU optimized programs, and even take a look at competing accelerators such as the Intel Xeon Phi. The goal of this lecture is to give you some perspective on GPU technology and where it may (or may not) fit into HPC in the next few years.
      Speaker: David Black-Schaffer
      Slides
    • 11:00 AM 12:00 PM
      Introduction to CUDA 1h E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      CUDA is a parallel computing platform and programming model for NVIDIA GPU devices that allows to use the capabilities of the hardware efficiently. Lecture and lab give an overview of CUDA, discuss aspects of programming that needs the programmer's attention in order to gain the desired performance, and provide a first hands-on experience.
      Speaker: Michael SCHLIEPHAKE
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 2:15 PM
      Lab: CUDA 1h 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Michael SCHLIEPHAKE
    • 2:15 PM 3:00 PM
      Introduction to CUDA 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Michael SCHLIEPHAKE
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 4:00 PM
      Introduction to CUDA 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Michael SCHLIEPHAKE
    • 4:00 PM 5:00 PM
      Lab: CUDA 1h 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Michael SCHLIEPHAKE
    • 9:15 AM 10:00 AM
      MPI Introduction 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erwin LAURE
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 12:00 PM
      MPI Basic Concepts & Point-to-Point Communication 1h 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erwin LAURE
      Slides
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 3:00 PM
      Lab: MPI Part 1 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Jonathan VINCENT
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 5:00 PM
      Lab: MPI Part 1 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Jonathan VINCENT
    • 9:15 AM 10:00 AM
      MPI - Collective Communication 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erwin LAURE
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 11:00 AM
      MPI - Intermediate MPI 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erwin LAURE
      Slides
    • 11:15 AM 12:00 PM
      Performance Engineering 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
      Slides
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 2:00 PM
      Performance Engineering 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
    • 2:15 PM 3:00 PM
      Lab: Performance Engineering 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 5:00 PM
      Lab: Performance Engineering 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
    • 3:15 PM 5:00 PM
      Project work 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Discuss your project ideas with other students, the course examiner, and tutors.
    • 8:30 AM 9:00 AM
      Wrap up: Performance Engineering 30m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
    • 9:15 AM 10:00 AM
      MPI: Advanced Concepts 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Erwin LAURE
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:30 AM 11:15 AM
      MPI: Advanced Concepts 45m
      Speaker: Erwin LAURE
    • 11:15 AM 12:00 PM
      Parallel Performance Engineering 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 3:00 PM
      Lab: Parallel Performance Engineering 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Pekka MANNINEN
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 5:00 PM
      Lab: MPI Part 2 1h 45m
      Speaker: Jonathan VINCENT
    • 9:15 AM 10:00 AM
      Interconnection Networks 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Interconnect networks have large influence on the performance and efficiency of message-passing and File-I/O operations in cluster systems. The lecture presents concise information about interconnect networks in order to support the understanding of their influence and how to use it in favour of simulation applications.
      Speaker: Michael SCHLIEPHAKE
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 11:00 AM
      Interconnection Networks 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Michael SCHLIEPHAKE
    • 11:15 AM 12:00 PM
      Case Study: Numerical experiments of turbulent flows on supercomputers 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      After a short description about the activities of the Swedish e-Science Research Centre (SeRC) a general motivation of studying turbulence is given, including elucidating the large range of scales needed to be resolved for high Reynolds numbers. The infrastructure needed to perform these simulations are discussed, including the simulation codes and large scale computational resources. Examples of such large scale simulations are then given in terms of high Reynolds number turbulent boundary layers on a flat plate, and also such a boundary layer with an obstacle. Finally the possibility to scale up the simulations to flows of direct aeronautical interest is discussed, e.g. when will it be possible to replace typical university wind tunnel experiments with DNS? This begs the question of the possibility of exa-scale computing and questions if the current methods can be used on such e-Infrastructure is posed?
      Speaker: Philipp SCHLATTER (KTH)
      Slides
    • 12:00 PM 1:00 PM
      Individual lunch 1h
    • 1:15 PM 3:00 PM
      Lab: MPI Part 3 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Jonathan VINCENT
    • 3:00 PM 3:15 PM
      Coffee break 15m
    • 3:15 PM 5:00 PM
      Lab: MPI Part 3 1h 45m 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Jonathan VINCENT
    • 3:15 PM 5:00 PM
      Project work 1h 45m
    • 6:00 PM 9:00 PM
      Social dinner 3h
    • 9:15 AM 10:00 AM
      Future Programming Languages 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      The lecture presents the current limitations of traditional programming models, such as MPI and openMP, and provides motivations to adopt new programming models for parallel computing. The potential of innovative programming models such as the Partitioned Global Address Space (PGAS) languages, and task-based programming models is discussed. Few examples of how to test on Lindgren these innovative programming models are also presented.
      Speaker: Stefano MARKIDIS
      Slides
    • 10:00 AM 10:15 AM
      Coffee break 15m
    • 10:15 AM 11:00 AM
      Future Programming Languages 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      Speaker: Stefano MARKIDIS
    • 11:15 AM 12:00 PM
      Abstractions for processing large data sets 45m E3

      E3

      KTH main campus

      KTH main campus Valhallavägen 79
      At Google there is often a need to process very large data sets across many machines. Building efficient parallel processing programs is not trivial and to avoid the overhead of each engineer reinventing the wheel, Google has created several programming models to abstract away the complexities of parallelism and have the programmer concentrate on the core of his processing problem instead. I will talk mainly about the MapReduce model, how it works and the conceptual model the programmer has to work with when using it. I will also mention a bit about a more recent framework, Pregel, which is built for processing very large
      Speaker: Jonas YNGVESSON
    • 12:00 PM 12:15 PM
      Individual lunch 15m
    • 1:00 PM 5:00 PM
      Open Lab and Project Work 4h 4V2Röd, 4V3Ora

      4V2Röd, 4V3Ora

      KTH main campus

      KTH main campus Valhallavägen 79