Introduction to HPC-Cluster

Introduction to HPC-Cluster

Published: 16 Feb 2022 by HPC Team Freiburg

The, University of Stuttgart is pleased to announce its web seminar for bwHPC users.

Title: Introduction to HPC-Cluster

Date: 22.03.2022

Topic: Introduction to HPC-Cluster - bwUniCluster 2.0 (Web Seminar)

Lecturer: Darko Milakovic (HLRS)

Web: https://training.bwhpc.de/goto.php?target=crs_664&client_id=BWHPC

Abstract

High Performance Computing (HPC) means achieving high and highest computing performance. Special HPC clusters and supercomputers are used for this purpose. To achieve maximum performance, all the components involved must be planned and coordinated and operated with each other. The course will give insight into the need for supercomputers and teach the basic structure of a microprocessor​ and multicore processor (x86_64)​ as well as the different aspects of of shared memory CPU-nodes​ and distributed memory system​s. In addition, the course will give an introduction of the bwUniCluster 2.0, including the connection, authentication, batch system, workspaces, module files, visualization, data transfer, file systems and interactive jobs.

Agenda

  • Why HPC-Cluster / Cluster Computing?​
  • System Architecture​
  • Compute Nodes with Multiple Processors​
  • Coffee Break
  • Cluster Basics
  • Coffee Break
  • Hands On / Live Demo on bwUniCluster 2.0​ (1)
  • Coffee Break
  • Digression: Use Bash in Jupyter Notebooks on bwUniCluster 2.0 (Live Demo)

After this course, participants will…

  • understand the benefits of HPC clusters
  • know the basics about system architecture
  • have gained knowledge about the difference of shared memory CPU-nodes​ and distributed memory system​s
  • be able to properly connect to the bwUniCluster 2.0
  • know about the file systems, environment module system, data transfer on the bwUniCluster 2.0
  • have a detailed understanding about the most important commands (of the batch system) on the bwUniCluster 2.0

Prerequisites: The background of Linux as well as the most important concepts and tools of Linux should be known, e.g.

  • Shell and shell commands (→safe use of the command line),
  • secure shell,
  • the handling of files and scripts,
  • the structure of the system,
  • the user and rights management and
  • creating simple batch scripts with an editor like nano, vi or emacs.

If you still notice deficits in this respect, we refer you at this point to https://www.tuxcademy.org/product/lxes/.

Date & Location

Online Webex, HLRS, University of Stuttgart, Germany

  • Online Web-Seminar: Tuesday 22.03.2022, 09:00 – 12:00 CET

Webex-Invitation will be sent directly by e-mail to the registered participants.

Registration and further information

Further upcoming courses 2022 that may be of interest for you:

You can not fit our course dates into your busy schedule? Please let us know. We will offer further course dates if there will be more prospective attendees.

bwHPC HPC Course Training

Latest Posts

Genoa Nodes Delivered

The AMD Genoa, Machine Learning and AI partitions for NEMO2 were delivered on December 4th. The acceptance of the storage has been delayed, so that NEMO2 could not yet start this year. However, calculations with the Milan nodes in NEMO1 are still possible.

End of Life and Milan Nodes in NEMO1

The Genoa partition for NEMO2 will be delivered on December 4th, at the same time all old NEMO1 nodes will be removed. To ease the transition, some new Milan nodes will be booted into NEMO1 environment and will remain available until at least January 31st. Users are encouraged to switch to the new Milan nodes and use the ‘milan’ queue for their jobs (-q milan). If demand increases, additional nodes will be added next week. The launch of NEMO2 is delayed due to unavailable storage, with further updates on testing and data transfer to follow once it becomes available.

Storage and Milan Partition Delivered

The Weka Storage and Milan partition have been successfully delivered for the new NEMO2 cluster. Testing, benchmarking, and system configuration will take place in the coming weeks. We anticipate starting with limited functionality and gradually expanding it over time. A portion of the old NEMO cluster had to be shut down to accommodate the installation of the Milan partition.