High Performance Computers  (KDM)

The Computing Services Department is responsible for the maintenance and expansion of KDM. The computing resources of the Center are interconnected by the WCSS internal network and connected to the Wrocław Academic Computer Network (WASK). 

In 2024, the Lem cluster was launched, the Center's newest computing machine, which in June 2024 ranked 80th on the TOP500 list of the world's fastest computers.

The Lem supercomputer infrastructure combines CPU and GPU computing machines. The CPU partition consists of 188 nodes, 23,808 cores, and 279 TB of RAM. The GPU partition consists of 76 nodes equipped with 304 NVIDIA H100 accelerators connected via NVLink technology with 96 GB of cache per accelerator.

In addition, the cluster is equipped with 64 service nodes, including: 40 GPU nodes (NVIDIA A30), 24 CPU nodes (48 cores per node). The CPU and GPU computing nodes are equipped with 1.5 TB and 1 TB of RAM, respectively. The network is based, among other things, on InfiniBand 4x NDR 200 Gb/s interfaces for GPU nodes; 2x NDR 200 Gb/s for CPU nodes and 2x HDR 100 Gb/s for service nodes. The total computing power of the system is 21 Pflops.

Cluster storage:

• Disks shared using the NFS, HTTP(s), and CIFS network protocols – 2 PB of space, 6 GB/s bandwidth,
• Disks shared using the LUSTRE network protocol – a total of 2 PB of space (permanent and temporary),100 Gb/s bandwidth,
• S3 object storage – 6 PB, bandwidth 200 Gb/s,
• Local temporary storage space of supercomputer nodes – a total of 1 PB NVME.

The cluster was created thanks to funding from the EuroHPC PL project and the CLARIN-PL-BIZ project, among others.

In June 2021, the Center launched its Bem 2 cluster, currently with the following parameters: 

• access node for local users of KDM WCSS: ui.wcss.pl
• computing power: 2,2 PFLOPS
• operating system: Alma Linux
• microarchitecture: Cascade Lake
• CPU cores: 24 288
• RAM: 141 TB
• temporary space: 750 TB Lustre
• 506 computing nodes:
  •  277 HUAWEI CH121L V5 nodes consisting of:
    • CPU: 2 x Intel Xeon Platinum 8268 (24 cores, 2,9 GHz)
    • RAM: 192 GB 2933 MHz ECC DDR4
    • network card: Infiniband EDR 100 Gbps
  • 229 węzłów HUAWEI CH121L V5 consisting of:
    • CPU: 2 x Intel Xeon Platinum 8268 (24 cores, 2,9 GHz)
    • RAM: 384 GB 2933 MHz ECC DDR4
    • network card: Infiniband EDR 100 Gbps

• computing network: Interconnect Infiniband EDR, capacity up to 100 Gbps, ultra-low delay (on the order of microseconds)
• software available on the Bem 2 cluster.

The scientific software used on the clusters includes: Gaussian, Quantum ESPRESSO, SLURM Workload Manager. The KDM team supports researchers in preparing and launching computing operations, compiling software and optimizing applications.

The WCSS computers can be used free of charge, on the basis of the so-called computing grants. Grant applications are accepted continuously.