Zeon

New Opterox-Login

Server is zeon.physik.uni-due.de, home directories are the same.

Queueing system = Slurm

• sinfo shows overall load and available queues (partitions). The default one is marked with *.
• squeue shows running jobs.
• simplest submission: sbatch -nn script-name
• scancel job-id kills job.

Intel oneAPI

Intel compilers, MKL and MPI are installed, must be selected via the module system:

module use /opt/intel/oneapi/modulefiles (unless you include that directory in your MODULEPATH)

• module avail lists the installed modules, relevant are:
  • compiler/latest → icx, icpx, ifx, ... (the new Intel compilers)
  • icc/latest → icc, icpc (the deprecated C/C++ compilers)
  • ifort/latest → ifort (the deprecated Fortran compiler)
  • mpi/latest → mpirun, mpiicx, mpiicpx, mpiifx, mpiicc, mpiicpc, mpiifort, ... (Attention: The mpii*s are only wrappers; the actual compiler module needs to be loaded, too.)
  • mkl/latest
• module load ... loads a module.

Inside a shell script (bash), you have to do shopt -s expand_aliases in order to be able to use the module command.

Pitfalls

• The module system fails to reach some Intel libraries (like libcilkrts.so.5^*). If needed, their path has to be found out and appended:
  export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/intel/oneapi/...
• ifort/mpiifort: When compiling with -i8, you also have to link with -i8 (cf. also manual).

^*: currently in /opt/intel/oneapi/compiler/2023.2.4/linux/bin/intel64

OpenMPI

• The setting export OMPI_MCA_pml=ucx is necessary to prevent a "failed OFI Libfabric library call".