CoolMUC-2: Open issues after the Cluster Hardware and Software Upgrade

Version 2020.R1

Version 2019.R3

Version 2019.R2

all older versions of ANSYS Mechanical are not able to run due to library dependency errors

All ANSYS Mechanical tests were based on Intel MPI 2018 (provided through SPACK). Working moduls published, documentation updated.

Version 2020.R1 - (with Intel MPI 2018)

Version 2019.R3 - (with Intel MPI 2018)

Version 2019.R2 - (with Intel MPI 2018)

Version 2019.R1 - (with Intel MPI 2018)

Version 19.2 - works only with IBM-MPI : "-mpi=ibmmpi -pib.dapl", see documentation and module comments

Version 19.1 - works only with IBM-MPI : "-mpi=ibmmpi -pib.dapl", see documentation and module comments

Earlier ANSYS Fluent versions 19.1 and 19.2 are provided, but are no longer recommended and will be retired soon.
Working modules of ANSYS CFX published on the module system. ANSYS Fluent documentation updated.

Version 2020.R1 (with Intel MPI 2018)

Version 2019.R3 (with Intel MPI 2018)

Version 2019.R2 (with Intel MPI 2018)

Version 2019.R1 (with Intel MPI 2018)

Version 19.2 (with Intel MPI 2018, also the software originally uses Intel MPI 2017 - to be retired soon!)

Version 19.1 (with Intel MPI 2018, also the software originally uses Intel MPI 2017 - to be retired soon!)

Working modules of ANSYS CFX published on the module system. ANSYS CFX documentation updated.

concerns HFSS and Maxwell-2d/-3d : SLES15 is a not supported OS; therefore almost guaranteed not to work on CM2

HFSS and Maxwell, Version 2019.R3 work under SLURM on SLES12 on CoolMUC-3.

Tested Version 5.5 (best chance to get it running):

https://www.comsol.de/system-requirements (SLES 15 is supported)
https://www.comsol.com/support/knowledgebase/1001 (Slurm is supported)

Internal MPI Support: Intel(R) MPI Library, Version 2018 Update 2 Build 20180125 (id: 18157)

External MPI Support: via -mpiroot flag

• GUI on login nodes works
• For single node share memory
• For >=2 Nodes:
  • nach module load intel-mpi/2018.4.274
    comsol batch -mpibootstrap slurm -mpifrabrics shm:ofa -inputfile micromixer_clean.mph -outputfile out_cm2.mph -study std1 -tmpdir $TMPDIR -mpidebug 10

Version 20182 -  - tested

Version 20190 -  - tested

Version 20191 -  - tested

Version 20200 -  - tested

starccm

starccm_dp

Version 2020.1.1 - fixed for Intel MPI 2018 : "-mpi intel", works with "-mpi openmpi -fabric ofi";

Version 2020.1 - fixed for Intel MPI 2018 : "-mpi intel", works with "-mpi openmpi -fabric ofi";

Version 2019.3.1 - fixed for Intel MPI 2018 : "-mpi intel", works with "-mpi openmpi -fabric ofi";

Version 2019.2.1 - tested and working with Intel MPI 2018 : "-mpi intel", works with "-mpi openmpi -fabric ibv";

Working modules of StarCCM+ published on the module system. StarCCM+ documentation updated.

SPACK module provided and successfully tested. 

As long as cgroups is deactivated (see list entry below), no Out-of-Memory errors at the end of Intel MPI 2018 jobs should occure anymore.

• Matlab itself works (batch jobs, interactive mode)
• Slurm jobs, submitted from MPS, fixed

g++ compiler requires libivonv.so for linking (module marked with -g++=broken). Use the new module with the -fixed suffix, if you encounter the problem. Will be resolved in the release version of the spack software stack.