[MITgcm-support] Derecho environment?

[Takaya Uchida]

Hi Jay,

I’ve got a configuration running on Derecho but the modules I load are:

module load ncarenv/23.06 craype/2.7.20 intel-classic/2023.0.0 ncarcompilers/1.0.0 cray-mpich/8.1.25 hdf5/1.12.2 netcdf/4.9.2

And the opt file I use is:

#

# Build options for Derecho at NCAR

#


FC=ftn

CC=cc

DEFINES='-DALLOW_USE_MPI -DALWAYS_USE_MPI -DWORDLENGTH=4 -DNML_TERMINATOR'

CPP='cpp -P -traditional'

EXTENDED_SRC_FLAG='-132'

NOOPTFLAGS='-O2 -g -march=core-avx2'

LIBS=''

INCLUDES='-I/opt/cray/pe/mpich/8.1.25/ofi/intel/19.0/include/'


if test "x$DEVEL" != x ; then

    FFLAGS="$FFLAGS  -W0 -WB -convert big_endian -assume byterecl -fPIC -O0 -g -noalign -fpstkchk -check all -fpe0 -traceback -ftrapuv -fpmodel except -warn all -march=core-avx2"

else

    FFLAGS="$FFLAGS  -W0 -WB -convert big_endian -assume byterecl -fPIC -march=core-avx2 -g"

fi


if test "x$IEEE" = x ; then

        FOPTIM='-O2 -align -ip'

        else

        FOPTIM='-O2 -align -ip -mp'

fi

CFLAGS='-O2 -ip -fPIC'

Best,
Takaya
————————
Assistant Research Scientist
Center for Ocean-Atmospheric Prediction Studies (COAPS)
Florida State University, USA
https://roxyboy.github.io/







On Nov 3, 2023, at 12:00 PM, Brett, Jay <Jay.Brett at jhuapl.edu> wrote:

Hi all,
I’m working to get the B-SOSE version of MITgcm compiled on the new NCAR supercomputer Derecho (successor to Cheyenne). If anyone has an environment working for MITgcm on there, please share. Below, I’m listing some options that I’ve tried and failed with.


I used the suggest_optfile_names to confirm compilers:
C:     icx gcc cc mpicc
FORTRAN:     ifort mpif77

My old Cheyenne working environment was:
1) ncarenv/1.3   2) intel/17.0.1   3) ncarcompilers/0.5.0   4) mpt/2.15f (H)   5) netcdf/4.4.1.1 (H)
But I haven’t found any mpt options on Derecho.

The default Derecho environment is:
1) ncarenv/23.06  (S)   4) ncarcompilers/1.0.0   7) netcdf/4.9.2
  2) craype/2.7.20        5) cray-mpich/8.1.25
  3) intel/2023.0.0       6) hdf5/1.12.2
Which gave compile errors of not finding mpif.h.

I tried Intel rather than Cray:
  1) ncarenv/23.06  (S)   4) ncarcompilers/1.0.0   7) netcdf/4.9.2
  2) craype/2.7.20        5) intel-mpi/2021.8.0
  3) intel/2023.0.0       6) hdf5-mpi/1.12.2
Which gave compile errors of not finding a bunch of mpi functions (wait, send, allreduce, etc).

Trying to update an old specific Cheyenne build_options file, rather than using the generic linux_amd64_ifort, suggests I may be having an issue with '-march=core-avx2' vs '-march=corei7', but I’m not sure either of those is correct.

This is by no means an exhaustive (or systematic) attempt, I am hoping that one of you can short-circuit the need for that.
Thank you all,
Jay


Dr. Jay Brett (they/them/theirs)
Senior Professional Staff, Johns Hopkins APL
Jay.Brett at jhuapl.edu<mailto:Jay.Brett at jhuapl.edu>
Phone (240)592-1037
11100 Johns Hopkins Rd, Bldg 8, Laurel MD


_______________________________________________
MITgcm-support mailing list
MITgcm-support at mitgcm.org<mailto:MITgcm-support at mitgcm.org>
https://urldefense.com/v3/__http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support__;!!PhOWcWs!xIzfe7_BHDnKB3QQjpeqJDs8pRHOhrLLqktEfnv95NRaYd6NLJSWzWvZ6OqFUpMaRiX9M_2NAAc1C9xe4ZgK$

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.mitgcm.org/pipermail/mitgcm-support/attachments/20231103/46f2a65b/attachment-0001.html>