<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Dear MITgcm support,<div class=""><br class=""></div><div class="">I have a run on Cheyenne, which runs fine without the diagnostics package turned on but fails within seconds once I turn the package on and it gives me no useful errors except for:</div><div class=""><br class=""></div><div class=""><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">MPT ERROR: MPI_COMM_WORLD rank 1589 has terminated without calling MPI_Finalize()</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>aborting job</span></div></div><div class=""><br class=""></div><div class="">I use the same namelist files, which run fine on the Columbia University Habanero cluster so my expectation was that it should all work fine. I am a bit lost here and would like to know if others have had related issues running MITgcm on Cheyenne.</div><div class=""><br class=""></div><div class="">The optfile I use, which can also be found here ( <a href="https://github.com/roxyboy/ChannelMOC_Cheyenne/tree/master/SO_only-physics/channel_flat" class="">https://github.com/roxyboy/ChannelMOC_Cheyenne/tree/master/SO_only-physics/channel_flat</a> ) including the namelist files, is:</div><div class=""><br class=""></div><div class=""><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">module load intel/17.0.1 mpt/2.15f netcdf/4.6.1</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961); min-height: 19px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">FC=mpif90</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">CC=mpicc</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">F90C=mpif90</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961); min-height: 19px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">DEFINES=</span><span style="font-variant-ligatures: no-common-ligatures" class="">'-DALLOW_USE_MPI -DALWAYS_USE_MPI -DWORDLENGTH=4'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">CPP=</span><span style="font-variant-ligatures: no-common-ligatures" class="">'/lib/cpp -traditional -P'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">EXTENDED_SRC_FLAG=</span><span style="font-variant-ligatures: no-common-ligatures; color: #c33720" class="">'-132'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">OMPFLAG=</span><span style="font-variant-ligatures: no-common-ligatures" class="">'-openmp'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">CFLAGS=</span><span style="font-variant-ligatures: no-common-ligatures; color: #c33720" class="">'-fPIC'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">LDADD=</span><span style="font-variant-ligatures: no-common-ligatures" class="">'-shared-intel'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961); min-height: 19px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">LIBS=</span><span style="font-variant-ligatures: no-common-ligatures" class="">"-L${MPI_ROOT}/lib"</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">INCLUDES=</span><span style="font-variant-ligatures: no-common-ligatures" class="">"-I${MPI_ROOT}/include"</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">NOOPTFLAGS=</span><span style="font-variant-ligatures: no-common-ligatures; color: #c33720" class="">'-O0 -fPIC'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961); min-height: 19px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(82, 48, 225); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">#FFLAGS="-fPIC -convert big_endian -assume byterecl -align -xCORE-AVX2" # 4% slower with -O2</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">FFLAGS=</span><span style="font-variant-ligatures: no-common-ligatures" class="">"-fPIC -convert big_endian -assume byterecl -align"</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">FDEBUG=</span><span style="font-variant-ligatures: no-common-ligatures" class="">'-W0 -WB'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">FFLAGS=</span><span style="font-variant-ligatures: no-common-ligatures" class="">"$FDEBUG $FFLAGS"</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961); min-height: 19px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(40, 254, 20); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">FOPTIM=</span><span style="font-variant-ligatures: no-common-ligatures; color: #c33720" class="">'-O3'</span></div><div style="margin: 0px; font-size: 14px; line-height: normal; font-family: Monaco; color: rgb(195, 55, 32); background-color: rgba(0, 0, 0, 0.901961);" class=""><span style="font-variant-ligatures: no-common-ligatures; color: #28fe14" class="">FOPTIM=</span><span style="font-variant-ligatures: no-common-ligatures" class="">"$FOPTIM -ip -fp-model precise -traceback -ftz"</span></div></div><div class=""><br class=""></div><div class="">Any advice would be appreciated.</div><div class=""><br class=""></div><div class="">Thank you,</div><div class="">Takaya</div><div class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">———————</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;">PhD Candidate</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">Physical Oceanography</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">Columbia University in the City of New York</div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="https://roxyboy.github.io/" class="">https://roxyboy.github.io/</a></div></div></div>
</div>
<br class=""></div></body></html>