[MITgcm-support] jobs died suddenly

[Martin Losch]

Hi Yangxin,

something is happening in S/R MDS_READ_SEC_YZ (in pkg/mdsio/mdsio_read_section.F)
The error message can have at least 5 different reasons, but we cannot know which, because you didn’t provide that infromation (probably somewhere in STDOUT.* or STDERR.*).

Martin

> On 25. Mar 2020, at 20:24, Yangxin He <y67he at uwaterloo.ca> wrote:
> 
> Hello there,
> 
> Recently several jobs of mine died of no reason. The error message is
> [y67he at gra-login1 b6]$ more sim-29315632.err 
> ABNORMAL END: S/R MDS_READ_SEC_YZ
> srun: Job step aborted: Waiting up to 62 seconds for job step to finish.
> slurmstepd: error: *** JOB 29315632 ON gra228 CANCELLED AT 2020-03-25T08:30:08 DUE TO TIME LIMIT ***
> slurmstepd: error: *** STEP 29315632.0 ON gra228 CANCELLED AT 2020-03-25T08:30:08 DUE TO TIME LIMIT ***
> The time limit was not the problem. The code simply stopped producing any new results, however, it was still running.
> This is confusing, because I have been using the same set up for a while and this only started to happen in the past few weeks.
> 
> I ran my code on graham in compute Canada, and the people there suggested it may be the problem in the code.
> Can anyone shed any lights on this?
> 
> Thanks
> 
> Yangxin
> _______________________________________________
> MITgcm-support mailing list
> MITgcm-support at mitgcm.org
> http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support