[MITgcm-support] bluesky run

[Mike Spall]

Constantinos et al,

Thanks for the suggestion to remove -qhot, that compiles much
faster.  Now for the next problem (keeping in mind that I know
very little of MPI and NCAR machines).  I tried to run the
following script using llsubmit
(I am not showing all the file copies, etc):
#
#@output=./out
#@error=err
#@job_type=parallel
#@network.MPI=csss,shared,US
#@node=1
#@tasks_per_node=4
#@wall_clock_limit=00:02:00
#@class=share
#@queue

#
./mitsrc

==================================================
and get the following error:


ATTENTION: 0031-408  4 tasks allocated by LoadLeveler, continuing...
ERROR: 0032-136 Invalid communicator  (91) in MPI_Comm_rank, task 0
ERROR: 0032-136 Invalid communicator  (91) in MPI_Comm_rank, task 1
ERROR: 0032-136 Invalid communicator  (91) in MPI_Comm_rank, task 3
ERROR: 0032-136 Invalid communicator  (91) in MPI_Comm_rank, task 2
ERROR: 0031-250  task 1: Terminated
ERROR: 0031-250  task 3: Terminated
ERROR: 0031-250  task 0: Terminated
ERROR: 0031-250  task 2: Terminated
============================================================

I e-mailed the scd consultant and she sent this:
It seems your job submit script is fine. But the error message is little
weird if I assume that you are trying out exactly the same code and
data that had been successful in linux platform.

The error message seems to indicate that you're calling MPI_Comm_rank
before initializing the communicator that you have been using in the
context.  Perhaps one of the most simple cases this error message will
appear if you call MPI_Init and then straight MPI_Comm_rank without
calling MPI_Comm_size. Certainly, this is not the only way to get this
error.

We need to look at your source (if it is not too big or even if it is
big you can point me the section which contains this stuff) in case you
want us give you more specific advice.

-- 
==================================================

Michael A. Spall
Senior Scientist
Department of Physical Oceanography
W.H.O.I. MS #21
360 Woods Hole Road
Woods Hole, MA   02543

mspall at whoi.edu
(508) 289-3342 (office)
(508) 457-2181 (fax)

=================================================