[MITgcm-support] FW: exf_interp_read/singleCPUIO - correction
Enright, Clare
mce at bas.ac.uk
Thu Dec 16 12:19:11 EST 2010
Hi Jean-Michel,
I'm running MPI only and don't have EXF_IREAD_USE_GLOBAL_POINTER defined.
Clare
-----Original Message-----
From: mitgcm-support-request at mitgcm.org [mailto:mitgcm-support-request at mitgcm.org]
Sent: 16 December 2010 17:00
To: mitgcm-support at mitgcm.org
Subject: MITgcm-support Digest, Vol 90, Issue 9
Send MITgcm-support mailing list submissions to
mitgcm-support at mitgcm.org
To subscribe or unsubscribe via the World Wide Web, visit
http://mitgcm.org/mailman/listinfo/mitgcm-support
or, via email, send a message with subject or body 'help' to
mitgcm-support-request at mitgcm.org
You can reach the person managing the list at
mitgcm-support-owner at mitgcm.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of MITgcm-support digest..."
Today's Topics:
1. Re: calendar package (Nico Wienders)
2. Re: calendar package (Patrick Heimbach)
3. Re: FW: exf_interp_read/singleCPUIO - correction
(Jean-Michel Campin)
----------------------------------------------------------------------
Message: 1
Date: Wed, 15 Dec 2010 13:13:55 -0500
From: Nico Wienders <wienders at fsu.edu>
To: mitgcm-support at mitgcm.org
Cc: "William K. Dewar" <dewar at ocean.fsu.edu>
Subject: Re: [MITgcm-support] calendar package
Message-ID: <C3BB05E6-BE0A-45AD-BB91-1BCD8748C8C2 at fsu.edu>
Content-Type: text/plain; charset="windows-1252"
On Dec 14, 2010, at 8:15 PM, Patrick Heimbach wrote:
> 2. to run, add "useCAL=.true." to data.pkg and provide file data.cal
> (in certain cases, e.g. when using exf, useCAL is initialized to .true.)
> Example is verification/global_with_exf
?Ok, but nowadays useCAL is no more part of the namelist in
packages_boot. F:
http://mitgcm.org/viewvc/MITgcm/MITgcm/model/src/packages_boot.F?view=markup
?Adding useCAL in data.pkg of course brings an error:
PGFIO-F-239/namelist read/unit=11/entity name is not member of group.
File name = /tmp/FTNBX6betWv45qXT formatted, sequential access record = 7
In source file packages_boot.f, at line number 1776
?Also, a thread from May 2008 recommends not to use useCAL anymore:
http://mitgcm.org/pipermail/mitgcm-support/2008-May/005491.html
?But as you say there is a hard-coded switch indeed in packages_boot.F
and that seems to now be enough.
C-- packages with hard-coded switch
#ifdef ALLOW_CAL
IF (useEXF) useCAL = .TRUE.
Cheers.
Nico Wienders
Florida State University - Earth, Ocean and Atmospheric Science - OSB415
117 N. Woodward Avenue, Tallahassee, FL 32306-4320 - wienders at fsu.edu
(850) 644-1987 (office) | (850) 294-3542 (cell) | (850) 644-2581 (fax)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mitgcm.org/pipermail/mitgcm-support/attachments/20101215/2e3084b6/attachment.html>
------------------------------
Message: 2
Date: Wed, 15 Dec 2010 10:28:10 -0800
From: Patrick Heimbach <heimbach at MIT.EDU>
To: "mitgcm-support at mitgcm.org" <mitgcm-support at mitgcm.org>
Cc: "William K. Dewar" <dewar at ocean.fsu.edu>,
"mitgcm-support at mitgcm.org" <mitgcm-support at mitgcm.org>
Subject: Re: [MITgcm-support] calendar package
Message-ID: <E7D06072-3CA2-49CD-A099-2FFF064BABA3 at mit.edu>
Content-Type: text/plain; charset="utf-8"
Yep,
sorry my first part in answer to you was wrong (too quick - I'm on travel, and getting old).
But glad 2nd part did the trick.
p
---
Patrick Heimbach
Work: +1-617-253-5259
Mobile: +1-617-642-3481
http://www.mit.edu/~heimbach
On Dec 15, 2010, at 10:13, Nico Wienders <wienders at fsu.edu> wrote:
>
> On Dec 14, 2010, at 8:15 PM, Patrick Heimbach wrote:
>
>> 2. to run, add "useCAL=.true." to data.pkg and provide file data.cal
>> (in certain cases, e.g. when using exf, useCAL is initialized to .true.)
>> Example is verification/global_with_exf
>
>
> ?Ok, but nowadays useCAL is no more part of the namelist in
> packages_boot. F:
>
> http://mitgcm.org/viewvc/MITgcm/MITgcm/model/src/packages_boot.F?view=markup
>
>
> ?Adding useCAL in data.pkg of course brings an error:
>
> PGFIO-F-239/namelist read/unit=11/entity name is not member of group.
> File name = /tmp/FTNBX6betWv45qXT formatted, sequential access record = 7
> In source file packages_boot.f, at line number 1776
>
>
> ?Also, a thread from May 2008 recommends not to use useCAL anymore:
> http://mitgcm.org/pipermail/mitgcm-support/2008-May/005491.html
>
>
> ?But as you say there is a hard-coded switch indeed in packages_boot.F
> and that seems to now be enough.
>
> C-- packages with hard-coded switch
> #ifdef ALLOW_CAL
> IF (useEXF) useCAL = .TRUE.
>
>
> Cheers.
>
>
>
>
> Nico Wienders
>
> Florida State University - Earth, Ocean and Atmospheric Science - OSB415
> 117 N. Woodward Avenue, Tallahassee, FL 32306-4320 - wienders at fsu.edu
> (850) 644-1987 (office) | (850) 294-3542 (cell) | (850) 644-2581 (fax)
>
> _______________________________________________
> MITgcm-support mailing list
> MITgcm-support at mitgcm.org
> http://mitgcm.org/mailman/listinfo/mitgcm-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mitgcm.org/pipermail/mitgcm-support/attachments/20101215/56d4c40b/attachment-0001.htm>
------------------------------
Message: 3
Date: Wed, 15 Dec 2010 15:14:14 -0500
From: Jean-Michel Campin <jmc at ocean.mit.edu>
To: mitgcm-support at mitgcm.org
Subject: Re: [MITgcm-support] FW: exf_interp_read/singleCPUIO -
correction
Message-ID: <20101215201414.GB24175 at ocean.mit.edu>
Content-Type: text/plain; charset=us-ascii
Hi Clare,
Are you running multi-threaded ? or just using MPI ? or both ?
And do you have EXF_IREAD_USE_GLOBAL_POINTER defined ?
Thanks,
Jean-Michel
On Wed, Dec 15, 2010 at 04:58:28PM +0000, Enright, Clare wrote:
> Actually the correction noted below DOESN'T help.
>
>
> -----Original Message-----
> From: Enright, Clare
> Sent: 15 December 2010 16:51
> To: 'mitgcm-support at mitgcm.org'
> Subject: exf_interp_read/singleCPUIO
>
> I've observed a problem on our particular architecture which manifests as one processor returning results offset from all other processors - this doesn't happen on other machines or when run as a serial job.
> I've tracked down the cause to using singleCPUio=.true. and the EXF package; i.e. I can solve it by setting singleCPUio=.false.
>
> I think the problem lies in exf_interp_read.F but I don't really understand what's happening...
> Surely MPI_BCAST is called by only the master process when it should be called by all?
> But why does turning off singleCPUio help; in this case I would have thought only the master process sees the data at all.
>
> Replacing:
>
> _BEGIN_MASTER( myThid )
> #ifdef ALLOW_USE_MPI
> C-- broadcast to all processes
> IF ( useSingleCPUIO ) THEN
> IF ( filePrec .EQ. 32 ) THEN
> CALL MPI_BCAST(buffer_r4,nx_in*ny_in,MPI_REAL,
> & 0,MPI_COMM_MODEL,ierr)
> ELSE
> CALL MPI_BCAST(buffer_r8,nx_in*ny_in,MPI_DOUBLE_PRECISION,
> & 0,MPI_COMM_MODEL,ierr)
> ENDIF
> ENDIF
> #endif /* ALLOW_USE_MPI */
>
> #ifdef EXF_IREAD_USE_GLOBAL_POINTER
> IF ( filePrec .EQ. 32 ) THEN
> glPtr4 => buffer_r4
> ELSE
> glPtr8 => buffer_r8
> ENDIF
> #endif
> _END_MASTER( myThid )
> _BARRIER
>
>
> with the following (i.e. remove the BEGIN_MASTER condition and include _BARRIER after the read and before the MPI_BCAST) :
>
> _BARRIER
> #ifdef ALLOW_USE_MPI
> C-- broadcast to all processes
> IF ( useSingleCPUIO ) THEN
> IF ( filePrec .EQ. 32 ) THEN
> CALL MPI_BCAST(buffer_r4,nx_in*ny_in,MPI_REAL,
> & 0,MPI_COMM_MODEL,ierr)
> ELSE
> CALL MPI_BCAST(buffer_r8,nx_in*ny_in,MPI_DOUBLE_PRECISION,
> & 0,MPI_COMM_MODEL,ierr)
> ENDIF
> ENDIF
> #endif /* ALLOW_USE_MPI */
>
> #ifdef EXF_IREAD_USE_GLOBAL_POINTER
> IF ( filePrec .EQ. 32 ) THEN
> glPtr4 => buffer_r4
> ELSE
> glPtr8 => buffer_r8
> ENDIF
> #endif
> _BARRIER
>
> - seems to solve the problem. Does this make sense?
>
> Clare
>
> Dr C. Enright,
> British Antarctic Survey
> High Cross
> Madingley Road,
> Cambridge
> CB3 0ET
> UK
> Tel: 01223 221228
>
> --
> This message (and any attachments) is for the recipient only NERC
> is subject to the Freedom of Information Act 2000 and the contents
> of this email and any reply you make may be disclosed by NERC unless
> it is exempt from release under the Act. Any material supplied to
> NERC may be stored in an electronic records management system.
> _______________________________________________
> MITgcm-support mailing list
> MITgcm-support at mitgcm.org
> http://mitgcm.org/mailman/listinfo/mitgcm-support
------------------------------
_______________________________________________
MITgcm-support mailing list
MITgcm-support at mitgcm.org
http://mitgcm.org/mailman/listinfo/mitgcm-support
End of MITgcm-support Digest, Vol 90, Issue 9
*********************************************
--
This message (and any attachments) is for the recipient only NERC
is subject to the Freedom of Information Act 2000 and the contents
of this email and any reply you make may be disclosed by NERC unless
it is exempt from release under the Act. Any material supplied to
NERC may be stored in an electronic records management system.
More information about the MITgcm-support
mailing list