[MITgcm-devel] issue on Pleiades /nobackupnfs2 "Device or resource busy" in mdsio_read_whalos.f

[Patrick Heimbach]

Hi there,

Yoshihiro Nakayama reported a problem when running the adjoint on Pleiades using 
#ALLOW_AUTODIFF_WHTAPEIO

The following problem is reproducible on /nobackupnfs2, but *not* on /nobackupp8

/////// error messages ///
forrtl: Device or resource busy
forrtl: severe (39): error during read, unit 1001, file /nobackupnfs2/ychang1/ECCO_from_ynakaya2/for_Patric_3/run/tapes2.007.data
Image              PC                Routine            Line        Source
libifcore.so.5     00002AAAAB2C32EB  Unknown               Unknown  Unknown
libifcore.so.5     00002AAAAB2E7C14  Unknown               Unknown  Unknown
mitgcmuv_ad        0000000000A4D595  mds_read_whalos_         1950  mdsio_read_whalos.f
mitgcmuv_ad        0000000000A4C6EF  adread_                  2377  adread_adwrite.f
mitgcmuv_ad        0000000000412C62  adthe_main_loop_.      298405  ad_taf_output.f
mitgcmuv_ad        00000000004039CB  the_model_main_          2966  the_model_main.f
mitgcmuv_ad        0000000000402D22  MAIN__                   4651  main.f
mitgcmuv_ad        0000000000402A4E  Unknown               Unknown  Unknown
libc.so.6          00002AAAAD009C36  Unknown               Unknown  Unknown
mitgcmuv_ad        0000000000402959  Unknown               Unknown  Unknown
///// end of error /////

NAS engineers were able to reproduce this problem (even in a much simpler reproducer code),
and suggest workaround that involves commitqq to flush the data to disk before reading it back.
(email exchange with Sherry.Chang at nasa.gov and Johnny.Chang at nasa.gov).

Corresponding change has been included in mdsio_read_whalos.F, bracketed by
#ifdef INTEL_COMMITQQ
...
#endif

Corresponding #define has been added to optfile
linux_amd64_ifort+mpi_ice_nas

-Patrick

--------------------------------------------------------
Patrick Heimbach, Ph.D. | http://heimbach.wordpress.com

* The University of Texas at Austin *
The Institute for Computational Engineering and Sciences
Institute for Geophysics | Jackson School of Geosciences
201 East 24th Street, POB 4.232 | Austin, TX 78712 | USA
FON: +1-512-232-7694 | Email: heimbach at utexas.edu

* Massachusetts Institute of Technology *
Department of Earth, Atmospheric, and Planetary Sciences
77 Massachusetts Ave, 54-1420 | Cambridge MA 02139 | USA
FON: +1-617-253-5259 | Email: heimbach at mit.edu
--------------------------------------------------------




-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 1849 bytes
Desc: not available
URL: <http://mitgcm.org/pipermail/mitgcm-devel/attachments/20160920/9489f814/attachment.p7s>