[MITgcm-support] glue netcdf files efficiently

[Oliver Jahn]

On 2013-01-08 08:09, 何映晖 wrote:
> Finally, I try to use the python script /gluemncbig/. Since I don't know
> the python at all, it also doesn't work.
>
> $ gluemncbig -o state.glob.nc <http://state.glob.nc> state.0000000000.t00*
> Tiled dimensions: Yp1 Y X Xp1
> Record dimension: T
> Writing non-record variables
> Traceback (most recent call last):
>    File
> "/home/Phoenix/MITgcm_c64b/utils/python/MITgcmutils/scripts/gluemncbig",
> line 1336, in <module>
>      if progress and not verbose: sys.stderr.write('Writing {} records:
> '.format(nrec))
> ValueError: zero length field name in format
>
> Any ideas why I get those errors? Considering the files which I want to
> combine are so large (about 50G), which method is more efficient?

Hi Yinghui

the python error is because you don't have python >= 2.7 or >= 3.2. 
I've just checked in a fix for this that should work on older python. 
This script should work as long as each individual variable (or time 
record) fits in memory.  Let me know how it goes!

Oliver