[MITgcm-support] MITgcm virtual memory usage
Jordan Dawe
jdawe at eos.ubc.ca
Fri Sep 22 12:41:20 EDT 2006
>>> But, really, who cares what the virtual memory usage is? What
>>> difference does it make? The main thing that matters is whether
>>> your model fits in memory or not. If it spills over into swap
>>> then you have a huge performance hit. But if you can hold the
>>> entire problem in RAM (without digging into swap on a continual
>>> basis) then what difference does it make whether you use a few
>>> more MB of RAM or not?
>>>
>> It matters because I want to upscale this run to a cluster with
>> slave nodes that have 2GB of RAM and no swap. If I can get rid of
>> the 60% of allocated ram that MITgcm doesn't use, I can double the
>> vertical resolution of the model. That matters to me.
>>
>
> I think you're missing the bigger picture. VM OSes (eg. Linux) are
> generally allowed to overcommit even when there is no swap device.
> Therefor, you can have a program that allocates a larger chunk of
> memory than exists and, so long as parts of that memory are never
> actually paged in, then its fine--it will run.
>
My apologies; you are correct. I was confusing >2GB memory space
allocation errors with being out of RAM.
More information about the MITgcm-support
mailing list