<div dir="ltr">I might be able to increase the amount of processors to 72. I don't mind changing the overall size and will also try that to get to 72. Is there any special reason other than increasing the number of processors for factorizable numbers? <div><br></div><div>Are there other areas where we can cut time without significantly changing the model?</div><div><br></div><div>Thanks so much for the advice! </div><div><br></div><div>Nadav</div></div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Tue, Mar 4, 2025 at 1:16 AM Dimitris Menemenlis <<a href="mailto:dmenemenlis@gmail.com">dmenemenlis@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>Oh my! These are not very factorizable numbers. How many processors do you have available?<div><br></div><div>“If” you have more processors available and “if” you do not mind changing the overall size of your domain a little bit, you could really speed-up your computation.</div><div><br></div><div>For example:</div><div><br></div><div>prime factors of 558: 1, 2, 3, 6, 9, 18, 31, 62, 93, 186, 279, 558</div><div><br></div><div>prime factors of 3400: 1, 2, 4, 5, 8, 10, 17, 20, 25, 34, 40, 50, 68, 85, 100, 136, 170, 200, 340, 425, 680, 850, 1700, 3400</div><div><br></div><div>If you were to split a 558x3400 domain in 18x17 or 18x20 tiles, you could speed up the computation by two orders of magnitude.</div><div><br></div><div>Cheers, D.</div><div><br></div><div><div><br><blockquote type="cite"><div>On Mar 3, 2025, at 4:54 AM, Nadav Mantel <<a href="mailto:nadav.mantel@mail.huji.ac.il" target="_blank">nadav.mantel@mail.huji.ac.il</a>> wrote:</div><br><div><div dir="ltr">Hi Dimitris,<img alt="ltp|17409063968802496" src="https://lav2.me/p.png?pixel_id=17409063968802496" style="display: none; width: 0px; height: 0px; border: none; padding: 0px; margin: 0px; outline: none; font-size: 0px; line-height: 0; text-indent: 0px; background: transparent;"><div><br></div><div>Thanks for the reply.</div><div><br></div><div>Yes, below is the SIZE.h file:</div><div><br></div><div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>sNx = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">139</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>sNy = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">283</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>OLx = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">3</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>OLy = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">3</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>nSx = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">1</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>nSy = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">1</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>nPx = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">4</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>nPy = <span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">12</span><span style="font-variant-ligatures:no-common-ligatures">,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>Nx<span> </span>= sNx*nSx*nPx,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>Ny<span> </span>= sNy*nSy*nPy,</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>& <span> </span>Nr<span> </span>=<span> </span></span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(202,51,35)">32</span><span style="font-variant-ligatures:no-common-ligatures">)</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo"><span style="font-variant-ligatures:no-common-ligatures"><br></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;line-height:normal"><font face="arial, sans-serif"><span style="font-variant-ligatures:no-common-ligatures">We split it into 48 processes. Any suggestions?</span></font></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;line-height:normal"><font face="arial, sans-serif"><span style="font-variant-ligatures:no-common-ligatures"><br></span></font></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-size-adjust:none;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;line-height:normal"><font face="arial, sans-serif"><span style="font-variant-ligatures:no-common-ligatures">Thanks</span></font></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Mar 3, 2025 at 3:54 AM Dimitris Menemenlis <<a href="mailto:dmenemenlis@gmail.com" target="_blank">dmenemenlis@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>I am assuming that you already have done the obvious of splitting your 556x3396 domain into smaller tiles and increased the number of processes that you are using so as to reduce computational load per process?<br id="m_7464578511309566120m_-7653730496415760393lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On Feb 25, 2025, at 5:11 AM, Nadav Mantel <<a href="mailto:nadav.mantel@mail.huji.ac.il" target="_blank">nadav.mantel@mail.huji.ac.il</a>> wrote:</div><br><div><div style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">I am attempting to run a high-resolution model of the Gulf of Aqaba. We are attempting to simluate a desalination plant's long term effects, but the addmass on a coarse grid doesn't simulate the salt plume as a singular point increases the salinity of a cell only slightly. Therefore, we increased the horizontal grid resolution to 60x60 meters, with 32 depth levels with depths ranging from 5 meters to 255 meters. Due to the high resolution, the CFL requires a maximum timestep of 30 sec before the model crashes. We want to run a hydrostatic simulation for two years which will result in a very long simulation. </div><div style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><br></div><div style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">Does anyone have any tips on how to reduce runtime? We tried to increase the timestep by changing the A4 and Ah max values and also use useFullLeith but they didn't really help. </div><br></div></blockquote></div><p style="margin:0px;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal"></p><blockquote type="cite"><div style="margin:0px;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>delX <span> </span>= 556*60,</span></div><div style="margin:0px;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>delY <span> </span>= 3396*60,</span></div></blockquote><br></div>_______________________________________________<br>
MITgcm-support mailing list<br>
<a href="mailto:MITgcm-support@mitgcm.org" target="_blank">MITgcm-support@mitgcm.org</a><br>
<a href="http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support" rel="noreferrer" target="_blank">http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support</a><br>
</blockquote></div>
_______________________________________________<br>MITgcm-support mailing list<br><a href="mailto:MITgcm-support@mitgcm.org" target="_blank">MITgcm-support@mitgcm.org</a><br><a href="http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support" target="_blank">http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support</a><br></div></blockquote></div><br></div></div>_______________________________________________<br>
MITgcm-support mailing list<br>
<a href="mailto:MITgcm-support@mitgcm.org" target="_blank">MITgcm-support@mitgcm.org</a><br>
<a href="http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support" rel="noreferrer" target="_blank">http://mailman.mitgcm.org/mailman/listinfo/mitgcm-support</a><br>
</blockquote></div>