<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Pavan,<br>
thanks for your reply and comments. Unfortunately, the actual
application I am running is outside my sphere of influence (though
as I am running a beta code, I will forward your thoughts in hope
they will consider them).<br>
<br>
Is there another way that does not include looking at the actual
application doing the work?<br>
<br>
Regards,<br>
Ron<br>
<br>
<div class="moz-cite-prefix">On 6/06/2014 11:48, Balaji, Pavan
wrote:<br>
</div>
<blockquote cite="mid:D117C0AE-4259-4859-BD3B-4A65F010832D@anl.gov"
type="cite">
<pre wrap="">Ron,
In general, oversubscribing the cores of a node is a bad idea. MPI is optimized for the common case where each MPI process is on at least one core, which most applications use. This, however, adds a cost when you oversubscribe, and is not recommended.
To deal with cores that operate at different speeds, the only good way is to restructure your algorithm to be more asynchronous in nature. For example, if a master-worker model is possible, that might work great. Some workers (which are running on faster cores) do more work than others. However, not all algorithms can be expressed in this model. There are other asynchronous models possible too.
In short, I think it’s time to go back to the whiteboard and see if the algorithm used by the application is appropriate or not.
— Pavan
On Jun 5, 2014, at 7:42 PM, Ron Palmer <a class="moz-txt-link-rfc2396E" href="mailto:ron.palmer@pgcgroup.com.au"><ron.palmer@pgcgroup.com.au></a> wrote:
</pre>
<blockquote type="cite">
<pre wrap="">I have a small cluster of computers with uneven clock speed CPUs and currently I am running with "-np" == total number of cores. However, it appears as if the fastest computer has to wait for the slower ones to finish at the end (at least I believe so). The most recent process took 65 hours so I am interested in finding ways to optimise the process.
Is it possible to, say, use a larger "-np" and then increase the thread number for the faster CPUs in the machine file to make the faster computers do more work so, ideally, they all finish about the same time? Will it finish off the first batch then start on the next batch? Or, will the faster computers just get more concurrent jobs, possibly slowing down the processing?
eg, if the single CPU of PC_A has twice the clock rating to that of single CPU PC_B, and both has quad cores, then use -np=12 and then have the following in the machinefile:
PC_A:8
PC_B:4
Perhaps this is something better addressed with job scheduling software like GridEngine? Reuti?
Thanks,
Ron
--
Ron Palmer MSc MBA.
Principal Geophysicist
<a class="moz-txt-link-abbreviated" href="mailto:ron.palmer@pgcgroup.com.au">ron.palmer@pgcgroup.com.au</a>
0413 579 099
07 3103 4963
_______________________________________________
discuss mailing list <a class="moz-txt-link-abbreviated" href="mailto:discuss@mpich.org">discuss@mpich.org</a>
To manage subscription options or unsubscribe:
<a class="moz-txt-link-freetext" href="https://lists.mpich.org/mailman/listinfo/discuss">https://lists.mpich.org/mailman/listinfo/discuss</a>
</pre>
</blockquote>
<pre wrap="">
_______________________________________________
discuss mailing list <a class="moz-txt-link-abbreviated" href="mailto:discuss@mpich.org">discuss@mpich.org</a>
To manage subscription options or unsubscribe:
<a class="moz-txt-link-freetext" href="https://lists.mpich.org/mailman/listinfo/discuss">https://lists.mpich.org/mailman/listinfo/discuss</a>
</pre>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<meta http-equiv="CONTENT-TYPE" content="text/html;
charset=windows-1252">
<title></title>
<meta name="GENERATOR" content="OpenOffice.org 3.3 (Win32)">
<meta name="AUTHOR" content="Ron Palmer">
<meta name="CREATED" content="20120715;16240238">
<meta name="CHANGEDBY" content="Ron Palmer">
<meta name="CHANGED" content="20120715;16254174">
<style type="text/css">
<!--
@page { margin: 2cm }
P { margin-bottom: 0.21cm }
P.western { so-language: en-AU }
A:link { so-language: zxx }
-->
</style>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"><font
color="#0000a2"><font face="Times New Roman"><font size="3"><span
lang="en"><b>Ron
Palmer</b></span></font></font></font><font
color="#000000"> </font><font color="#000000"><font size="2"><span
lang="en">MSc
MBA</span></font></font><font color="#000000"><span
lang="en">. </span></font>
</p>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"
lang="en">
<font color="#000000"><font face="Times New Roman"><font
size="3">Principal
Geophysicist</font></font></font></p>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"><a
href="mailto:ron.palmer@pgcgroup.com.au"><font color="#0000a2"><font
face="Times New Roman"><font size="3"><span lang="en">ron.palmer@pgcgroup.com.au</span></font></font></font></a></p>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"
lang="en">
<font color="#000000"><font face="Times New Roman"><font
size="3">0413
579 099</font></font></font></p>
<p class="western" style="line-height: 100%" lang="en"><font
color="#000000"><font face="Times New Roman"><font size="3">07
3103 4963</font></font></font></p>
<p class="western" style="margin-bottom: 0cm"><br>
</p>
</div>
</body>
</html>