No subject
Tue Jun 18 13:52:11 CDT 2019
as less latency than 4KB.
I was looking for explanation of this behavior but did not get any.
1. MPIR_CVAR_CH3_EAGER_MAX_MSG_SIZE is set to 128KB. So none of the abov=
e message size is using Rendezvous protocol. Is there any partition inside =
eager protocol (e.g. 0 - 512 bytes, 1KB - 8KB, 16KB - 64KB)? If yes then wh=
at are the boundaries for them? Can I log them with debug-event-logging?
Setup I am using:
- two nodes has intel core i7, one with 16gb memory another one 8gb
- mpich 3.2.1, configured and build to use nemesis tcp
- 1gb Ethernet connection
- NFS is using for sharing
- osu_latency : uses MPI_Send and MPI_Recv
- MPIR_CVAR_CH3_EAGER_MAX_MSG_SIZE=3D 131072 (128KB)
Can anyone help me on that? Thanks in advance.
Best Regards,
Abu Naser
_______________________________________________
discuss mailing list discuss at mpich.org<mailto:discuss at mpich.org>
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss
--
Jeff Hammond
jeff.science at gmail.com<mailto:jeff.science at gmail.com>
http://jeffhammond.github.io/
_______________________________________________
discuss mailing list discuss at mpich.org<mailto:discuss at mpich.org>
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss
--_000_BLUPR0501MB20037286A10BAAD88A18EF8D974B0BLUPR0501MB2003_
Content-Type: text/html; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
<html><head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1=
252">
<style type=3D"text/css" style=3D"display:none;"><!-- P {margin-top:0;margi=
n-bottom:0;} --></style>
</head>
<body dir=3D"ltr">
<div id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Helvetica,sans-serif;" dir=3D"ltr">
<div id=3D"divtagdefaultwrapper" style=3D"font-size: 12pt; color: rgb(0, 0,=
0); font-family: Calibri, Helvetica, sans-serif, EmojiFont, "Apple Co=
lor Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI=
Symbol", "Android Emoji", EmojiSymbols;" dir=3D"ltr">
<p style=3D"margin-top:0;margin-bottom:0">Hello Min and Jeff,</p>
<p style=3D"margin-top:0;margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0;margin-bottom:0"></p>
<p style=3D"margin-bottom: 0in; line-height: 100%">Here is my experiment re=
sults. Default number of iterations in osu_latency for 0B =96 8KB is 1=
0,000. With that setting I had run the osu_latency 100 times and found stan=
dard deviation 33 for 8KB message size.</p>
<p style=3D"margin-bottom: 0in; line-height: 100%"><br>
</p>
<p style=3D"margin-bottom: 0in; line-height: 100%">So later I have set the =
iteration to 50,000 and 100,000 for 1KB =96 16KB message size. Then run osu=
_latency for 100 times for each setting and take the average and standard d=
eviation.</p>
<p style=3D"margin-bottom: 0in; line-height: 100%"><br>
</p>
<table width=3D"665" cellpadding=3D"4" cellspacing=3D"0">
<colgroup><col width=3D"99"><col width=3D"112"><col width=3D"118"><col widt=
h=3D"154"><col width=3D"140"></colgroup>
<tbody>
<tr valign=3D"top">
<td width=3D"99" style=3D"border-top: 1px solid #000000; border-bottom: 1px=
solid #000000; border-left: 1px solid #000000; border-right: none; padding=
-top: 0.04in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: =
0in">
<p align=3D"center"><b>Msg Size in Bytes</b></p>
</td>
<td width=3D"112" style=3D"border-top: 1px solid #000000; border-bottom: 1p=
x solid #000000; border-left: 1px solid #000000; border-right: none; paddin=
g-top: 0.04in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right:=
0in">
<p align=3D"center"><b>Avg time in us (50K iterations)</b></p>
</td>
<td width=3D"118" style=3D"border-top: 1px solid #000000; border-bottom: 1p=
x solid #000000; border-left: 1px solid #000000; border-right: none; paddin=
g-top: 0.04in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right:=
0in">
<p align=3D"center"><b>Avg time in us (100k iterations)</b></p>
</td>
<td width=3D"154" style=3D"border-top: 1px solid #000000; border-bottom: 1p=
x solid #000000; border-left: 1px solid #000000; border-right: none; paddin=
g-top: 0.04in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right:=
0in">
<p align=3D"center"><b>Standard deviation (50K iterations)</b></p>
</td>
<td width=3D"140" style=3D"border: 1px solid #000000; padding: 0.04in">
<p align=3D"center"><b>Standard deviation (100K iterations)</b></p>
</td>
</tr>
<tr valign=3D"top">
<td width=3D"99" style=3D"border-top: none; border-bottom: 1px solid #00000=
0; border-left: 1px solid #000000; border-right: none; padding-top: 0in; pa=
dding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">1k</p>
</td>
<td width=3D"112" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">85.10</p>
</td>
<td width=3D"118" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">84.9</p>
</td>
<td width=3D"154" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">0.55</p>
</td>
<td width=3D"140" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: 1px solid #000000; paddin=
g-top: 0in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0.=
04in">
<p align=3D"center">0.45</p>
</td>
</tr>
<tr valign=3D"top">
<td width=3D"99" style=3D"border-top: none; border-bottom: 1px solid #00000=
0; border-left: 1px solid #000000; border-right: none; padding-top: 0in; pa=
dding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">2k</p>
</td>
<td width=3D"112" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">75.79</p>
</td>
<td width=3D"118" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">74.63</p>
</td>
<td width=3D"154" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center"><font color=3D"#ff0000">5.09</font></p>
</td>
<td width=3D"140" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: 1px solid #000000; paddin=
g-top: 0in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0.=
04in">
<p align=3D"center"><font color=3D"#ff0000">4.44</font></p>
</td>
</tr>
<tr valign=3D"top">
<td width=3D"99" style=3D"border-top: none; border-bottom: 1px solid #00000=
0; border-left: 1px solid #000000; border-right: none; padding-top: 0in; pa=
dding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">4k</p>
</td>
<td width=3D"112" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">273.80</p>
</td>
<td width=3D"118" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">274.71</p>
</td>
<td width=3D"154" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">4.18</p>
</td>
<td width=3D"140" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: 1px solid #000000; paddin=
g-top: 0in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0.=
04in">
<p align=3D"center">2.45</p>
</td>
</tr>
<tr valign=3D"top">
<td width=3D"99" style=3D"border-top: none; border-bottom: 1px solid #00000=
0; border-left: 1px solid #000000; border-right: none; padding-top: 0in; pa=
dding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">8k</p>
</td>
<td width=3D"112" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">258.56</p>
</td>
<td width=3D"118" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">249.83</p>
</td>
<td width=3D"154" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center"><font color=3D"#ff0000">21.14</font></p>
</td>
<td width=3D"140" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: 1px solid #000000; paddin=
g-top: 0in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0.=
04in">
<p align=3D"center"><font color=3D"#ff0000">28</font></p>
</td>
</tr>
<tr valign=3D"top">
<td width=3D"99" height=3D"24" style=3D"border-top: none; border-bottom: 1p=
x solid #000000; border-left: 1px solid #000000; border-right: none; paddin=
g-top: 0in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0i=
n">
<p align=3D"center">16k</p>
</td>
<td width=3D"112" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">281.31</p>
</td>
<td width=3D"118" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">281.02</p>
</td>
<td width=3D"154" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: none; padding-top: 0in; p=
adding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0in">
<p align=3D"center">3.22</p>
</td>
<td width=3D"140" style=3D"border-top: none; border-bottom: 1px solid #0000=
00; border-left: 1px solid #000000; border-right: 1px solid #000000; paddin=
g-top: 0in; padding-bottom: 0.04in; padding-left: 0.04in; padding-right: 0.=
04in">
<p align=3D"center">4.10</p>
</td>
</tr>
</tbody>
</table>
<p style=3D"margin-bottom: 0in; line-height: 100%"><br>
</p>
<p style=3D"margin-bottom: 0in; line-height: 100%"><br>
</p>
<p style=3D"margin-bottom: 0in; line-height: 100%">The standard deviation o=
f 8K message is so high and that implies it actually not producing any cons=
istent latency time. Looks like that's the reason for 8K is taking les=
s time than 4K.</p>
<p style=3D"margin-bottom: 0in; line-height: 100%"><br>
</p>
<p style=3D"margin-bottom: 0in; line-height: 100%">Meanwhile, 2K has standa=
rd deviation less than 5 but 1K message latency timing are more densely pop=
ulated than 2K. So probably this is the explanation for 2K message less lat=
ency time.</p>
<p style=3D"margin-bottom: 0in; line-height: 100%"><br>
</p>
<p style=3D"margin-bottom: 0in; line-height: 100%">Thank you for your sugge=
stions.</p>
<br>
<p></p>
<p style=3D"margin-top:0;margin-bottom:0"><br>
</p>
<div id=3D"Signature">
<div id=3D"divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; color=
:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif,"EmojiFont"=
,"Apple Color Emoji","Segoe UI Emoji",NotoColorEmoji,&q=
uot;Segoe UI Symbol","Android Emoji",EmojiSymbols">
<p><br>
</p>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Best Regards,</span></p>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<div align=3D"left"><span style=3D"font-size:11pt; font-family:Calibri,Helv=
etica,sans-serif"></span></div>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Abu Naser</span><br>
</p>
</div>
</div>
</div>
<hr style=3D"display:inline-block;width:98%" tabindex=3D"-1">
<div id=3D"divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" st=
yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b> Abu Naser<br>
<b>Sent:</b> Wednesday, June 20, 2018 1:48:53 PM<br>
<b>To:</b> discuss at mpich.org<br>
<b>Subject:</b> Re: [mpich-discuss] osu_latency test: why 8KB takes less ti=
me than 4KB and 2KB takes less time than 1KB?</font>
<div> </div>
</div>
<meta content=3D"text/html; charset=3Diso-8859-1">
<div dir=3D"ltr">
<div id=3D"x_divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size: 12pt; co=
lor: rgb(0, 0, 0); font-family: Calibri, Helvetica, sans-serif, EmojiFont, =
"Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, =
"Segoe UI Symbol", "Android Emoji", EmojiSymbols;">
<div id=3D"x_divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; col=
or:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif,"EmojiFont&quo=
t;,"Apple Color Emoji","Segoe UI Emoji",NotoColorEmoji,=
"Segoe UI Symbol","Android Emoji",EmojiSymbols">
<p style=3D"margin-top:0; margin-bottom:0">Hello Min,</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">Thanks for the clarification.&nb=
sp; I will do the experiment.<br>
</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<div id=3D"x_Signature">
<div id=3D"x_divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; col=
or:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif,"EmojiFont&quo=
t;,"Apple Color Emoji","Segoe UI Emoji",NotoColorEmoji,=
"Segoe UI Symbol","Android Emoji",EmojiSymbols">
<p>Thanks.</p>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Best Regards,</span></p>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<div align=3D"left"><span style=3D"font-size:11pt; font-family:Calibri,Helv=
etica,sans-serif"></span></div>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Abu Naser</span><br>
</p>
</div>
</div>
</div>
<hr tabindex=3D"-1" style=3D"display:inline-block; width:98%">
<div id=3D"x_divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" =
color=3D"#000000" style=3D"font-size:11pt"><b>From:</b> Min Si <msi at anl.=
gov><br>
<b>Sent:</b> Wednesday, June 20, 2018 1:39:30 PM<br>
<b>To:</b> discuss at mpich.org<br>
<b>Subject:</b> Re: [mpich-discuss] osu_latency test: why 8KB takes less ti=
me than 4KB and 2KB takes less time than 1KB?</font>
<div> </div>
</div>
<meta content=3D"text/html; charset=3DWindows-1252">
<div style=3D"background-color:#FFFFFF">Hi Abu,<br>
<br>
I think Jeff means that you should run your experiment with more iterations=
in order to get a stable results.<br>
- Increase the iteration of for loop in each execution (I think osu benchma=
rk allows you to set it)<br>
- Run the experiments 10 or 100 times, and take the average and standard de=
viation.<br>
<br>
If you see a very small standard deviation (e.g., <=3D5%), then the tren=
d is stable and you might not see such gaps.<br>
<br>
Best regards,<br>
Min<br>
<div class=3D"x_x_moz-cite-prefix">On 2018/06/20 12:14, Abu Naser wrote:<br=
>
</div>
<blockquote type=3D"cite">
<div id=3D"x_x_divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; c=
olor:rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif,"EmojiFont&q=
uot;,"Apple Color Emoji","Segoe UI Emoji",NotoColorEmoj=
i,"Segoe UI Symbol","Android Emoji",EmojiSymbols">
<p style=3D"margin-top:0; margin-bottom:0">Hello Jeff,</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">Yes, I am using a switch and oth=
er machines are also connected with that switch.
<br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">If I remove other machines and j=
ust use my two node with the switch, then will it improve the performance b=
y 200 ~ 400 iterations?</p>
<p style=3D"margin-top:0; margin-bottom:0">Meanwhile I will give a try with=
a single dedicated cable.
<span></span><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">Thank you.<br>
</p>
<div id=3D"x_x_Signature">
<div id=3D"x_x_divtagdefaultwrapper" dir=3D"ltr" style=3D"">
<p><br>
</p>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Best Regards,</span></p>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<div align=3D"left"><span style=3D"font-size:11pt; font-family:Calibri,Helv=
etica,sans-serif"></span></div>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Abu Naser</span><br>
</p>
</div>
</div>
</div>
<hr tabindex=3D"-1" style=3D"display:inline-block; width:98%">
<div id=3D"x_x_divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif=
" color=3D"#000000" style=3D"font-size:11pt"><b>From:</b> Jeff Hammond
<a class=3D"x_x_moz-txt-link-rfc2396E x_OWAAutoLink" href=3D"mailto:jeff.sc=
ience at gmail.com" id=3D"LPlnk983157" previewremoved=3D"true">
<jeff.science at gmail.com></a><br>
<b>Sent:</b> Wednesday, June 20, 2018 12:52:06 PM<br>
<b>To:</b> MPICH<br>
<b>Subject:</b> Re: [mpich-discuss] osu_latency test: why 8KB takes less ti=
me than 4KB and 2KB takes less time than 1KB?</font>
<div> </div>
</div>
<meta content=3D"text/html; charset=3Dutf-8">
<div>
<div dir=3D"ltr">Is the ethernet connection a single dedicated cable betwee=
n the two machines or are you running through a switch that handles other t=
raffic?
<div><br>
</div>
<div>My best guess is that this is noise and that you may be able to avoid =
it by running a very long time, e.g. 10000 iterations.</div>
<div><br>
</div>
<div>Jeff</div>
</div>
<div class=3D"x_x_x_gmail_extra"><br>
<div class=3D"x_x_x_gmail_quote">On Wed, Jun 20, 2018 at 6:53 AM, Abu Naser=
<span dir=3D"ltr">
<<a href=3D"mailto:an16e at my.fsu.edu" target=3D"_blank" id=3D"LPlnk305789=
" class=3D"x_OWAAutoLink" previewremoved=3D"true">an16e at my.fsu.edu</a>><=
/span> wrote:<br>
<blockquote class=3D"x_x_x_gmail_quote" style=3D"margin:0 0 0 .8ex; border-=
left:1px #ccc solid; padding-left:1ex">
<div dir=3D"ltr">
<div id=3D"x_x_x_m_6077755676379859201divtagdefaultwrapper" dir=3D"ltr" sty=
le=3D"">
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">Good day to all,</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">I had run point to point osu_lat=
ency test in two nodes for 200 times. Followings are the average time=
in microsecond for various size of the messages -</p>
<div>1KB 84.8514 us<br>
<span style=3D"color:rgb(255,0,0)">2KB 73.52535</span> us=
<br>
4KB 272.55275 us<br>
<span style=3D"color:rgb(255,0,0)">8KB 234.86385</span> u=
s<br>
16KB 288.88 us<br>
32KB 523.3725 us<br>
64KB 910.4025 us</div>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">From the above looks like, 2KB m=
essage has less latency than 1 KB and 8KB has less latency than 4KB.
<br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">I was looking for explanation of=
this behavior but did not get any.</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<ol style=3D"margin-bottom:0px; margin-top:0px">
<li><span>MPIR_CVAR_CH3_EAGER_MAX_MSG_<wbr>SIZE</span><span> is set to 128K=
B. So none of the above message size is using Rendezvous protocol. Is there=
any partition inside eager protocol (e.g. 0 - 512 bytes, 1KB - 8KB, 16KB -=
64KB)? If yes then what are the
boundaries for them? Can I log them with debug-event-logging? </span><br>
</li></ol>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">Setup I am using:</p>
<p style=3D"margin-top:0; margin-bottom:0">- two nodes has intel core i7, o=
ne with 16gb memory another one 8gb</p>
<p style=3D"margin-top:0; margin-bottom:0">- mpich 3.2.1, configured and bu=
ild to use nemesis tcp</p>
<p style=3D"margin-top:0; margin-bottom:0">- 1gb Ethernet connection</p>
<p style=3D"margin-top:0; margin-bottom:0">- NFS is using for sharing<br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">- osu_latency : uses MPI_Send an=
d MPI_Recv</p>
<p style=3D"margin-top:0; margin-bottom:0">- <span>MPIR_CVAR_CH3_EAGER_MAX_=
MSG_<wbr>SIZE</span>=3D
<span>131072</span> (128KB)<br>
</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0">Can anyone help me on that? Than=
ks in advance.<br>
</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<p style=3D"margin-top:0; margin-bottom:0"><br>
</p>
<div id=3D"x_x_x_m_6077755676379859201Signature">
<div id=3D"x_x_x_m_6077755676379859201divtagdefaultwrapper" dir=3D"ltr" sty=
le=3D"">
<p><br>
</p>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Best Regards,</span></p>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<div align=3D"left"><span style=3D"font-size:11pt; font-family:Calibri,Helv=
etica,sans-serif"></span></div>
<span style=3D"font-family:Calibri,Helvetica,sans-serif; font-size:10pt"></=
span>
<p align=3D"left"><span style=3D"font-size:10pt; font-family:Calibri,Helvet=
ica,sans-serif">Abu Naser</span><br>
</p>
</div>
</div>
</div>
</div>
<br>
______________________________<wbr>_________________<br>
discuss mailing list <a href=3D"mailto:discuss at mpich.org=
" id=3D"LPlnk816471" class=3D"x_OWAAutoLink" previewremoved=3D"true">discus=
s at mpich.org</a><br>
To manage subscription options or unsubscribe:<br>
<a href=3D"https://lists.mpich.org/mailman/listinfo/discuss" rel=3D"norefer=
rer" target=3D"_blank" id=3D"LPlnk624595" class=3D"x_OWAAutoLink" previewre=
moved=3D"true">https://lists.mpich.org/<wbr>mailman/listinfo/discuss</a><br=
>
<br>
</blockquote>
</div>
<br>
<br clear=3D"all">
<div><br>
</div>
-- <br>
<div class=3D"x_x_x_gmail_signature">Jeff Hammond<br>
<a href=3D"mailto:jeff.science at gmail.com" target=3D"_blank" id=3D"LPlnk3149=
93" class=3D"x_OWAAutoLink" previewremoved=3D"true">jeff.science at gmail.com<=
/a><br>
<a href=3D"http://jeffhammond.github.io/" target=3D"_blank" id=3D"LPlnk8614=
34" class=3D"x_OWAAutoLink" previewremoved=3D"true">http://jeffhammond.gith=
ub.io/</a></div>
</div>
</div>
<br>
<fieldset class=3D"x_x_mimeAttachmentHeader"></fieldset> <br>
<pre>_______________________________________________=0A=
discuss mailing list <a class=3D"x_x_moz-txt-link-abbreviated x_OWAAuto=
Link" href=3D"mailto:discuss at mpich.org" id=3D"LPlnk657371" previewremoved=
=3D"true">discuss at mpich.org</a>=0A=
To manage subscription options or unsubscribe:=0A=
<a class=3D"x_x_moz-txt-link-freetext x_OWAAutoLink" href=3D"https://lists.=
mpich.org/mailman/listinfo/discuss" id=3D"LPlnk669988" previewremoved=3D"tr=
ue">https://lists.mpich.org/mailman/listinfo/discuss</a>=0A=
</pre>
</blockquote>
<br>
</div>
</div>
</div>
</div>
</body>
</html>
--_000_BLUPR0501MB20037286A10BAAD88A18EF8D974B0BLUPR0501MB2003_--
--===============3923392798546736373==
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
discuss mailing list discuss at mpich.org
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss
--===============3923392798546736373==--
More information about the discuss
mailing list