<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p></p>
<div>Dear Friends,</div>
<div><br>
</div>
<div>The problem that I faced is I could not bind CPUs yet to test my hybrid code.</div>
<div>I tried various methods which I found on internet, but the main</div>
<div>problem is as we have different version of Linux and MPI,</div>
<div>there is no general solution for doing that.</div>
<div>Any solutions are specific for their computers and operating systems.</div>
<div>The last and proper solution that I found is following:</div>
<div> </div>
<div> module load gcc/5.2.1</div>
<div> module load openmpi-x86_64</div>
<div> </div>
<div>export OMP_SCHEDULE="dynamic,200"</div>
<div>export OMP_NUM_THREADS=32</div>
<div>export OMP_PLACES=threads</div>
<div>export OMP_PROC_BIND=spread</div>
<div> </div>
<div>numactl --all</div>
<div>numactl -N 0,1 > dbind.txt</div>
<div>numactl -C 0-15,32-47</div>
<div>numactl -C 1-31,48-63</div>
<div>numactl --show > dcpu.txt</div>
<div>mpirun -np 2 --map-by ppr:32:socket:pe=2 ./pjet.gfortran > output.txt</div>
<div><br>
</div>
<div>Although it did not face with any error, It did not bind CPU, I do not know why?</div>
<div>Can you please tell me that am I in right direction? do you have any</div>
<div>recommendation for that?</div>
<div><span style="font-size: 12pt;">I am using module (Open MPI) 1.8.1,</span><br>
</div>
<div>Right now, I do not face with any errors. Thus I tried to find a proper way to bind cpu for running the code in this new condition. </div>
<div>I changed NUMA setting and played with mpirun flags(as you saw above), but it seems that openmp is not working in this condition.</div>
<div>As computational time do not vary in different cases. (it did not reduce or change at all even if assuming export OMP_NUM_THREADS=16 or export OMP_NUM_THREADS=1)</div>
<div>Can you please tell me what else can I do for solving that?</div>
<div>I would appreciate your help and thank in advance.</div>
<div>
<div style="font-family: Calibri, Helvetica, sans-serif, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols; font-size: 16px;">
Thank you in advance</div>
<div><span style="font-size: 12pt;">Best regards.</span><br>
</div>
</div>
<div><span style="color: rgb(253, 120, 50); font-family: Calibri, Arial, Helvetica, sans-serif, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols; font-size: 12pt;">Pasha Pashaei </span><br>
</div>
<p></p>
<div id="Signature">
<div id="divtagdefaultwrapper" style="font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255); font-family: Calibri, Arial, Helvetica, sans-serif, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols;">
<p><br>
</p>
</div>
</div>
</div>
</body>
</html>