<!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Tried both ways but gives error. root@ ampere-altra-2-1: /# mpirun -np 5 -rankmap '(vector,1,1,0,0,0)' -hosts 192. 168. 2. 100,192. 168. 2. 200 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world Abort(678028815) on node 1: Fatal error in internal_Init:
</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" ><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #90a4ae;background-color:#D0D8DC;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" id="pfptBannerwu4wpi4" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #D0D8DC !important; background-color: #D0D8DC; border-top: 4px solid #90a4ae !important; border-top: 4px solid #90a4ae;">
<div id="pfptBannerwu4wpi4" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannerwu4wpi4" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannerwu4wpi4" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannerwu4wpi4 { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #D0D8DC !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtonwu4wpi4:hover, .pfptPrimaryButtonwu4wpi4:focus {
background-color: #b4c1c7 !important; }
.pfptPrimaryButtonwu4wpi4:active {
background-color: #90a4ae !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
@font-face
{font-family:Menlo;
panose-1:2 11 6 9 3 8 4 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
code
{mso-style-priority:99;
font-family:"Courier New";}
p.xmsonormal, li.xmsonormal, div.xmsonormal
{mso-style-name:x_msonormal;
margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
p.xxmsonormal, li.xxmsonormal, div.xxmsonormal
{mso-style-name:x_xmsonormal;
margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
p.xp1, li.xp1, div.xp1
{mso-style-name:x_p1;
margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black;}
span.xs1
{mso-style-name:x_s1;}
span.xapple-converted-space
{mso-style-name:x_apple-converted-space;}
span.EmailStyle27
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
p.p1, li.p1, div.p1
{mso-style-name:p1;
margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black;}
p.p2, li.p2, div.p2
{mso-style-name:p2;
margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black;}
span.s1
{mso-style-name:s1;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Tried both ways but gives error.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="p1"><span class="s1">root@ampere-altra-2-1:/# mpirun -np 5</span><span class="apple-converted-space">
</span><span class="s1">-rankmap '(vector,1,1,0,0,0)' </span><span class="apple-converted-space">
</span><span class="s1">-hosts 192.168.2.100,192.168.2.200 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span><o:p></o:p></p>
<p class="p1"><span class="s1">Abort(678028815) on node 1: Fatal error in internal_Init: Other MPI error, error stack:</span><o:p></o:p></p>
<p class="p1"><span class="s1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span><o:p></o:p></p>
<p class="p1"><span class="s1">MPII_Init_thread(268).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_init_comm_world(34)......:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit(800).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit_internal(585):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPID_Comm_commit_pre_hook(151):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDI_world_pre_init(638).....:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span><o:p></o:p></p>
<p class="p1"><span class="s1">Abort(678028815) on node 3: Fatal error in internal_Init: Other MPI error, error stack:</span><o:p></o:p></p>
<p class="p1"><span class="s1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span><o:p></o:p></p>
<p class="p1"><span class="s1">MPII_Init_thread(268).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_init_comm_world(34)......:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit(800).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit_internal(585):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPID_Comm_commit_pre_hook(151):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDI_world_pre_init(638).....:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span><o:p></o:p></p>
<p class="p2"><o:p> </o:p></p>
<p class="p2"><o:p> </o:p></p>
<p class="p1"><span class="s1">^C[mpiexec@ampere-altra-2-1] Sending Ctrl-C to processes as requested</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] Press Ctrl-C again to force abort</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYDU_sock_write (lib/utils/sock.c:250): write error (Bad file descriptor)</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] send_hdr_downstream (mpiexec/pmiserv_cb.c:28): sock write error</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYD_pmcd_pmiserv_send_signal (mpiexec/pmiserv_cb.c:218): unable to write data to proxy</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] ui_cmd_cb (mpiexec/pmiserv_pmci.c:61): unable to send signal downstream</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYDT_dmxu_poll_wait_for_event (lib/tools/demux/demux_poll.c:76): callback returned error status</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYD_pmci_wait_for_completion (mpiexec/pmiserv_pmci.c:173): error waiting for event</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] main (mpiexec/mpiexec.c:260): process manager error waiting for completion</span><o:p></o:p></p>
<p class="p1"><span class="s1"><o:p> </o:p></span></p>
<p class="p1"><span class="s1"><o:p> </o:p></span></p>
<p class="p1"><span class="s1"><o:p> </o:p></span></p>
<p class="p1"><span class="s1">root@ampere-altra-2-1:/# mpirun -np 5</span><span class="apple-converted-space">
</span><span class="s1">-rankmap 1,1,0,0,0 </span><span class="apple-converted-space">
</span><span class="s1">-hosts 192.168.2.100,192.168.2.200 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span><o:p></o:p></p>
<p class="p1"><span class="s1">Abort(678028815) on node 1: Fatal error in internal_Init: Other MPI error, error stack:</span><o:p></o:p></p>
<p class="p1"><span class="s1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span><o:p></o:p></p>
<p class="p1"><span class="s1">MPII_Init_thread(268).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_init_comm_world(34)......:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit(800).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit_internal(585):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPID_Comm_commit_pre_hook(151):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDI_world_pre_init(638).....:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span><o:p></o:p></p>
<p class="p1"><span class="s1">Abort(678028815) on node 3: Fatal error in internal_Init: Other MPI error, error stack:</span><o:p></o:p></p>
<p class="p1"><span class="s1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span><o:p></o:p></p>
<p class="p1"><span class="s1">MPII_Init_thread(268).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_init_comm_world(34)......:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit(800).........:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIR_Comm_commit_internal(585):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPID_Comm_commit_pre_hook(151):</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDI_world_pre_init(638).....:</span><span class="apple-converted-space"> </span><o:p></o:p></p>
<p class="p1"><span class="s1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span><o:p></o:p></p>
<p class="p1"><span class="s1">^C[mpiexec@ampere-altra-2-1] Sending Ctrl-C to processes as requested</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] Press Ctrl-C again to force abort</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYDU_sock_write (lib/utils/sock.c:250): write error (Bad file descriptor)</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] send_hdr_downstream (mpiexec/pmiserv_cb.c:28): sock write error</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYD_pmcd_pmiserv_send_signal (mpiexec/pmiserv_cb.c:218): unable to write data to proxy</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] ui_cmd_cb (mpiexec/pmiserv_pmci.c:61): unable to send signal downstream</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYDT_dmxu_poll_wait_for_event (lib/tools/demux/demux_poll.c:76): callback returned error status</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] HYD_pmci_wait_for_completion (mpiexec/pmiserv_pmci.c:173): error waiting for event</span><o:p></o:p></p>
<p class="p1"><span class="s1">[mpiexec@ampere-altra-2-1] main (mpiexec/mpiexec.c:260): process manager error waiting for completion</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Monday, July 1, 2024 at 9:39</span><span style="font-family:"Arial",sans-serif;color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Use quote. Try </span><code><span style="font-size:10.0pt;color:black">-rankmap '(vector,1,1,0,0,0)'</span></code><span style="font-family:"Arial",sans-serif;color:black"></span><span style="color:black">.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Actually, the </span><code><span style="font-size:10.0pt;color:black">vector</span></code><span style="font-family:"Arial",sans-serif;color:black"></span><span style="color:black"> part is optional, so this should
also work: </span><code><span style="font-size:10.0pt;color:black">-rankmap 1,1,0,0,0</span></code><span style="font-family:"Arial",sans-serif;color:black"></span><span style="color:black">.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">--<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Hui<o:p></o:p></span></p>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Sent:</b> Monday, July 1, 2024 9:11 PM<br>
<b>To:</b> discuss@mpich.org <discuss@mpich.org>; Zhou, Hui <zhouh@anl.gov>; Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc:</b> nd <nd@arm.com><br>
<b>Subject:</b> Re: Custom rank for processes</span> <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">I get the below error when trying.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">.
am I trying it worng? root@</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">ampere-altra-2-1:</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">/#
mpirun -np 5 -hosts 192.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">168.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">2.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">100,192.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">168.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">2.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">200
-rankmap (vector,1,1,0,0,0) /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world bash: syntax error near
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart<o:p></o:p></span></p>
</div>
<div style="border:none;border-top:solid #90A4AE 3.0pt;padding:0in 0in 0in 0in;display:block!important;text-align:left!important;margin:0px!important;padding:16px!important;border-radius:4px!important;min-width:200px!important;background-color:#D0D8DC!important;border-top:#90a4ae!important" id="x_pfptBannerjmbng2y">
<div id="x_pfptBannerjmbng2y">
<div id="x_pfptBannerjmbng2y">
<p class="MsoNormal" style="line-height:13.5pt;background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif;color:black">This Message Is From an External Sender
<o:p></o:p></span></b></p>
</div>
<div id="x_pfptBannerjmbng2y">
<p class="MsoNormal" style="line-height:13.5pt;background:#D0D8DC"><span style="font-family:"Arial",sans-serif;color:black">This message came from outside your organization.
<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="background:#D0D8DC"><span style="color:black"> </span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd<o:p></o:p></span></p>
</div>
<div>
<p class="xmsonormal"><span style="font-size:11.0pt">I get the below error when trying.. am I trying it worng?</span><o:p></o:p></p>
<p class="xmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="xmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="xp1"><span class="xs1">root@ampere-altra-2-1:/# mpirun </span><span class="xapple-converted-space">
</span><span class="xs1">-np 5</span><span class="xapple-converted-space"> </span>
<span class="xs1">-hosts 192.168.2.100,192.168.2.200 </span><span class="xapple-converted-space">
</span><span class="xs1">-rankmap (vector,1,1,0,0,0)</span><span class="xapple-converted-space">
</span><span class="xs1">/mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span><o:p></o:p></p>
<p class="xp1"><span class="xs1">bash: syntax error near unexpected token `('</span><o:p></o:p></p>
<p class="xmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="xmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div id="x_mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Niyaz Murshed via discuss <discuss@mpich.org><br>
<b>Date: </b>Monday, July 1, 2024 at 4:42</span><span style="font-family:"Arial",sans-serif;color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Zhou, Hui <zhouh@anl.gov>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, nd <nd@arm.com><br>
<b>Subject: </b>Re: [mpich-discuss] Custom rank for processes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="font-size:1.0pt;color:white">Thank you so much Hui. Really appreciate it. I now understand it. From: Zhou, Hui <zhouh@</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">anl.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">gov>
Date: Monday, July 1, 2024 at 4:</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">37 PM To: Niyaz Murshed <Niyaz.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">Murshed@</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">arm.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">com>,
discuss@</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">mpich.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">org
<discuss@</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">mpich.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">org>,
Jenke, </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart</span><o:p></o:p></p>
</div>
<div style="border:none;border-top:solid #90A4AE 3.0pt;padding:0in 0in 0in 0in;display:block!important;text-align:left!important;margin:0px!important;padding:16px!important;border-radius:4px!important;min-width:200px!important;background-color:#D0D8DC!important;border-top:#90a4ae!important" id="x_pfptBannervdcy3qg">
<div id="x_pfptBannervdcy3qg">
<div id="x_pfptBannervdcy3qg">
<p class="xmsonormal" style="line-height:13.5pt;background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif;color:black">This Message Is From an External Sender
</span></b><o:p></o:p></p>
</div>
<div id="x_pfptBannervdcy3qg">
<p class="xmsonormal" style="line-height:13.5pt;background:#D0D8DC"><span style="font-family:"Arial",sans-serif;color:black">This message came from outside your organization.
</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="xmsonormal" style="background:#D0D8DC"><span style="color:black"> </span><o:p></o:p></p>
</div>
</div>
<div>
<p class="xmsonormal"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="font-size:11.0pt">Thank you so much Hui. Really appreciate it. I now understand it.</span><o:p></o:p></p>
<p class="xmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div id="x_mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Monday, July 1, 2024 at 4:37</span><span style="font-family:"Arial",sans-serif;color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="color:black">Yes, you can use rankmap to simply list out the node assignment for each rank. "-rankmap (vector,1,1,0,0,0)" is a list of 5 node ids, one for each rank. So rank 0 gets node 1, rank 1 gets node 1, rank 2 gets node
0, and so on.</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="color:black">The -hosts options is convenient if you have somewhat uniform assignment. If you want arbitrary assignment, just use -rankmap option.</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="color:black">--</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="color:black">Hui</span><o:p></o:p></p>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="x_divRplyFwdMsg">
<p class="xmsonormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Sent:</b> Monday, July 1, 2024 4:30 PM<br>
<b>To:</b> Zhou, Hui <zhouh@anl.gov>; discuss@mpich.org <discuss@mpich.org>; Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc:</b> nd <nd@arm.com><br>
<b>Subject:</b> Re: Custom rank for processes</span> <o:p></o:p></p>
<div>
<p class="xmsonormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="xmsonormal"><span style="font-size:1.0pt;color:white">Sorry to bother you again with silly questions. How do I read the below : -rankmap (vector,1,1,0,0,0) I have 5 processes. 1 1 => means node1 will get first 2 processes ? -hosts 192.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">168.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">2.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">100:</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">2,192.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">168.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">2.</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">200:</span><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:white"> </span><span style="font-size:1.0pt;color:white">3
: this will give 2 process in </span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart</span><o:p></o:p></p>
</div>
<div style="border:none;border-top:solid #90A4AE 3.0pt;padding:0in 0in 0in 0in;display:block!important;text-align:left!important;margin:0px!important;padding:16px!important;border-radius:4px!important;min-width:200px!important;background-color:#D0D8DC!important;border-top:#90a4ae!important" id="x_x_pfptBanner4epdvkz">
<div id="x_x_pfptBanner4epdvkz">
<div id="x_x_pfptBanner4epdvkz">
<p class="xmsonormal" style="line-height:13.5pt;background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif;color:black">This Message Is From an External Sender
</span></b><o:p></o:p></p>
</div>
<div id="x_x_pfptBanner4epdvkz">
<p class="xmsonormal" style="line-height:13.5pt;background:#D0D8DC"><span style="font-family:"Arial",sans-serif;color:black">This message came from outside your organization.
</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="xmsonormal" style="background:#D0D8DC"><span style="color:black"> </span><o:p></o:p></p>
</div>
</div>
<div>
<p class="xmsonormal"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="font-size:11.0pt">Sorry to bother you again with silly questions.</span><o:p></o:p></p>
<p class="xxmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="xxmsonormal"><span style="font-size:11.0pt">How do I read the below : </span>
<o:p></o:p></p>
<p class="xxmsonormal"><span style="color:black;background:white">-rankmap (vector,1,1,0,0,0)</span><o:p></o:p></p>
<p class="xxmsonormal"><span style="color:black;background:white"> </span><o:p></o:p></p>
<p class="xxmsonormal"><span style="color:black;background:white">I have 5 processes. 1 1 => means node1 will get first 2 processes ?
</span><o:p></o:p></p>
<p class="xxmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="xxmsonormal"><span style="color:black">-hosts 192.168.2.100:2,192.168.2.200:3 : this will give 2 process in 100 and 3 in 200 .. Still won’t be able to specify which ranks goes to which node. Rank0 will be on node 100 .. what If I want Rank0 on node
200?</span><o:p></o:p></p>
<p class="xxmsonormal"><span style="color:black"> </span><o:p></o:p></p>
<p class="xxmsonormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div id="x_x_mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xxmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Monday, July 1, 2024 at 4:09</span><span style="font-family:"Arial",sans-serif;color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> root@ampere-altra-2-1:/# mpirun -n 5 -bind-to user:10,11,12,13 -hosts 192.168.2.200,192.168.2.100 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">Hello world from processor ampere-altra-2-1, rank 1 out of 5 processors</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">Hello world from processor ampere-altra-2-1, rank 3 out of 5 processors</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">Hello world from processor dpr740, rank 0 out of 5 processors</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">Hello world from processor dpr740, rank 4 out of 5 processors</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">Hello world from processor dpr740, rank 2 out of 5 processors</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> -bind-to user:10,11,12,13</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> This would mean on host 192.168.2.100</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> P0=>10 , P2=>11</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> This would mean on host 192.168.2.200</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> P0=>10 , P2=>11, P3=12</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Is this correct understanding ? Is it also possible to say which rank process will be pinned to which core ?<br>
<br>
Yes, that is correct. The ranks are assigned to hosts as shown in the hello world output.</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> About the rankmap:, trying to understand if I can select where a particular rank would be from > list of hosts. Currently, the first host in the list always get rank0.</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Can I specify the below ranks?</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> mpirun -n 5 -bind-to user:10,11,12,13 -hosts 192.168.2.200,192.168.2.100 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> </span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Hello world from processor ampere-altra-2-1, rank 1 out of 5 processors => rank0</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Hello world from processor ampere-altra-2-1, rank 3 out of 5 processors. => rank1</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Hello world from processor dpr740, rank 0 out of 5 processors =>rank2</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Hello world from processor dpr740, rank 4 out of 5 processors =>rank3</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">> Hello world from processor dpr740, rank 2 out of 5 processors =>rank4<br>
<br>
Yes. You can use "-rankmap (vector,1,1,0,0,0)". Alternatively, you can use "-hosts 192.168.2.100:2,192.168.2.200:3", the colon syntax specifies how many processes you want to assign to each host.</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black"> </span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">--</span><o:p></o:p></p>
</div>
<div>
<p class="xxmsonormal"><span style="color:black">Hui</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>