<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Niyaz,</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I don't know what prevents your from using shared memory. But in the meantime if you want to turn off shared memory, you could try configure mpich with --without-ch4-shmmods.</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
--</div>
<div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hui</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Sent:</b> Friday, July 5, 2024 9:14 AM<br>
<b>To:</b> discuss@mpich.org <discuss@mpich.org>; Zhou, Hui <zhouh@anl.gov>; Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc:</b> nd <nd@arm.com><br>
<b>Subject:</b> Re: Custom rank for processes</font>
<div> </div>
</div>
<div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
Hi Hui, Any suggestion on this ? Regards, Niyaz From: Niyaz Murshed via discuss <discuss@ mpich. org> Date: Tuesday, July 2, 2024 at 10: 48 AM To: Zhou, Hui <zhouh@ anl. gov>, discuss@ mpich. org <discuss@ mpich. org>, Jenke, Joachim
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerStart</div>
<div dir="ltr" id="x_pfptBannerqm2hsyt" style="display:block!important; text-align:left!important; margin:16px 0px 16px 0px!important; padding:8px 16px 8px 16px!important; border-radius:4px!important; min-width:200px!important; background-color:#D0D8DC!important; background-color:#D0D8DC; border-top:4px solid #90a4ae!important; border-top:4px solid #90a4ae">
<div id="x_pfptBannerqm2hsyt" style="float:left!important; display:block!important; margin:0px 0px 1px 0px!important; max-width:600px!important">
<div id="x_pfptBannerqm2hsyt" style="display:block!important; visibility:visible!important; background-color:#D0D8DC!important; color:#000000!important; color:#000000; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-weight:bold!important; font-weight:bold; font-size:14px!important; line-height:18px!important; line-height:18px">
This Message Is From an External Sender </div>
<div id="x_pfptBannerqm2hsyt" style="display:block!important; visibility:visible!important; background-color:#D0D8DC!important; color:#000000!important; color:#000000; font-weight:normal; font-family:'Arial',sans-serif!important; font-family:'Arial',sans-serif; font-size:12px!important; line-height:18px!important; line-height:18px; margin-top:2px!important">
This message came from outside your organization. </div>
</div>
<div style="clear:both!important; display:block!important; visibility:hidden!important; line-height:0!important; font-size:0.01px!important; height:0px">
</div>
</div>
<div style="display:none!important; display:none; visibility:hidden; font-size:1px; color:#ffffff; line-height:1px; height:0px; max-height:0px; opacity:0; overflow:hidden">
ZjQcmQRYFpfptBannerEnd</div>
<style>
<!--
#x_pfptBannerqm2hsyt
{display:block!important;
visibility:visible!important;
opacity:1!important;
background-color:#D0D8DC!important;
max-width:none!important;
max-height:none!important}
-->
</style>
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Aptos}
@font-face
{font-family:Menlo}
p.x_MsoNormal, li.x_MsoNormal, div.x_MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif}
code
{font-family:"Courier New"}
p.x_xmsonormal, li.x_xmsonormal, div.x_xmsonormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif}
p.x_xxmsonormal, li.x_xxmsonormal, div.x_xxmsonormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif}
p.x_xxxmsonormal, li.x_xxxmsonormal, div.x_xxxmsonormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif}
p.x_xxp1, li.x_xxp1, div.x_xxp1
{margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black}
p.x_xp1, li.x_xp1, div.x_xp1
{margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black}
p.x_xp2, li.x_xp2, div.x_xp2
{margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black}
p.x_p1, li.x_p1, div.x_p1
{margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black}
span.x_s1
{}
span.x_apple-converted-space
{}
span.x_xs1
{}
span.x_xapple-converted-space
{}
span.x_xxs1
{}
span.x_xxapple-converted-space
{}
span.x_EmailStyle34
{font-family:"Aptos",sans-serif;
color:windowtext}
.x_MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
div.x_WordSection1
{}
-->
</style>
<div class="x_WordSection1">
<p class="x_MsoNormal"><span style="font-size:11.0pt">Hi Hui, </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt">Any suggestion on this ?</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt">Regards,</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt">Niyaz</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Niyaz Murshed via discuss <discuss@mpich.org><br>
<b>Date: </b>Tuesday, July 2, 2024 at 10:48</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">AM<br>
<b>To: </b>Zhou, Hui <zhouh@anl.gov>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, nd <nd@arm.com><br>
<b>Subject: </b>Re: [mpich-discuss] Custom rank for processes</span></p>
</div>
<div>
<p class="x_MsoNormal" style=""><span style="font-size:1.0pt; color:white">I deleted and tried again. root@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">ampere-altra-2-1:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">/#
cd /dev/shm/ root@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">ampere-altra-2-1:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">/dev/shm#
ls -l total 24 -rw------- 1 root root 256 Jul 2 15:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">07 mpich_shar_tmp7LFvuU -rw------- 1 root root 256 Jul 2 02:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">01
mpich_shar_tmpDXxqHv -rw------- </span></p>
</div>
<div>
<p class="x_MsoNormal" style=""><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerStart</span></p>
</div>
<div id="x_pfptBanner0fgcu63" style="border:none; border-top:solid #90A4AE 3.0pt; padding:0in 0in 0in 0in; display:block!important; text-align:left!important; margin:0px!important; padding:16px!important; border-radius:4px!important; min-width:200px!important; background-color:#D0D8DC!important; border-top:#90a4ae!important">
<div id="x_pfptBanner0fgcu63">
<div id="x_pfptBanner0fgcu63">
<p class="x_MsoNormal" style="line-height:13.5pt; background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif; color:black">This Message Is From an External Sender
</span></b></p>
</div>
<div id="x_pfptBanner0fgcu63">
<p class="x_MsoNormal" style="line-height:13.5pt; background:#D0D8DC"><span style="font-family:"Arial",sans-serif; color:black">This message came from outside your organization.
</span></p>
</div>
</div>
<div>
<p class="x_MsoNormal" style="background:#D0D8DC"><span style="color:black"> </span></p>
</div>
</div>
<div>
<p class="x_MsoNormal" style=""><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerEnd</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt">I deleted and tried again.</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_p1"><span class="x_s1">root@ampere-altra-2-1:/# cd /dev/shm/ </span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">root@ampere-altra-2-1:/dev/shm# ls -l</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">total 24</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 256 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 15:07 mpich_shar_tmp7LFvuU</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 256 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 02:01 mpich_shar_tmpDXxqHv</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 256 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 15:07 mpich_shar_tmpEivSSF</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 192 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 15:07 mpich_shar_tmpXaqJui</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 192 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 02:01 mpich_shar_tmpg2Rank</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 192 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 15:07 mpich_shar_tmpxwlNrm</span></p>
<p class="x_p1"><span class="x_s1">root@ampere-altra-2-1:/dev/shm# rm -rf *</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1"> </span></p>
<p class="x_p1"><span class="x_s1"> </span></p>
<p class="x_p1"><span class="x_s1">root@ampere-altra-2-1:/dev/shm# mpirun -np 5</span><span class="x_apple-converted-space">
</span><span class="x_s1">-rankmap 1,1,0,0,0 </span><span class="x_apple-converted-space">
</span><span class="x_s1">-hosts 192.168.2.100,192.168.2.200 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span></p>
<p class="x_p1"><span class="x_s1">Abort(678028815) on node 1: Fatal error in internal_Init: Other MPI error, error stack:</span></p>
<p class="x_p1"><span class="x_s1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span></p>
<p class="x_p1"><span class="x_s1">MPII_Init_thread(268).........:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIR_init_comm_world(34)......:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIR_Comm_commit(800).........:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIR_Comm_commit_internal(585):</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPID_Comm_commit_pre_hook(151):</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIDI_world_pre_init(638).....:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span></p>
<p class="x_p1"><span class="x_s1">Abort(678028815) on node 3: Fatal error in internal_Init: Other MPI error, error stack:</span></p>
<p class="x_p1"><span class="x_s1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span></p>
<p class="x_p1"><span class="x_s1">MPII_Init_thread(268).........:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIR_init_comm_world(34)......:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIR_Comm_commit(800).........:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIR_Comm_commit_internal(585):</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPID_Comm_commit_pre_hook(151):</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIDI_world_pre_init(638).....:</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span></p>
<p class="x_p1"><span class="x_s1">^C[mpiexec@ampere-altra-2-1] Sending Ctrl-C to processes as requested</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] Press Ctrl-C again to force abort</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] HYDU_sock_write (lib/utils/sock.c:250): write error (Bad file descriptor)</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] send_hdr_downstream (mpiexec/pmiserv_cb.c:28): sock write error</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] HYD_pmcd_pmiserv_send_signal (mpiexec/pmiserv_cb.c:218): unable to write data to proxy</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] ui_cmd_cb (mpiexec/pmiserv_pmci.c:61): unable to send signal downstream</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] HYDT_dmxu_poll_wait_for_event (lib/tools/demux/demux_poll.c:76): callback returned error status</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] HYD_pmci_wait_for_completion (mpiexec/pmiserv_pmci.c:173): error waiting for event</span></p>
<p class="x_p1"><span class="x_s1">[mpiexec@ampere-altra-2-1] main (mpiexec/mpiexec.c:260): process manager error waiting for completion</span></p>
<p class="x_p1"><span class="x_s1"> </span></p>
<p class="x_p1"><span class="x_s1"> </span></p>
<p class="x_p1"><span class="x_s1">root@ampere-altra-2-1:/dev/shm# ls -l</span><span class="x_apple-converted-space"> </span></p>
<p class="x_p1"><span class="x_s1">total 8</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 256 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 15:46 mpich_shar_tmp0eFIGw</span></p>
<p class="x_p1"><span class="x_s1">-rw------- 1 root root 192 Jul</span><span class="x_apple-converted-space">
</span><span class="x_s1">2 15:46 mpich_shar_tmpd4W7pC</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Tuesday, July 2, 2024 at 10:20</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">AM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="color:black">Not sure why it can't create shared memory. Do you have
</span><code><span style="font-size:10.0pt; color:black">/dev/shm</span></code><span style="font-family:"Arial",sans-serif; color:black"></span><span style="color:black">? Is it full?<br>
<br>
--</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="color:black">Hui</span></p>
</div>
<div class="x_MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="x_divRplyFwdMsg">
<p class="x_MsoNormal"><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black"> Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Sent:</b> Tuesday, July 2, 2024 10:09 AM<br>
<b>To:</b> Zhou, Hui <zhouh@anl.gov>; discuss@mpich.org <discuss@mpich.org>; Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc:</b> nd <nd@arm.com><br>
<b>Subject:</b> Re: Custom rank for processes</span> </p>
<div>
<p class="x_MsoNormal"> </p>
</div>
</div>
<div>
<div>
<p class="x_MsoNormal"><span style="font-size:1.0pt; color:white">Tried both ways but gives error. root@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">ampere-altra-2-1:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">/#
mpirun -np 5 -rankmap '(vector,1,1,0,0,0)' -hosts 192.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">168.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">100,192.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">168.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">200
/mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world Abort(678028815) on node 1: Fatal error in internal_Init:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">
</span></p>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerStart</span></p>
</div>
<div id="x_x_pfptBannerp6hxly8" style="border:none; border-top:solid #90A4AE 3.0pt; padding:0in 0in 0in 0in; display:block!important; text-align:left!important; margin:0px!important; padding:16px!important; border-radius:4px!important; min-width:200px!important; background-color:#D0D8DC!important; border-top:#90a4ae!important">
<div id="x_x_pfptBannerp6hxly8">
<div id="x_x_pfptBannerp6hxly8">
<p class="x_MsoNormal" style="line-height:13.5pt; background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif; color:black">This Message Is From an External Sender
</span></b></p>
</div>
<div id="x_x_pfptBannerp6hxly8">
<p class="x_MsoNormal" style="line-height:13.5pt; background:#D0D8DC"><span style="font-family:"Arial",sans-serif; color:black">This message came from outside your organization.
</span></p>
</div>
</div>
<div>
<p class="x_MsoNormal" style="background:#D0D8DC"><span style="color:black"> </span></p>
</div>
</div>
<div>
<p class="x_MsoNormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerEnd</span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="font-size:11.0pt">Tried both ways but gives error.</span></p>
<p class="x_xmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xp1"><span class="x_xs1">root@ampere-altra-2-1:/# mpirun -np 5</span><span class="x_xapple-converted-space">
</span><span class="x_xs1">-rankmap '(vector,1,1,0,0,0)' </span><span class="x_xapple-converted-space">
</span><span class="x_xs1">-hosts 192.168.2.100,192.168.2.200 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span></p>
<p class="x_xp1"><span class="x_xs1">Abort(678028815) on node 1: Fatal error in internal_Init: Other MPI error, error stack:</span></p>
<p class="x_xp1"><span class="x_xs1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span></p>
<p class="x_xp1"><span class="x_xs1">MPII_Init_thread(268).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_init_comm_world(34)......:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit(800).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit_internal(585):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPID_Comm_commit_pre_hook(151):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDI_world_pre_init(638).....:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span></p>
<p class="x_xp1"><span class="x_xs1">Abort(678028815) on node 3: Fatal error in internal_Init: Other MPI error, error stack:</span></p>
<p class="x_xp1"><span class="x_xs1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span></p>
<p class="x_xp1"><span class="x_xs1">MPII_Init_thread(268).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_init_comm_world(34)......:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit(800).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit_internal(585):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPID_Comm_commit_pre_hook(151):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDI_world_pre_init(638).....:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span></p>
<p class="x_xp2"> </p>
<p class="x_xp2"> </p>
<p class="x_xp1"><span class="x_xs1">^C[mpiexec@ampere-altra-2-1] Sending Ctrl-C to processes as requested</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] Press Ctrl-C again to force abort</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYDU_sock_write (lib/utils/sock.c:250): write error (Bad file descriptor)</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] send_hdr_downstream (mpiexec/pmiserv_cb.c:28): sock write error</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYD_pmcd_pmiserv_send_signal (mpiexec/pmiserv_cb.c:218): unable to write data to proxy</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] ui_cmd_cb (mpiexec/pmiserv_pmci.c:61): unable to send signal downstream</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYDT_dmxu_poll_wait_for_event (lib/tools/demux/demux_poll.c:76): callback returned error status</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYD_pmci_wait_for_completion (mpiexec/pmiserv_pmci.c:173): error waiting for event</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] main (mpiexec/mpiexec.c:260): process manager error waiting for completion</span></p>
<p class="x_xp1"><span class="x_xs1"> </span></p>
<p class="x_xp1"><span class="x_xs1"> </span></p>
<p class="x_xp1"><span class="x_xs1"> </span></p>
<p class="x_xp1"><span class="x_xs1">root@ampere-altra-2-1:/# mpirun -np 5</span><span class="x_xapple-converted-space">
</span><span class="x_xs1">-rankmap 1,1,0,0,0 </span><span class="x_xapple-converted-space">
</span><span class="x_xs1">-hosts 192.168.2.100,192.168.2.200 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span></p>
<p class="x_xp1"><span class="x_xs1">Abort(678028815) on node 1: Fatal error in internal_Init: Other MPI error, error stack:</span></p>
<p class="x_xp1"><span class="x_xs1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span></p>
<p class="x_xp1"><span class="x_xs1">MPII_Init_thread(268).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_init_comm_world(34)......:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit(800).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit_internal(585):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPID_Comm_commit_pre_hook(151):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDI_world_pre_init(638).....:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span></p>
<p class="x_xp1"><span class="x_xs1">Abort(678028815) on node 3: Fatal error in internal_Init: Other MPI error, error stack:</span></p>
<p class="x_xp1"><span class="x_xs1">internal_Init(70).............: MPI_Init(argc=(nil), argv=(nil)) failed</span></p>
<p class="x_xp1"><span class="x_xs1">MPII_Init_thread(268).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_init_comm_world(34)......:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit(800).........:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIR_Comm_commit_internal(585):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPID_Comm_commit_pre_hook(151):</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDI_world_pre_init(638).....:</span><span class="x_xapple-converted-space"> </span></p>
<p class="x_xp1"><span class="x_xs1">MPIDU_Init_shm_init(179)......: unable to allocate shared memory</span></p>
<p class="x_xp1"><span class="x_xs1">^C[mpiexec@ampere-altra-2-1] Sending Ctrl-C to processes as requested</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] Press Ctrl-C again to force abort</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYDU_sock_write (lib/utils/sock.c:250): write error (Bad file descriptor)</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] send_hdr_downstream (mpiexec/pmiserv_cb.c:28): sock write error</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYD_pmcd_pmiserv_send_signal (mpiexec/pmiserv_cb.c:218): unable to write data to proxy</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] ui_cmd_cb (mpiexec/pmiserv_pmci.c:61): unable to send signal downstream</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYDT_dmxu_poll_wait_for_event (lib/tools/demux/demux_poll.c:76): callback returned error status</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] HYD_pmci_wait_for_completion (mpiexec/pmiserv_pmci.c:173): error waiting for event</span></p>
<p class="x_xp1"><span class="x_xs1">[mpiexec@ampere-altra-2-1] main (mpiexec/mpiexec.c:260): process manager error waiting for completion</span></p>
<p class="x_xmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xmsonormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_xmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Monday, July 1, 2024 at 9:39</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes</span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black">Use quote. Try </span><code><span style="font-size:10.0pt; color:black">-rankmap '(vector,1,1,0,0,0)'</span></code><span style="font-family:"Arial",sans-serif; color:black"></span><span style="color:black">.</span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black">Actually, the </span><code><span style="font-size:10.0pt; color:black">vector</span></code><span style="font-family:"Arial",sans-serif; color:black"></span><span style="color:black"> part is optional, so this
should also work: </span><code><span style="font-size:10.0pt; color:black">-rankmap 1,1,0,0,0</span></code><span style="font-family:"Arial",sans-serif; color:black"></span><span style="color:black">.</span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black">--</span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="color:black">Hui</span></p>
</div>
<div class="x_MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="x_x_divRplyFwdMsg">
<p class="x_xmsonormal"><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black"> Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Sent:</b> Monday, July 1, 2024 9:11 PM<br>
<b>To:</b> discuss@mpich.org <discuss@mpich.org>; Zhou, Hui <zhouh@anl.gov>; Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc:</b> nd <nd@arm.com><br>
<b>Subject:</b> Re: Custom rank for processes</span> </p>
<div>
<p class="x_xmsonormal"> </p>
</div>
</div>
<div>
<div>
<p class="x_xmsonormal"><span style="font-size:1.0pt; color:white">I get the below error when trying.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">. am I trying it worng?
root@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">ampere-altra-2-1:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">/#
mpirun -np 5 -hosts 192.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">168.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">100,192.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">168.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">200
-rankmap (vector,1,1,0,0,0) /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world bash: syntax error near
</span></p>
</div>
<div>
<p class="x_xmsonormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerStart</span></p>
</div>
<div id="x_x_x_pfptBannerjmbng2y" style="border:none; border-top:solid #90A4AE 3.0pt; padding:0in 0in 0in 0in; display:block!important; text-align:left!important; margin:0px!important; padding:16px!important; border-radius:4px!important; min-width:200px!important; background-color:#D0D8DC!important; border-top:#90a4ae!important">
<div id="x_x_x_pfptBannerjmbng2y">
<div id="x_x_x_pfptBannerjmbng2y">
<p class="x_xmsonormal" style="line-height:13.5pt; background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif; color:black">This Message Is From an External Sender
</span></b></p>
</div>
<div id="x_x_x_pfptBannerjmbng2y">
<p class="x_xmsonormal" style="line-height:13.5pt; background:#D0D8DC"><span style="font-family:"Arial",sans-serif; color:black">This message came from outside your organization.
</span></p>
</div>
</div>
<div>
<p class="x_xmsonormal" style="background:#D0D8DC"><span style="color:black"> </span></p>
</div>
</div>
<div>
<p class="x_xmsonormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerEnd</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:11.0pt">I get the below error when trying.. am I trying it worng?</span></p>
<p class="x_xxmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xxmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xxp1"><span class="x_xxs1">root@ampere-altra-2-1:/# mpirun </span><span class="x_xxapple-converted-space">
</span><span class="x_xxs1">-np 5</span><span class="x_xxapple-converted-space">
</span><span class="x_xxs1">-hosts 192.168.2.100,192.168.2.200 </span><span class="x_xxapple-converted-space">
</span><span class="x_xxs1">-rankmap (vector,1,1,0,0,0)</span><span class="x_xxapple-converted-space">
</span><span class="x_xxs1">/mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span></p>
<p class="x_xxp1"><span class="x_xxs1">bash: syntax error near unexpected token `('</span></p>
<p class="x_xxmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xxmsonormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_x_x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_xxmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Niyaz Murshed via discuss <discuss@mpich.org><br>
<b>Date: </b>Monday, July 1, 2024 at 4:42</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Zhou, Hui <zhouh@anl.gov>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, nd <nd@arm.com><br>
<b>Subject: </b>Re: [mpich-discuss] Custom rank for processes</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:1.0pt; color:white">Thank you so much Hui. Really appreciate it. I now understand it. From: Zhou, Hui <zhouh@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">anl.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">gov>
Date: Monday, July 1, 2024 at 4:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">37 PM To: Niyaz Murshed <Niyaz.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">Murshed@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">arm.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">com>,
discuss@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">mpich.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">org
<discuss@</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">mpich.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">org>,
Jenke, </span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerStart</span></p>
</div>
<div id="x_x_x_pfptBannervdcy3qg" style="border:none; border-top:solid #90A4AE 3.0pt; padding:0in 0in 0in 0in; display:block!important; text-align:left!important; margin:0px!important; padding:16px!important; border-radius:4px!important; min-width:200px!important; background-color:#D0D8DC!important; border-top:#90a4ae!important">
<div id="x_x_x_pfptBannervdcy3qg">
<div id="x_x_x_pfptBannervdcy3qg">
<p class="x_xxmsonormal" style="line-height:13.5pt; background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif; color:black">This Message Is From an External Sender
</span></b></p>
</div>
<div id="x_x_x_pfptBannervdcy3qg">
<p class="x_xxmsonormal" style="line-height:13.5pt; background:#D0D8DC"><span style="font-family:"Arial",sans-serif; color:black">This message came from outside your organization.
</span></p>
</div>
</div>
<div>
<p class="x_xxmsonormal" style="background:#D0D8DC"><span style="color:black"> </span></p>
</div>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerEnd</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:11.0pt">Thank you so much Hui. Really appreciate it. I now understand it.</span></p>
<p class="x_xxmsonormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_x_x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_xxmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Monday, July 1, 2024 at 4:37</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="color:black">Yes, you can use rankmap to simply list out the node assignment for each rank. "-rankmap (vector,1,1,0,0,0)" is a list of 5 node ids, one for each rank. So rank 0 gets node 1, rank 1 gets node 1, rank 2 gets
node 0, and so on.</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="color:black">The -hosts options is convenient if you have somewhat uniform assignment. If you want arbitrary assignment, just use -rankmap option.</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="color:black">--</span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="color:black">Hui</span></p>
</div>
<div class="x_MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="x_x_x_divRplyFwdMsg">
<p class="x_xxmsonormal"><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:black"> Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Sent:</b> Monday, July 1, 2024 4:30 PM<br>
<b>To:</b> Zhou, Hui <zhouh@anl.gov>; discuss@mpich.org <discuss@mpich.org>; Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc:</b> nd <nd@arm.com><br>
<b>Subject:</b> Re: Custom rank for processes</span> </p>
<div>
<p class="x_xxmsonormal"> </p>
</div>
</div>
<div>
<div>
<p class="x_xxmsonormal"><span style="font-size:1.0pt; color:white">Sorry to bother you again with silly questions. How do I read the below : -rankmap (vector,1,1,0,0,0) I have 5 processes. 1 1 => means node1 will get first 2 processes ? -hosts 192.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">168.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">100:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2,192.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">168.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">2.</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">200:</span><span style="font-size:1.0pt; font-family:"Arial",sans-serif; color:white"> </span><span style="font-size:1.0pt; color:white">3
: this will give 2 process in </span></p>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerStart</span></p>
</div>
<div id="x_x_x_x_pfptBanner4epdvkz" style="border:none; border-top:solid #90A4AE 3.0pt; padding:0in 0in 0in 0in; display:block!important; text-align:left!important; margin:0px!important; padding:16px!important; border-radius:4px!important; min-width:200px!important; background-color:#D0D8DC!important; border-top:#90a4ae!important">
<div id="x_x_x_x_pfptBanner4epdvkz">
<div id="x_x_x_x_pfptBanner4epdvkz">
<p class="x_xxmsonormal" style="line-height:13.5pt; background:#D0D8DC"><b><span style="font-family:"Arial",sans-serif; color:black">This Message Is From an External Sender
</span></b></p>
</div>
<div id="x_x_x_x_pfptBanner4epdvkz">
<p class="x_xxmsonormal" style="line-height:13.5pt; background:#D0D8DC"><span style="font-family:"Arial",sans-serif; color:black">This message came from outside your organization.
</span></p>
</div>
</div>
<div>
<p class="x_xxmsonormal" style="background:#D0D8DC"><span style="color:black"> </span></p>
</div>
</div>
<div>
<p class="x_xxmsonormal"><span style="font-size:1.0pt; color:white">ZjQcmQRYFpfptBannerEnd</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="font-size:11.0pt">Sorry to bother you again with silly questions.</span></p>
<p class="x_xxxmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xxxmsonormal"><span style="font-size:11.0pt">How do I read the below :
</span></p>
<p class="x_xxxmsonormal"><span style="color:black; background:white">-rankmap (vector,1,1,0,0,0)</span></p>
<p class="x_xxxmsonormal"><span style="color:black; background:white"> </span></p>
<p class="x_xxxmsonormal"><span style="color:black; background:white">I have 5 processes. 1 1 => means node1 will get first 2 processes ?
</span></p>
<p class="x_xxxmsonormal"><span style="font-size:11.0pt"> </span></p>
<p class="x_xxxmsonormal"><span style="color:black">-hosts 192.168.2.100:2,192.168.2.200:3 : this will give 2 process in 100 and 3 in 200 .. Still won’t be able to specify which ranks goes to which node. Rank0 will be on node 100 .. what If I want Rank0 on
node 200?</span></p>
<p class="x_xxxmsonormal"><span style="color:black"> </span></p>
<p class="x_xxxmsonormal"><span style="font-size:11.0pt"> </span></p>
<div id="x_x_x_x_mail-editor-reference-message-container">
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_xxxmsonormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">Zhou, Hui <zhouh@anl.gov><br>
<b>Date: </b>Monday, July 1, 2024 at 4:09</span><span style="font-family:"Arial",sans-serif; color:black"> </span><span style="color:black">PM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, discuss@mpich.org <discuss@mpich.org>, Jenke, Joachim <jenke@itc.rwth-aachen.de><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: Custom rank for processes</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> root@ampere-altra-2-1:/# mpirun -n 5 -bind-to user:10,11,12,13 -hosts 192.168.2.200,192.168.2.100 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">Hello world from processor ampere-altra-2-1, rank 1 out of 5 processors</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">Hello world from processor ampere-altra-2-1, rank 3 out of 5 processors</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">Hello world from processor dpr740, rank 0 out of 5 processors</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">Hello world from processor dpr740, rank 4 out of 5 processors</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">Hello world from processor dpr740, rank 2 out of 5 processors</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> -bind-to user:10,11,12,13</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> This would mean on host 192.168.2.100</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> P0=>10 , P2=>11</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> This would mean on host 192.168.2.200</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> P0=>10 , P2=>11, P3=12</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Is this correct understanding ? Is it also possible to say which rank process will be pinned to which core ?<br>
<br>
Yes, that is correct. The ranks are assigned to hosts as shown in the hello world output.</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> About the rankmap:, trying to understand if I can select where a particular rank would be from > list of hosts. Currently, the first host in the list always get rank0.</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Can I specify the below ranks?</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> mpirun -n 5 -bind-to user:10,11,12,13 -hosts 192.168.2.200,192.168.2.100 /mpitutorial/tutorials/mpi-hello-world/code/mpi_hello_world</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> </span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Hello world from processor ampere-altra-2-1, rank 1 out of 5 processors => rank0</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Hello world from processor ampere-altra-2-1, rank 3 out of 5 processors. => rank1</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Hello world from processor dpr740, rank 0 out of 5 processors =>rank2</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Hello world from processor dpr740, rank 4 out of 5 processors =>rank3</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">> Hello world from processor dpr740, rank 2 out of 5 processors =>rank4<br>
<br>
Yes. You can use "-rankmap (vector,1,1,0,0,0)". Alternatively, you can use "-hosts 192.168.2.100:2,192.168.2.200:3", the colon syntax specifies how many processes you want to assign to each host.</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black"> </span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">--</span></p>
</div>
<div>
<p class="x_xxxmsonormal"><span style="color:black">Hui</span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>