<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Lucida Grande";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
code
{mso-style-priority:99;
font-family:"Courier New";}
p.xmsonormal, li.xmsonormal, div.xmsonormal
{mso-style-name:x_msonormal;
margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Arial",sans-serif;
color:windowtext;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">I tried -configfile option and it further crashed with a memory failure.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">The configfile itself has 1199 words/23777 characters. Overall it has 4 lines for 4 partitions.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">*** Error in `vmpiexec': double free or corruption (out): 0x00000000007001e0 ***<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">======= Backtrace: =========<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">/lib64/libc.so.6(+0x81329)[0x7ffff7206329]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">vmpiexec[0x4262a9]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">vmpiexec[0x4220ed]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">vmpiexec[0x409d23]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">vmpiexec[0x4035da]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">/lib64/libc.so.6(__libc_start_main+0xf5)[0x7ffff71a7555]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">vmpiexec[0x404c05]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">======= Memory map: ========<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">00400000-0047c000 r-xp 00000000 00:77 2085572302 ./mpich2/linux_x86_64/bin/mpiexec.hydra<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">0067b000-0067e000 rw-p 0007b000 00:77 2085572302 ./mpich2/linux_x86_64/bin/mpiexec.hydra<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">0067e000-00bd9000 rw-p 00000000 00:00 0 [heap]<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff0000000-7ffff0021000 rw-p 00000000 00:00 0
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff0021000-7ffff4000000 ---p 00000000 00:00 0
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6b45000-7ffff6b6a000 r-xp 00000000 08:02 45522 /usr/lib64/liblzma.so.5.2.2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6b6a000-7ffff6d69000 ---p 00025000 08:02 45522 /usr/lib64/liblzma.so.5.2.2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6d69000-7ffff6d6a000 r--p 00024000 08:02 45522 /usr/lib64/liblzma.so.5.2.2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6d6a000-7ffff6d6b000 rw-p 00025000 08:02 45522 /usr/lib64/liblzma.so.5.2.2<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6d6b000-7ffff6d80000 r-xp 00000000 08:02 447697 /usr/lib64/libz.so.1.2.7<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6d80000-7ffff6f7f000 ---p 00015000 08:02 447697 /usr/lib64/libz.so.1.2.7<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6f7f000-7ffff6f80000 r--p 00014000 08:02 447697 /usr/lib64/libz.so.1.2.7<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6f80000-7ffff6f81000 rw-p 00015000 08:02 447697 /usr/lib64/libz.so.1.2.7<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6f81000-7ffff6f83000 r-xp 00000000 08:02 45003 /usr/lib64/libdl-2.17.so<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff6f83000-7ffff7183000 ---p 00002000 08:02 45003 /usr/lib64/libdl-2.17.so<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">7ffff7183000-7ffff7184000 r--p 00002000 08:02 45003 /usr/lib64/libdl-2.17.so<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Tarun<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Kumar, Tarun (DI SW ICS DVT RD QSCE) <br>
<b>Sent:</b> Monday, September 18, 2023 3:16 PM<br>
<b>To:</b> Zhou, Hui <zhouh@anl.gov>; discuss@mpich.org; Thakur, Rajeev <thakur@anl.gov><br>
<b>Cc:</b> Raffenetti, Ken <raffenet@anl.gov><br>
<b>Subject:</b> RE: [mpich-discuss] Core dump in parse_args<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Thanks. Good to know. I will explore further.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Tarun<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Zhou, Hui <<a href="mailto:zhouh@anl.gov">zhouh@anl.gov</a>>
<br>
<b>Sent:</b> Monday, September 18, 2023 2:34 PM<br>
<b>To:</b> <a href="mailto:discuss@mpich.org">discuss@mpich.org</a>; Thakur, Rajeev <<a href="mailto:thakur@anl.gov">thakur@anl.gov</a>><br>
<b>Cc:</b> Raffenetti, Ken <<a href="mailto:raffenet@anl.gov">raffenet@anl.gov</a>>; Kumar, Tarun (DI SW ICS DVT RD QSCE) <<a href="mailto:kumar.tarun@siemens.com">kumar.tarun@siemens.com</a>><br>
<b>Subject:</b> Re: [mpich-discuss] Core dump in parse_args<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Hydra supports </span>
<code><span style="font-size:10.0pt;color:black">-configfile {name}</span></code><span style="font-size:12.0pt;color:black"> option, so one could try putting all his commandline arguments in a file and pass that to hydra.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Hui<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="98%" align="center">
</div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">From:</span></b><span style="color:black"> Raffenetti, Ken via discuss <</span><a href="mailto:discuss@mpich.org">discuss@mpich.org</a><span style="color:black">><br>
<b>Sent:</b> Monday, September 18, 2023 4:22 PM<br>
<b>To:</b> </span><a href="mailto:discuss@mpich.org">discuss@mpich.org</a><span style="color:black"> <</span><a href="mailto:discuss@mpich.org">discuss@mpich.org</a><span style="color:black">>; Thakur, Rajeev <</span><a href="mailto:thakur@anl.gov">thakur@anl.gov</a><span style="color:black">><br>
<b>Cc:</b> Raffenetti, Ken <</span><a href="mailto:raffenet@anl.gov">raffenet@anl.gov</a><span style="color:black">>;
</span><a href="mailto:kumar.tarun@siemens.com">kumar.tarun@siemens.com</a><span style="color:black"> <</span><a href="mailto:kumar.tarun@siemens.com">kumar.tarun@siemens.com</a><span style="color:black">><br>
<b>Subject:</b> Re: [mpich-discuss] Core dump in parse_args</span> <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="xmsonormal">I’m not aware of a hard-coded limit, but I am able to reproduce a segfault reliably by passing 1000 arguments a toy executable. Will update with more info when we have it.<o:p></o:p></p>
<p class="xmsonormal"> <o:p></o:p></p>
<p class="xmsonormal">Ken<o:p></o:p></p>
<p class="xmsonormal"> <o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal" style="margin-left:.5in"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">"kumar.tarun--- via discuss" <</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Reply-To: </b>"</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">" <</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Date: </b>Friday, September 15, 2023 at 4:57 PM<br>
<b>To: </b>"Thakur, Rajeev" <</span><a href="mailto:thakur@anl.gov"><span style="font-size:12.0pt">thakur@anl.gov</span></a><span style="font-size:12.0pt;color:black">>, "</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">"
<</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Cc: </b>"</span><a href="mailto:kumar.tarun@siemens.com"><span style="font-size:12.0pt">kumar.tarun@siemens.com</span></a><span style="font-size:12.0pt;color:black">" <</span><a href="mailto:kumar.tarun@siemens.com"><span style="font-size:12.0pt">kumar.tarun@siemens.com</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Subject: </b>Re: [mpich-discuss] Core dump in parse_args</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="margin-left:.5in"> <o:p></o:p></p>
</div>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Thanks Rajeev for your reply.
</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">I don’t have the exact number as of now. It’s definitely more than 1000. Is there a hard coded limit?</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Regards<br>
Tarun</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal" style="margin-left:.5in"><b>From:</b> Thakur, Rajeev <<a href="mailto:thakur@anl.gov">thakur@anl.gov</a>>
<br>
<b>Sent:</b> Friday, September 15, 2023 2:40 PM<br>
<b>To:</b> <a href="mailto:discuss@mpich.org">discuss@mpich.org</a><br>
<b>Cc:</b> Kumar, Tarun (DI SW ICS DVT RD QSCE) <<a href="mailto:kumar.tarun@siemens.com">kumar.tarun@siemens.com</a>><br>
<b>Subject:</b> Re: [mpich-discuss] Core dump in parse_args<o:p></o:p></p>
</div>
</div>
<p class="xmsonormal" style="margin-left:.5in"> <o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-family:"Lucida Grande"">How many arguments?</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-family:"Lucida Grande""> </span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-family:"Lucida Grande"">Rajeev</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-family:"Lucida Grande""> </span><o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="xmsonormal" style="margin-left:.5in"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">"kumar.tarun--- via discuss" <</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Reply-To: </b>"</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">" <</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Date: </b>Friday, September 15, 2023 at 4:22 PM<br>
<b>To: </b>"</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">" <</span><a href="mailto:discuss@mpich.org"><span style="font-size:12.0pt">discuss@mpich.org</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Cc: </b>"</span><a href="mailto:kumar.tarun@siemens.com"><span style="font-size:12.0pt">kumar.tarun@siemens.com</span></a><span style="font-size:12.0pt;color:black">" <</span><a href="mailto:kumar.tarun@siemens.com"><span style="font-size:12.0pt">kumar.tarun@siemens.com</span></a><span style="font-size:12.0pt;color:black">><br>
<b>Subject: </b>[mpich-discuss] Core dump in parse_args</span><o:p></o:p></p>
</div>
<div>
<p class="xmsonormal" style="margin-left:.5in"> <o:p></o:p></p>
</div>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hi,</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> I recently encountered this crash where mpiexec when executed from a bash script and with a large number of arguments crashes. The core dump is
as follows:</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">#0 0x0000000000408ec3 in parse_args ()</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">#1 0x0000000000409f26 in HYD_uii_mpx_get_parameters ()</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">#2 0x000000000040397a in main ()</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">If I reduce the number of arguments then I don’t see the crash. Is it a known issue?</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Regards</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Tarun</span><o:p></o:p></p>
<p class="xmsonormal" style="margin-left:.5in"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>