<div dir="auto">Hi Hui </div><div dir="auto"><br></div><div dir="auto">I cannot run mpiexec directly on my hosts because both rsh and ssh connections are disabled. I have to use qsub -P bnormal -pe dp 4 mpiexec ./my_exe to run my binary on remote hosts. </div><div dir="auto"><br></div><div dir="auto">Thanks </div><div dir="auto">Shuwei</div><div><br><div class="gmail_quote"><div>On Wed, Nov 28, 2018 at 16:59 Zhou, Hui <<a href="mailto:zhouh@anl.gov">zhouh@anl.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">



<div style="word-wrap:break-word;line-break:after-white-space">
<div style="word-wrap:break-word;line-break:after-white-space">
Hi Shuwei,
<div><br>
</div>
<div>Were you able to run over multiple hosts directly, e.g.:</div>
<div><br>
</div>
<div>```</div>
<div>$ mpiexec -n 2 -hosts “hostname_1,hostname_2” ./cpi</div>
<div>```</div>
<div>?</div>
<div><br>
</div>
<div>
<div>
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space">
<div dir="auto" style="word-wrap:break-word;line-break:after-white-space">
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
— </div></div></div></div></div></div></div></div></div><div style="word-wrap:break-word;line-break:after-white-space"><div style="word-wrap:break-word;line-break:after-white-space"><div><div><div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space"><div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space"><div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space"><div dir="auto" style="word-wrap:break-word;line-break:after-white-space">
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
Hui Zhou</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<br>
</div>
<div style="color:rgb(0,0,0);font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<br>
</div>
<br class="m_-4187978857954510742Apple-interchange-newline">
</div>
</div>
<br class="m_-4187978857954510742Apple-interchange-newline">
</div>
<br class="m_-4187978857954510742Apple-interchange-newline">
</div>
<br class="m_-4187978857954510742Apple-interchange-newline">
<br class="m_-4187978857954510742Apple-interchange-newline">
</div>
<div><br>
<blockquote type="cite">
<div>On Nov 28, 2018, at 3:33 PM, Shuwei Zhao <<a href="mailto:shuweizhao1991@gmail.com" target="_blank">shuweizhao1991@gmail.com</a>> wrote:</div>
<br class="m_-4187978857954510742Apple-interchange-newline">
<div>
<div dir="auto">Hi hui </div>
<div dir="auto"><br>
</div>
<div dir="auto">I tried your suggestion but looks like the newly spawned jobs are using ssh to distribute on the new hosts. Howver In my machine farm, ssh & rsh connections are disabled. have to submit through qsub network interface. Is using qsub
  possible in mpi_comm_spawn? </div>
<div dir="auto"><br>
</div>
<div dir="auto">Thanks a lot</div>
<div dir="auto">Shuwei</div>
<div><br>
<div class="gmail_quote">
<div>On Mon, Nov 19, 2018 at 09:21 Zhou, Hui <<a href="mailto:zhouh@anl.gov" target="_blank">zhouh@anl.gov</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
On Sun, Nov 18, 2018 at 10:33:48PM -0600, Shuwei Zhao wrote:<br>
>2. About the MPI_Info object, I tried to use mpi_comm_spawn on the same<br>
>machine, it can work. But I don't know how to spawn processes cross<br>
>machines. For example, if I have 4 processes on machine 1, and I want to<br>
>spawn 4 more processes on other machines (resource managed by qsub), how do<br>
>I need to declare in the MPI_Info object?<br>
<br>
Did you try setting the host parameter in the info object? For <br>
example:<br>
<br>
    MPI_Info info;<br>
    MPI_Info_create(&info, "host", "A,B,C");<br>
<br>
    MPI_Comm_spawn("worker", MPI_ARGV_NULL, n_hosts, info, 0, <br>
MPI_COMM_SELF, &comm_workers, MPI_ERRCODES_IGNORE)?<br>
<br>
    MPI_Info_free(&info);<br>
<br>
Replace "A,B,C" with host name list that you want to spawn process on.<br>
<br>
-- <br>
Hui Zhou<br>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>

</blockquote></div></div>