[mpich-discuss] how to dynamically schedule process in mpich

[Shuwei Zhao]

Hi, Hui,

Thanks for your response, I have already read through the docs that you
said. It's very useful.
although I did some research still have some questions:
IMHO, there are 2 possible ways to do dynamic scheduling of cpu cores:
1. using mpi_comm_spawn to spawn a new hydra_pmi_proxy on a different port
or using mpi_comm_spawn_multiple to spawn new processes on the same port
but my question is that how to start the new processes on a remote machine,
using farm resource manager(qsub,bsub,etc)? *Is there a reserved keyword in
the MPI_info that can qualify for this function?*
2. using mpi_comm_connect to connect an already started mpi application to
connect to another mpi application, but I didn't find some useful testcases
yet. Do you know if this way is possible?

Thanks,
Shuwei


On Thu, Nov 8, 2018 at 4:52 PM Zhou, Hui <zhouh at anl.gov> wrote:

> I am by far not an expert on MPI dynamic process at this point. I will
> point you to the MPI standards https://www.mpi-forum.org/docs/, in
> particular, chapter 10. MPICH implements most of the standards. Try follow
> the standards to see what you can do. If you hit specific problem, post
> back here and some one will help you.
>
> Cheers,
> —
> Hui Zhou
>
>
>
>
>
>
>
>
>
> On Nov 6, 2018, at 5:20 PM, Shuwei Zhao via discuss <discuss at mpich.org>
> wrote:
>
> Hi, Experts,
>
> I have a question about if mpich can do dynamically allocate/schedule/kill
> process on the runtime? If that’s doable, how can we do that?
>
> Let’s see an example:
> qsub -P my_queue -pe mpi 8 mpiexec my_exe
> Distribute mpich application on 8 processes each on a single machine.
> During the application runtime, can we dynamically (allocate &
> start)/(remove & kill) one process and (add to)/(delete from) the current
> communication group ?
>
> Appreciate your help ahead!
>
> Thanks,
> Shuwei
>
> _______________________________________________
> discuss mailing list     discuss at mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mpich.org/pipermail/discuss/attachments/20181113/becf7b0a/attachment.html>