[mpich-discuss] ssh-less MPI using docker exec?
Balaji, Pavan
balaji at anl.gov
Mon Apr 4 12:03:20 CDT 2016
Christian,
Supporting a new launcher is fairly trivial in Hydra (mpich's process manager). You'd need to create something similar to 'ssh' in here: http://git.mpich.org/mpich.git/tree/HEAD:/src/pm/hydra/tools/bootstrap/external
In fact, based on a google search, I found this:
https://docs.docker.com/engine/reference/commandline/exec/
It looks like you can simply replace "ssh" with "docker exec" to get the required behavior? If that is correct, can you try launching mpich this way:
% HYDRA_LAUNCHER_EXTRA_ARGS=exec mpiexec -hosts host1,host2 -launcher-exec 'docker' ./foo
-- Pavan
> On Apr 3, 2016, at 4:56 AM, Christian Kniep <christian at qnib.org> wrote:
>
> Hey Pavan,
>
> I sparked a discussion on the github repo of Open MPI: https://github.com/open-mpi/ompi/issues/1511
> But I assume that a docker-native execution model would also do for MPICH.
>
> Cheers
> Christian
>
> On 3 April 2016 at 05:18:36, Balaji, Pavan (balaji at anl.gov) wrote:
>
>>
>> Did you mean to send this to the Open MPI mailing list?
>>
>> -- Pavan
>>
>> > On Mar 31, 2016, at 12:56 PM, Christian Kniep <christian at qnib.org> wrote:
>> >
>> > Hey there,
>> >
>> > I tinkered around with a ssh-less openmpi and I was wondering if it could be implemented in a nicer way. http://qnib.org/2016/03/31/dssh/
>> >
>> > I just used -mca plm_rsh_agent /opt/qnib/src/dssh with a rather simple script to use docker exec:
>> >
>> > #!/bin/bash
>> >
>> > REMOTE_HOST=$1
>> > shift
>> > set -x
>> > docker -H
>> > unix:///var/run/docker.sock
>> > exec -i -u ${USER} ${REMOTE_HOST} $@
>> >
>> > Cheers Christian
>> >
>> >
>> >
>> >
>> >
>> >
>> > _______________________________________________
>> > discuss mailing list discuss at mpich.org
>> > To manage subscription options or unsubscribe:
>> > https://lists.mpich.org/mailman/listinfo/discuss
>>
>> _______________________________________________
>> discuss mailing list discuss at mpich.org
>> To manage subscription options or unsubscribe:
>> https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________
discuss mailing list discuss at mpich.org
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss
More information about the discuss
mailing list