[mpich-discuss] Best practices for installation procedures of ib-drivers/ucx/pmix/mpich stack

[Raffenetti, Kenneth J.]

Hi,

Both PMIx and UCX are runtime dependencies. They must be available on 
all nodes where your application runs.

Location is mostly a style decision. Many systems use /usr/local for 
packages installed manually (i.e. not by the system package manager). 
GPFS is also a fine option, which allows you to install only once.

Ken

On 12/12/19 8:54 AM, Sajid Ali via discuss wrote:
> Hi MPICH-developers,
> 
> I'm trying to help the sysadmins at my univ. cluster install mpich using 
> spack with ucx and pmix (previously we just let mpich interact with 
> slurm's pmi2 and as mentioned on the mailing list the old versions of 
> mpich either failed to read the nodelist properly or were (incorrectly) 
> configured with default TCP/IP transport protocols).
> 
> After the sysadmins installed pmix-2.2.3 and pmix-3.1.3 from rpm's at 
> /usr/lib64/pmix-version (and configured slurm to use them), I tried 
> building mpich in my home folder (on GPFS) but it was giving a build 
> error as it was picking up some wrong libraries from /usr/lib64. When I 
> installed pmix using spack in my home directory (on GPFS), I was able to 
> build mpich-devel against it.
> 
> What is the best location to install pmix and ucx? Does it have to be 
> available on every node and if yes would it be on the local file system 
> on each node or GPFS file-system ? Or is it okay to have it installed on 
> the slurm launcher node alone ?
> 
> Hope this is the right place to ask this question and thanks in advance 
> for the help!
> 
> 
> -- 
> Sajid Ali | PhD Candidate
> Applied Physics
> Northwestern University
> s-sajid-ali.github.io <http://s-sajid-ali.github.io>
> 
> _______________________________________________
> discuss mailing list     discuss at mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
>