[mpich-discuss] Runing mpich over InfiniBand Open Fabrics
Ramiro Alba
raq at cttc.upc.edu
Thu Jan 15 05:52:35 CST 2015
Hi all,
I've compiled mpich-3.1.3 on centos 6.5 with the following options:
--enable-fortran=yes \
--with-device=ch3:nemesis:ib \
--with-pm=hydra:gforker \
and the package 'libibverbs-devel' installed.
When I try to run a test hello program using two IB DDR nodes, using
the
command:
mpiexec.hydra -np 16 -bind-to core -launcher rsh -iface ib0 -hosts
jff201,jff202 mpi_hello
I've got the errors bellow, even running using with root user.
If I compile with:
--with-device=ch3:nemesis
it works with no errors.
I am also using both openmpi and mvapich2 on Infiniband and they work
fine
Am I doing something wrong when compiling and/or running?
Any sugestion is welcomed?
Thanks in advance
Regards
##########################################################################
MPICH OVER IB: RUN ERRORS
##########################################################################
Fatal error in MPI_Init: Other MPI error, error stack:
MPIR_Init_thread(498):
MPID_Init(177).......: channel initialization failed
MPIDI_CH3_Init(89)...:
MPID_nem_init(320)...:
MPID_nem_ib_init(264): MPID_nem_ib_com_open failed
Fatal error in MPI_Init: Other MPI error, error stack:
MPIR_Init_thread(498):
MPID_Init(177).......: channel initialization failed
MPIDI_CH3_Init(89)...:
MPID_nem_init(320)...:
MPID_nem_ib_init(264): MPID_nem_ib_com_open failed
[root at jff201 mpich]# mpirun -np 2 -iface eth0 mpi_hello-mpich
IB device not foundFatal error in MPI_Init: Other MPI error, error
stack:
MPIR_Init_thread(498):
MPID_Init(177).......: channel initialization failed
MPIDI_CH3_Init(89)...:
MPID_nem_init(320)...:
MPID_nem_ib_init(264): MPID_nem_ib_com_open failed
IB device not foundFatal error in MPI_Init: Other MPI error, error
stack:
MPIR_Init_thread(498):
MPID_Init(177).......: channel initialization failed
MPIDI_CH3_Init(89)...:
MPID_nem_init(320)...:
MPID_nem_ib_init(264): MPID_nem_ib_com_open failed
##########################################################################
--
Ramiro Alba
Centre Tecnològic de Tranferència de Calor
http://www.cttc.upc.edu
Escola Tècnica Superior d'Enginyeries
Industrial i Aeronàutica de Terrassa
Colom 11, E-08222, Terrassa, Barcelona, Spain
Tel: (+34) 93 739 8928
--
Aquest missatge ha estat analitzat per MailScanner
a la cerca de virus i d'altres continguts perillosos,
i es considera que est� net.
-------------- next part --------------
_______________________________________________
discuss mailing list discuss at mpich.org
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss
More information about the discuss
mailing list