<html dir="ltr"><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">
<div>
<div>Hi Sylvain,</div>
<div><br>
</div>
<div>IB netmod is contributed by RIKEN and they are working on cleaning up this netmod. At the meantime, I would recommend using MXM netmod instead by specifying “—with-device=ch3:nemesis:mxm”. MXM is a netmod for IB networks using the MXM API instead of Verbs
to interact with the HCA. Note that it is only for Mellanox hardware.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Xin</div>
</div>
<div><br>
</div>
<div>
<div>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF230755" style="direction: ltr;"><font face="Tahoma" size="2" color="#000000"><b>From:</b> Korzennik, Sylvain [skorzennik@cfa.harvard.edu]<br>
<b>Sent:</b> Saturday, March 07, 2015 5:18 PM<br>
<b>To:</b> discuss@mpich.org<br>
<b>Subject:</b> [mpich-discuss] Building mpich 1.3.4 w/ IB enabled<br>
</font><br>
</div>
<div></div>
<div>
<div dir="ltr">
<div class="gmail_default" style="font-family:monospace,monospace; font-size:small">
I downloaded mpich-1.3.4.tar.gz and was able to build it with GCC 4.9.1 and the following configure flags:<br>
<br>
<span style="color:rgb(0,0,255)"><font size="1">./configure \<br>
CC=/opt/gnu/gcc/bin/gcc \<br>
FC=/opt/gnu/gcc/bin/gfortran \<br>
CXX=/opt/gnu/gcc/bin/g++ \<br>
--enable-static \<br>
--with-device=ch3:nemesis \<br>
--with-thread-package=posix \<br>
--with-pm=hydra \<br>
--enable-shared \<br>
--enable-debuginfo \<br>
--prefix=$dest<br>
</font></span><br>
<br clear="all">
</div>
<div class="gmail_default" style="font-family:monospace,monospace; font-size:small">
If instead I try to build w/ IB support, namely:<br>
<br>
<span style="color:rgb(0,0,255)"><font size="1">./configure \<br>
CC=/opt/gnu/gcc/bin/gcc \<br>
FC=/opt/gnu/gcc/bin/gfortran \<br>
CXX=/opt/gnu/gcc/bin/g++ \<br>
--enable-static \<br>
<span style="color:rgb(255,0,0)">--with-device=ch3:nemesis:ib</span> \<br>
--with-thread-package=posix \<br>
--with-pm=hydra \<br>
--enable-shared \<br>
--enable-debuginfo \<br>
--prefix=$dest</font></span><br>
<br>
</div>
<div class="gmail_default" style="font-family:monospace,monospace; font-size:small">
I get the following (slew) of errors when building (make):<br>
<br>
<span style="color:rgb(0,0,255)"><font size="1"> CC src/mpid/ch3/channels/nemesis/netmod/ib/lib_libmpi_la-ib_poll.lo<br>
src/mpid/ch3/channels/nemesis/netmod/ib/ib_poll.c: In function 'MPID_nem_ib_Pkt\<br>
Handler_Put':<br>
src/mpid/ch3/channels/nemesis/netmod/ib/ib_poll.c:1839:24: error: 'MPIDI_CH3_Re\<br>
qHandler_PutRecvComplete' undeclared (first use in this function)<br>
req->dev.OnFinal = MPIDI_CH3_ReqHandler_PutRecvComplete;<br>
^<br>
src/mpid/ch3/channels/nemesis/netmod/ib/ib_poll.c:1839:24: note: each undeclared identifier is reported only once for each function it appears in<br>
src/mpid/ch3/channels/nemesis/netmod/ib/ib_poll.c:1847:20: error: 'MPIDI_CH3_Pkt_put_t' has no member named 'immed_len'<br>
if (put_pkt->immed_len > 0) {<br>
^<br>
In file included from ./src/mpid/ch3/channels/nemesis/include/mpid_nem_memdefs.h:10:0,<br>
from ./src/mpid/ch3/channels/nemesis/include/mpid_nem_pre.h:12,<br>
from ./src/mpid/ch3/channels/nemesis/include/mpidi_ch3_pre.h:9,<br>
from ./src/mpid/ch3/include/mpidpre.h:49,<br>
from ./src/include/mpiimpl.h:172,<br>
from ./src/mpid/ch3/include/mpidimpl.h:22,<br>
from ./src/mpid/ch3/channels/nemesis/include/mpidi_ch3_impl.h:10,<br>
from ./src/mpid/ch3/channels/nemesis/include/mpid_nem_impl.h:11,<br>
from src/mpid/ch3/channels/nemesis/netmod/ib/ib_impl.h:11,<br>
from src/mpid/ch3/channels/nemesis/netmod/ib/ib_poll.c:8:<br>
src/mpid/ch3/channels/nemesis/netmod/ib/ib_poll.c:1849:66: error: 'MPIDI_CH3_Pkt_put_t' has no member named 'immed_len'<br>
MPIU_Memcpy(req->dev.user_buf, put_pkt->data, put_pkt->immed_len);<br>
[...]</font></span><br>
</div>
<br>
<div class="gmail_default" style="font-family:monospace,monospace; font-size:small">
What I am doing wrong? Is there a documentation on the values that can be used for --with-device<br>
</div>
<div class="gmail_default" style="font-family:monospace,monospace; font-size:small">
and how to build mpich w/ InfiniBand support.</div>
<br>
<div class="gmail_signature">
<div dir="ltr">
<div><font><font> </font><span style="font-family:courier new,monospace">Cheers,<br>
</span></font></div>
<font><span style="font-family:courier new,monospace"> Sylvain<br>
</span><font><span style="font-family:courier new,monospace">--</span><br>
<br>
</font></font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>