<div dir="ltr">To Whom It May Concern,<div><br></div><div>Recently, I switched to CH4 device in MPICH 3.3.1 for better network performance over the RoCE network we are using.</div><div>I realized that my code fails to run when I use direct interface of OrangeFS 2.9.7. It exits without any error. But even simple helloworld cannot print anything. It happens only when I enable direct interface of OrangeFS by linking -lorangefsposix.</div><div>Could you please help me on this issue?</div><div>Here are some information that might be useful:</div><div>Output of ibv_devinfo of 40Gbps Mellanox ConnectX-4 Lx adapter:</div><div>hca_id: mlx5_0<br>        transport:                      InfiniBand (0)<br>        fw_ver:                         14.20.1030<br>        node_guid:                      248a:0703:0015:a800<br>        sys_image_guid:                 248a:0703:0015:a800<br>        vendor_id:                      0x02c9<br>        vendor_part_id:                 4117<br>        hw_ver:                         0x0<br>        board_id:                       LNV2430110027<br>        phys_port_cnt:                  1<br>                port:   1<br>                        state:                  PORT_ACTIVE (4)<br>                        max_mtu:                4096 (5)<br>                        active_mtu:             1024 (3)<br>                        sm_lid:                 0<br>                        port_lid:               0<br>                        port_lmc:               0x00<br>                        link_layer:             Ethernet<br><br>hca_id: i40iw0<br>        transport:                      iWARP (1)<br>        fw_ver:                         0.2<br>        node_guid:                      7cd3:0aef:3da0:0000<br>        sys_image_guid:                 7cd3:0aef:3da0:0000<br>        vendor_id:                      0x8086<br>        vendor_part_id:                 14289<br>        hw_ver:                         0x0<br>        board_id:                       I40IW Board ID<br>        phys_port_cnt:                  1<br>                port:   1<br>                        state:                  PORT_ACTIVE (4)<br>                        max_mtu:                4096 (5)<br>                        active_mtu:             1024 (3)<br>                        sm_lid:                 0<br>                        port_lid:               1<br>                        port_lmc:               0x00<br>                        link_layer:             Ethernet<br></div><div>MPICH 3.3.1 configuration command: ./configure --with-device=ch4:ofi --with-pvfs2=/home/kfeng/install --enable-shared --enable-romio --with-file-system=ufs+pvfs2+zoidfs --enable-fortran=no --with-libfabric=/home/kfeng/install</div><div>OrangeFS 2.9.7 configuration command: ./configure --prefix=/home/kfeng/install --enable-shared --enable-jni --with-jdk=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64 --with-kernel=/usr/src/kernels/3.10.0-862.el7.x86_64</div><div>Make command: mpicc -o ~/hello ~/hello.c -L/home/kfeng/install/lib -lorangefsposix</div><div>The verbose outputs of mpiexec are attached.</div><div><br clear="all"><div><div dir="ltr" data-smartmail="gmail_signature"><div dir="ltr">Thanks<div>Kun</div></div></div></div></div></div>