<div style="font-family: Helvetica; font-size: 13px; ">Can you update to a recent version of MPICH? 1.4.1p is very old at this point. The most recent stable version is 3.0.4.<div><br></div><div>Wesley</div></div>
<div></div>
<p style="color: #A0A0A8;">On Tuesday, August 13, 2013 at 9:43 AM, 정재용 wrote:</p>
<blockquote type="cite" style="border-left-style:solid;border-width:1px;margin-left:0px;padding-left:10px;">
<span><div><div>
<div style="width:100%"> <span style="font-family: Dotum; font-size: small;">I set up 2 node cluster and installed mpich by using intel compiler. OS is CentOS 6.4 </span><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">Each node is connected by ethernet. They shared directories where the compiler and mpich are installed, by using nfs.</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">SSH co
nnection can be done without password.</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">By way of experiment, I compiled simple example of MPI_File_open with mpicc and executed by mpiexec on the nfs directory.</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">The code is </span></div><div><p style="margin-top: 0.5em; margin-bottom: 0.9em; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 11.818181991577148px; line-height: 17.017045974731445px;">#include "mpi.h"<br>#include</p><p style="margin-top: 0.5em; margin-bottom: 0.9em; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 11.818181991577148px; line-height: 17.017045974731445px;">int main( int argc, char *argv[] )<br>{<br>MPI_Fint handleA, handleB;<br>int rc;<br>int errs = 0;<br>int rank;<br>MPI_File cFile;<!--
p--></p><p style="margin-top: 0.5em; margin-bottom: 0.9em; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 11.818181991577148px; line-height: 17.017045974731445px;">MPI_Init( &argc, &argv );<br>MPI_Comm_rank( MPI_COMM_WORLD, &rank );<br>rc = MPI_File_open( MPI_COMM_WORLD, "temp", MPI_MODE_RDWR | MPI_MODE_DELETE_ON_CLOSE | MPI_MODE_CREATE, MPI_INFO_NULL, &cFile );<br>if (rc) {<br>printf( "Unable to open file \"temp\"\n" );fflush(stdout);<br>}<br>else {<br>MPI_File_close( &cFile );<br>}<br>MPI_Finalize();<br>return 0;<br>}</p><p style="margin-top: 0.5em; margin-bottom: 0.9em; font-family: Verdana, Arial, Helvetica, sans-serif; font-size: 11.818181991577148px; line-height: 17.017045974731445px;"><br></p></div><div><span style="font-family: Dotum; font-size: small;">This example just opens the file and closes it in parallel.</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; fon
t-size: small;">On the single machine, it worked well.</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">However, it didn't work when 2 machines' processor executed the code in parallel.</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">The error message:</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Gulim; font-size: 13px; ">Internal Error: invalid error code 209e0e (Ring ids do not match) in MPIR_Bcast_intra:1119</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">Fatal error in PMPI_Bcast: Other MPI error, error stack:</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">PMPI_Bcast(1478)......: MPI_Bcast(b
uf=0x1deb980, count=1, MPI_CHAR, root=0, comm=0x84000004) failed</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPIR_Bcast_impl(1321).: </span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPIR_Bcast_intra(1119): </span><br style="font-family: Gulim; font-size: 13px; "></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><div><span style="font-family: Dotum; font-size: small;">When I added the prefix nfs: to the filename, as "nfs:temp", it worked well. </span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">However, I don't want to add that because I should execute very big code on the cluster. </span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum;
font-size: small;">It is very hard to modify the code. </span><span style="font-family: Dotum; font-size: small;">Would you let me know what the problem is and how the problem is solved?</span></div></div><div><br></div><div><span style="font-family: Dotum; font-size: small;">The nfs options are</span></div><div><span style="font-family: Dotum; font-size: small;">(client)</span></div><div><span style="font-family: Dotum; font-size: small;">mount -t nfs -o noac,nfsvers=3 "server_directory" "mount_directory"</span></div><div><span style="font-family: Dotum; font-size: small;">(server, /etc/exports)</span></div><div><span style="font-family: Dotum; font-size: small;">sync,rw,no_root_squash</span></div><div><span style="font-family: Dotum; font-size: small;"><br></span></div><div><span style="font-family: Dotum; font-size: small;">I shared /opt and /home/username </span></div><div><br></div><div>mpich configuration is</div><div><span style="font-family: Gulim; font-siz
e: medium;">MPICH2 Version: 1.4.1p1</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPICH2 Release date: Thu Sep 1 13:53:02 CDT 2011</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPICH2 Device: ch3:nemesis</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPICH2 configure: --prefix=/home/master/lib/mpich/mpich2-1.4.1p1 CC=icc F77=ifort CXX=icpc FC=ifort --enable-romio --with-file-system=nfs+ufs --with-pm=hydra</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPICH2 CC: icc -O2</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: mediu
m;">MPICH2 CXX: icpc -O2</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPICH2 F77: ifort -O2</span><br style="font-family: Gulim; font-size: 13px; "><span style="font-family: Gulim; font-size: 13px; ">MPICH2 FC: ifort -O2</span><br style="font-family: Gulim; font-size: 13px; "></div><div><br></div> </div><table border="0" cellpadding="0" cellspacing="0" style="width:100%; padding:30 10 10 10"><tbody><tr><td style="font-family:Gulim; font-size:12px;"> <div><p>------------------------------------------------------<br></p>
<p>Jaeyong Jeong</p>
<p>Department of Mechanical Engineering</p>
<p>Pohang University of Science and Technology</p>
<p> </p>
<p> </p> </div>
</td><td width="15"></td></tr></tbody></table>
<img src="http://webmail.postech.ac.kr/mail/PutAck.jsp?ack_args=c2VudF9maWxlPWh1dGluYXgyQHBvc3RlY2guYWMua3IvLlNlbnQvMTM3NjQwNDk4NDY0My43MTg5My5wb3N0ZWNoJnNlbmRfZGF0ZT0yMDEzMDgxMzIzNDMwNCZzdWJqZWN0PVttcGljaC1kaXNjdXNzXU1QSV9GaWxlX29wZW4gZmFpbHMgb24gdGhlIGNsdXN0ZXIgKDIgbm9kZSk=&to_email=discuss@mpich.org_____________________________________________________________________________________________________________________________________" width="1" border="0" height="1">
</div><div><div>_______________________________________________</div><div>discuss mailing list <a href="mailto:discuss@mpich.org">discuss@mpich.org</a></div><div>To manage subscription options or unsubscribe:</div><div><a href="https://lists.mpich.org/mailman/listinfo/discuss">https://lists.mpich.org/mailman/listinfo/discuss</a></div></div></div></span>
</blockquote>
<div>
<br>
</div>