<html dir="ltr"><head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Hi Victor,
<div><br>
</div>
<div>I think it is due to a bug for MPI_PUT to handle large derived datatype and we will fix it as soon as possible. The code works with MPI_GET.</div>
<div><br>
</div>
<div>You can track this bug at: https://trac.mpich.org/projects/mpich/ticket/2189</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Xin</div>
<div><br>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF18888" style="direction: ltr;"><font face="Tahoma" size="2" color="#000000"><b>From:</b> Victor Vysotskiy [victor.vysotskiy@teokem.lu.se]<br>
<b>Sent:</b> Thursday, October 16, 2014 11:19 AM<br>
<b>To:</b> discuss@mpich.org<br>
<b>Subject:</b> Re: [mpich-discuss] Problem with RMA && MPI_Type_vector when stride value is relatively large (UPD)<br>
</font><br>
</div>
<div></div>
<div>
<div style="direction:ltr; font-family:Tahoma; color:#000000; font-size:10pt">Hi,
<div><br>
</div>
<div>I am sorry that the test bed code has not been attached to the original message. </div>
<div>Enclosed please find it. I have also checked the issue in MPICH v3.1.3. Unfortunately,</div>
<div>the latest MPICH3 version behaves exactly the same as the MPICH2 v1.5, i.e. it also hangs </div>
<div><span style="color:rgb(83,87,94); font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px">at "30000 2000". </span></div>
<div><br>
<div>With best regards,<br>
<div style="font-family:Tahoma; font-size:13px">
<div class="BodyFragment"><font size="2"><span style="font-size:10pt">
<div class="PlainText"><span style="font-size:10pt">Victor.</span></div>
<div class="PlainText"><span style="font-size:10pt"><br>
</span></div>
<div class="PlainText">P.s. <span style="color:rgb(83,87,94); font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px">Below is given an update on MPICH3 version used:</span></div>
<div class="PlainText">
<div>
<div class="BodyFragment"><font size="2"><span style="font-size:10pt">
<div class="PlainText">
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 Version: 3.1.3</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 Release date: Wed Oct 8 09:37:19 CDT 2014</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 Device: ch3:nemesis</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 configure: --prefix=/opt/mpi/mpich3-1.3/ --disable-weak-symbols</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 CC: gcc -O2</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 CXX: c++ -O2</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 F77: gfortran -O2</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 FC: gfortran -O2</p>
<div><br>
</div>
<div>GCC version 4.7.3</div>
</div>
</span></font></div>
</div>
</div>
</span></font></div>
</div>
</div>
<div style="font-family:Times New Roman; color:#000000; font-size:16px">
<hr tabindex="-1">
<div id="divRpF559000" style="direction:ltr"><font face="Tahoma" size="2" color="#000000"><b>From:</b> Victor Vysotskiy<br>
<b>Sent:</b> Thursday, October 16, 2014 1:34 PM<br>
<b>To:</b> discuss@mpich.org<br>
<b>Subject:</b> Problem with RMA && MPI_Type_vector when stride value is relatively large<br>
</font><br>
</div>
<div></div>
<div>
<div style="direction:ltr; font-family:Tahoma; color:#000000; font-size:10pt">
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
Hi, </p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
I am straggling with a simple MPI program when a vector derived datatype is used as origin/remote datatypes in the MPI_Put RMA operation. The underlying idea is quite simple: a contiguous piece of memory is interpreted as a 2D array and only its certain slice
is going to be updated via MPI_Put. To this end, I am using a MPI_Type_vector call. Everything works fine when the stride value <= 24000, regardless count and blocklength. However, if stride is greater than 24000 then program simply hangs. The source code
is attached and you can simply verify the issue by compiling and running it with the following parameters:</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
mpicc mpi_tvec_rma.c</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
mpirun -np 2 ./a.out 10000 2000 </p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
Ok</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
mpirun -np 2 ./a.out 20000 2000 </p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
Ok</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
mpirun -np 2 ./a.out 30000 2000 </p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
Hangs</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
Is there any internal/known limits to the size of MPI_TYPE_VECTOR datatypes?</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
So, I am really puzzled what is happening here and any help will be greatly appreciated! </p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
With best regards,</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
Victor.</p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
P.S. The attached code is perfectly runs with the OpenMPI v1.8.2. </p>
<p style="margin-right:0px; margin-bottom:1.5em; margin-left:0px; padding:0px; font-family:Arial,宋体,Tahoma,Helvetica,sans-serif; font-size:12px; color:rgb(83,87,94)">
P.P.S. Below are given some details about hardware and software setups used:</p>
<div>
<div style="font-family:Tahoma; font-size:13px">
<div class="BodyFragment"><font size="2"><span style="font-size:10pt">
<div class="PlainText">
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 Version: 1.5</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 Release date: Mon Oct 8 14:00:48 CDT 2012</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 Device: ch3:nemesis</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 configure: --prefix=/opt/mpi/mpich2/ --disable-weak-symbols</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 CC: gcc -O2</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 CXX: c++ -O2</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 F77: gfortran -O2</p>
<p style="margin-right:0px; margin-left:0px; font-size:11px; font-family:Menlo">MPICH2 FC: gfortran -O2</p>
<div><br>
</div>
<div>GCC version 4.7.3</div>
<div><br>
</div>
<div><br>
</div>
</div>
</span></font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>