[mpich-discuss] determinism in collectives

Dave Goodell goodell at mcs.anl.gov
Tue Nov 13 12:21:24 CST 2012

Oops :(

There's nothing new in my previous post relative to the other comments in this thread, please ignore me.  I haven't updated my mail filters for the lists.mcs.anl.gov --> mpich.org switch yet, so I didn't see the rest of the thread after Nick's original email.


On Nov 13, 2012, at 12:17 PM CST, Dave Goodell wrote:

> On Nov 12, 2012, at 9:00 PM CST, Nichols A. Romero wrote:
>> Are collective operations, such as sums, using MPI_Reduce deterministic? In other words, if I run MPI_Reduce N times on P tasks, will the sums always occur in the same order. Thus it would be reproducible to the expected precision.
> In practice, this usually holds, and it's even recommended by the MPI standard (see MPI-3, sec. 5.9, p.175, l.9-13).  However, you may not be able to capture all inputs to a collective routine, and it's entirely reasonable for future versions of MPICH (or any MPI library) to attempt to use adaptive methods for selecting collective algorithms.  Such adaptive behavior could easily disturb the commutivity/associativity of your reduction collective.

More information about the discuss mailing list