[mpich-discuss] determinism in collectives
Pavan Balaji
balaji at mcs.anl.gov
Mon Nov 12 21:43:24 CST 2012
The default machine-independent implementation of MPICH is
deterministic. However, each device can (and most times does) implement
its own version of MPI_Reduce. We have no control on them.
-- Pavan
On 11/12/2012 09:40 PM US Central Time, Jeff Hammond wrote:
> We are primarily interested in MPICH2, as the motivation for this
> question relates to a particular supercomputer that uses MPICH2 and,
> in particular, the MPICH2 implementation of MPI_Reduce for
> (comm,type,op) of interest to us.
>
> Jeff
>
> On Mon, Nov 12, 2012 at 9:35 PM, Pavan Balaji <balaji at mcs.anl.gov> wrote:
>>
>> The MPI standard does not guarantee this. For example, an
>> implementation could use topology-aware reductions or an MPI_ANY_SOURCE
>> while waiting for messages from peers making the order in which the
>> reduction operations are applied different for each run.
>>
>> -- Pavan
>>
>> On 11/12/2012 09:00 PM US Central Time, Nichols A. Romero wrote:
>>> Hi,
>>>
>>> I apologize if this has been asked a trillion times, if its documented somewhere just point it out to me online.
>>>
>>> Are collective operations, such as sums, using MPI_Reduce deterministic? In other words, if I run MPI_Reduce N times on P tasks, will the sums always occur in the same order. Thus it would be reproducible to the expected precision.
>>>
>>
>> --
>> Pavan Balaji
>> http://www.mcs.anl.gov/~balaji
>> _______________________________________________
>> discuss mailing list discuss at mpich.org
>> To manage subscription options or unsubscribe:
>> https://lists.mpich.org/mailman/listinfo/discuss
>
>
>
--
Pavan Balaji
http://www.mcs.anl.gov/~balaji
More information about the discuss
mailing list