[mpich-devel] Message Passing models for Hybrid Parallelism

[Shigang Li]

Hi  Muhammad, Huiwei,

There is a Hybrid MPI(HMPI) library which aims at implementing MPI efficiently
on both inter-node network and shared memory architecture. Here are some
papers talking about this, which may give you some info.

Ownership Passing: Efficient Distributed Memory Programming on Multi-core
Systems<http://htor.inf.ethz.ch/publications//img/friedley-ownership-passing.pdf>
NUMA-Aware Shared Memory Collective Communication for
MPI<http://dl.acm.org/citation.cfm?id=2462903>
Hybrid MPI: Efficient Message Passing for Multi-core
Systems<http://htor.inf.ethz.ch/publications//img/friedley-hmpi-sc13.pdf>

Best Regards,
Shigang


On Thu, Aug 29, 2013 at 12:31 PM, Muhammad Ansar Javed <
muhammad.ansar at seecs.edu.pk> wrote:

> Hi Huiwei,
> Thank you so much for suggesting reading material. These are really useful
> papers but I am looking for models that provide seamless integration of two
> devices (Network device and Shared Memory device) into one hybrid device.
> Message passing mechanism should be exactly same  for end user at MPI
> layer.
> Idea is to use to use Network Device for establishing network
> communication between nodes and Shared memory device should
> be responsible for Intra-node communication on each multi-core machine.
> Shared Memory device is implemented using Multi-threading approach. Both
> Network and Shared Memory device are in working state independently.
>
> I hope it explains what I am really looking for. Please suggest papers
> that can provide guidelines for achieving this goal.
>
>
>
> On Wed, Aug 28, 2013 at 7:40 PM, Huiwei Lu <huiweilu at mcs.anl.gov> wrote:
>
>> Hi, Muhammad,
>>
>> As I am also starting to exploit this area, I would like to share with
>> you some of my readings.
>>
>> Following are a few papers to help you start:
>> 1. Early Experiments with the OpenMP/MPI Hybrid Programming Model,
>> http://www.mcs.anl.gov/~lusk/hybridpaper.pdf
>> 2. Test Suite for Evaluating Performance of MPI Implementations That
>> Support MPI THREAD MULTIPLE,
>> http://www.mcs.anl.gov/~thakur/papers/thread-tests.pdf
>>
>> In the second paper, you can also find some code examples for using
>> hybrid programming model.
>>
>> Best,
>>
>> Huiwei Lu
>> http://www.mcs.anl.gov/~huiweilu/
>>
>>
>> On Wed, Aug 28, 2013 at 12:54 AM, Muhammad Ansar Javed <
>> muhammad.ansar at seecs.edu.pk> wrote:
>>
>>> Hi,
>>> I am looking for message passing models for Hybrid Parallelism that are
>>> being used in MPICH implementations for the Cluster of Multi-core machines.
>>> Can you please suggest me some papers or study material that can explain
>>> communication models that incorporate network communication as well as
>>> shared memory communication.
>>>
>>> Thanks,
>>> Ansar
>>>
>>
>>
>
>
> --
>
> Regards:
> *
> *Muhammad Ansar Javed
> NUST SEECS
> Contact: +92 334 438 9394
> Email: muhammad.ansar at seecs.edu.pk
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mpich.org/pipermail/devel/attachments/20130829/e5401867/attachment-0001.html>