[mpich-devel] Message Passing models for Hybrid Parallelism

[Huiwei Lu]

Thank you Shigang. Your links are very helpful.

Sorry Muhammad I didn't answer your question at the first time. I have just
read about HMPI briefly several days ago.


Huiwei Lu
http://www.mcs.anl.gov/~huiweilu/


On Thu, Aug 29, 2013 at 1:53 PM, Shigang Li <shigangli.cs at gmail.com> wrote:

> Hi  Muhammad, Huiwei,
>
> There is a Hybrid MPI(HMPI) library which aims at implementing MPI efficiently
> on both inter-node network and shared memory architecture. Here are some
> papers talking about this, which may give you some info.
>
> Ownership Passing: Efficient Distributed Memory Programming on Multi-core
> Systems<http://htor.inf.ethz.ch/publications//img/friedley-ownership-passing.pdf>
> NUMA-Aware Shared Memory Collective Communication for MPI<http://dl.acm.org/citation.cfm?id=2462903>
> Hybrid MPI: Efficient Message Passing for Multi-core Systems<http://htor.inf.ethz.ch/publications//img/friedley-hmpi-sc13.pdf>
>
> Best Regards,
> Shigang
>
>
> On Thu, Aug 29, 2013 at 12:31 PM, Muhammad Ansar Javed <
> muhammad.ansar at seecs.edu.pk> wrote:
>
>> Hi Huiwei,
>> Thank you so much for suggesting reading material. These are really
>> useful papers but I am looking for models that provide seamless integration
>> of two devices (Network device and Shared Memory device) into one hybrid
>> device. Message passing mechanism should be exactly same  for end user at
>> MPI layer.
>> Idea is to use to use Network Device for establishing network
>> communication between nodes and Shared memory device should
>> be responsible for Intra-node communication on each multi-core machine.
>> Shared Memory device is implemented using Multi-threading approach. Both
>> Network and Shared Memory device are in working state independently.
>>
>> I hope it explains what I am really looking for. Please suggest papers
>> that can provide guidelines for achieving this goal.
>>
>>
>>
>> On Wed, Aug 28, 2013 at 7:40 PM, Huiwei Lu <huiweilu at mcs.anl.gov> wrote:
>>
>>> Hi, Muhammad,
>>>
>>> As I am also starting to exploit this area, I would like to share with
>>> you some of my readings.
>>>
>>> Following are a few papers to help you start:
>>> 1. Early Experiments with the OpenMP/MPI Hybrid Programming Model,
>>> http://www.mcs.anl.gov/~lusk/hybridpaper.pdf
>>> 2. Test Suite for Evaluating Performance of MPI Implementations That
>>> Support MPI THREAD MULTIPLE,
>>> http://www.mcs.anl.gov/~thakur/papers/thread-tests.pdf
>>>
>>> In the second paper, you can also find some code examples for using
>>> hybrid programming model.
>>>
>>> Best,
>>>
>>> Huiwei Lu
>>> http://www.mcs.anl.gov/~huiweilu/
>>>
>>>
>>> On Wed, Aug 28, 2013 at 12:54 AM, Muhammad Ansar Javed <
>>> muhammad.ansar at seecs.edu.pk> wrote:
>>>
>>>> Hi,
>>>> I am looking for message passing models for Hybrid Parallelism that are
>>>> being used in MPICH implementations for the Cluster of Multi-core machines.
>>>> Can you please suggest me some papers or study material that can explain
>>>> communication models that incorporate network communication as well as
>>>> shared memory communication.
>>>>
>>>> Thanks,
>>>> Ansar
>>>>
>>>
>>>
>>
>>
>> --
>>
>> Regards:
>> *
>> *Muhammad Ansar Javed
>> NUST SEECS
>> Contact: +92 334 438 9394
>> Email: muhammad.ansar at seecs.edu.pk
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mpich.org/pipermail/devel/attachments/20130829/3820ab84/attachment.html>