[mpich-devel] Message Passing models for Hybrid Parallelism

[Pavan Balaji]

You can create shared memory in regular MPI as well.  I'm not sure you need HMPI extensions for this.

 -- Pavan

On Aug 29, 2013, at 1:59 PM, Huiwei Lu wrote:

> Thank you Shigang. Your links are very helpful.
> 
> Sorry Muhammad I didn't answer your question at the first time. I have just read about HMPI briefly several days ago.
> 
> 
> Huiwei Lu
> http://www.mcs.anl.gov/~huiweilu/
> 
> 
> On Thu, Aug 29, 2013 at 1:53 PM, Shigang Li <shigangli.cs at gmail.com> wrote:
> Hi  Muhammad, Huiwei,
> 
> There is a Hybrid MPI(HMPI) library which aims at implementing MPI efficiently on both inter-node network and shared memory architecture. Here are some papers talking about this, which may give you some info.
> 
> Ownership Passing: Efficient Distributed Memory Programming on Multi-core Systems
> NUMA-Aware Shared Memory Collective Communication for MPI
> Hybrid MPI: Efficient Message Passing for Multi-core Systems
> 
> Best Regards,
> Shigang
> 
> 
> On Thu, Aug 29, 2013 at 12:31 PM, Muhammad Ansar Javed <muhammad.ansar at seecs.edu.pk> wrote:
> Hi Huiwei,
> Thank you so much for suggesting reading material. These are really useful papers but I am looking for models that provide seamless integration of two devices (Network device and Shared Memory device) into one hybrid device. Message passing mechanism should be exactly same  for end user at MPI layer. 
> Idea is to use to use Network Device for establishing network communication between nodes and Shared memory device should be responsible for Intra-node communication on each multi-core machine. Shared Memory device is implemented using Multi-threading approach. Both Network and Shared Memory device are in working state independently.
> 
> I hope it explains what I am really looking for. Please suggest papers that can provide guidelines for achieving this goal.
> 
> 
> 
> On Wed, Aug 28, 2013 at 7:40 PM, Huiwei Lu <huiweilu at mcs.anl.gov> wrote:
> Hi, Muhammad,
> 
> As I am also starting to exploit this area, I would like to share with you some of my readings.
> 
> Following are a few papers to help you start:
> 1. Early Experiments with the OpenMP/MPI Hybrid Programming Model, http://www.mcs.anl.gov/~lusk/hybridpaper.pdf
> 2. Test Suite for Evaluating Performance of MPI Implementations That Support MPI THREAD MULTIPLE, http://www.mcs.anl.gov/~thakur/papers/thread-tests.pdf
> 
> In the second paper, you can also find some code examples for using hybrid programming model.
> 
> Best,
> 
> Huiwei Lu
> http://www.mcs.anl.gov/~huiweilu/
> 
> 
> On Wed, Aug 28, 2013 at 12:54 AM, Muhammad Ansar Javed <muhammad.ansar at seecs.edu.pk> wrote:
> Hi,
> I am looking for message passing models for Hybrid Parallelism that are being used in MPICH implementations for the Cluster of Multi-core machines. Can you please suggest me some papers or study material that can explain communication models that incorporate network communication as well as shared memory communication.  
> 
> Thanks,
> Ansar
> 
> 
> 
> 
> -- 
> 
> Regards:
> 
> Muhammad Ansar Javed
> NUST SEECS
> Contact: +92 334 438 9394
> Email: muhammad.ansar at seecs.edu.pk
> 
> 

--
Pavan Balaji
http://www.mcs.anl.gov/~balaji