[mpich-devel] P states and MPI

Bronis R. de Supinski bronis at llnl.gov
Fri Jan 17 08:48:36 CST 2014


I guess I should add that in particular we predict wait
times on a call site basis in order to exploit consistent
imbalance  (or even slowly evolving imbalance, see the
results for ParaDiS, for which process work changes but
not rapidly, which is typical of real apps)


On Fri, 17 Jan 2014, Bronis R. de Supinski wrote:

>
> Um, I would say the Dell approach has no novelty and is
> rather rudimentary. We have done a lot more in Adagio:
>
> http://dl.acm.org/citation.cfm?id=1542340
>
> @inproceedings{Rountree:2009:AMD:1542275.1542340,
> author = {Rountree, Barry and Lownenthal, David K. and de Supinski, Bronis 
> R. and Schulz, Martin and Freeh, Vincent W. and Bletsch, Tyler},
>  title = {Adagio: Making DVS Practical for Complex HPC Applications},
>  booktitle = {Proceedings of the 23rd International Conference on 
> Supercomputing},
>  series = {ICS '09},
>  year = {2009},
>  isbn = {978-1-60558-498-0},
>  location = {Yorktown Heights, NY, USA},
>  pages = {460--469},
>  numpages = {10},
>  url = {http://doi.acm.org/10.1145/1542275.1542340},
>  doi = {10.1145/1542275.1542340},
>  acmid = {1542340},
>  publisher = {ACM},
>  address = {New York, NY, USA},
>  keywords = {dvfs, dvs, energy, mpi, runtime},
> }
>
>
>
> On Fri, 17 Jan 2014, William Gropp wrote:
>
>>  There has been some work on this for parallel programs; Wu Feng at
>>  Virginia Tech has done some, for example.  I don't recall seeing any work
>>  that used the profiling interface.  Some of the issues raised, especially
>>  the required privs, mean that this is only available for experiments, not
>>  production, until that changes.  Also, its sometimes possible to make
>>  predictions about wait times based on previous iterations; that could be
>>  used to refine such control.
>>
>>  Bill
>>
>>  William Gropp
>>  Director, Parallel Computing Institute
>>  Deputy Director for Research
>>  Institute for Advanced Computing Applications and Technologies
>>  Thomas M. Siebel Chair in Computer Science
>>  University of Illinois Urbana-Champaign
>> 
>> 
>> 
>>
>>  On Jan 16, 2014, at 9:36 PM, Jeff Hammond wrote:
>> 
>> >  I was impressed by
>> >  http://www.hpcadvisorycouncil.com/events/2013/Spain-Workshop/pdf/5_Dell.pdf
>> >  / 
>> >  http://www.bsc.es/sites/default/files/public/mare_nostrum/2013hpcac-05.pdf.
>> >  I wonder if anyone else has seen this, done anything similar, is
>> >  interested in doing something similar, etc.  I can imagine that a more
>> >  integrated implementation has some performance advantages, albeit at
>> >  much greater maintenance cost.
>> > 
>> >  Thanks,
>> > 
>> >  Jeff
>> > 
>> >  --
>> >  Jeff Hammond
>> >  jeff.science at gmail.com
>> 
>> 
>


More information about the devel mailing list