<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
Hi Bill,
<div><br>
</div>
<div> Thank you ! That worked perfectly. Will start to make use of MPE on our code tomorrow.</div>
<div><br>
</div>
<div><br>
<div>
<div>On Dec 2, 2015, at 5:49 PM, William Gropp <<a href="mailto:wgropp@illinois.edu">wgropp@illinois.edu</a>></div>
<div> wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
I’ve fixed this by testing for the bug in using const in the removed routines; in the process of testing with Open MPI, I found a few other bugs that I also fixed. I’ve pushed the fixes to mpe2.git, and created a new tarball, which is installed at the ftp
site (with link to mpe2.tar.gz).
<div><br>
</div>
<div>Bill</div>
<div><br>
<div>William Gropp<br>
Director, Parallel Computing Institute<br>
Thomas M. Siebel Chair in Computer Science<br>
Chief Scientist, NCSA<br>
University of Illinois Urbana-Champaign<br>
<br>
<br>
<br>
<br>
</div>
<br>
<div>
<div>On Dec 2, 2015, at 9:17 AM, Jeff Hammond <<a href="mailto:jeff.science@gmail.com">jeff.science@gmail.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">
<div style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">
<div dir="ltr">But you are right that a configure test could be useful to make MPE work with MPICH releases that have the unnecessary const attributes in MPI_Type_hindexed, MPI_Type_struct, MPI_Address, PMPI_Type_hindexed, PMPI_Type_struct, PMPI_Address.
<div><br>
</div>
<div>Best,</div>
<div><br>
Jeff</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Dec 2, 2015 at 7:16 AM, Jeff Hammond<span class="Apple-converted-space"> </span><span dir="ltr"><<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a>></span><span class="Apple-converted-space"> </span>wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;">
<div dir="ltr">Hi Bill,
<div><br>
</div>
<div>My original idea was wrong. Since those deprecated MPI-2 functions should never have const in the declaration, the right solution is to remove MPE_CONST from them. The macro logic is fine as-is as long as an MPI implementation only adds const to MPI-3
functions.</div>
<div><br>
</div>
<div>The attached patch implements the aforementioned change. Of course, it must be coupled to my patch to MPICH for the function signatures to align.</div>
<div><br>
</div>
<div>I don't have write privileges on the MPE repo, not that it is critical.</div>
<div><br>
</div>
<div>Best,</div>
<div><br>
</div>
<div>Jeff</div>
</div>
<div class="HOEnZb">
<div class="h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Dec 2, 2015 at 7:08 AM, William Gropp<span class="Apple-converted-space"> </span><span dir="ltr"><<a href="mailto:wgropp@illinois.edu" target="_blank">wgropp@illinois.edu</a>></span><span class="Apple-converted-space"> </span>wrote:<br>
<blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex;">
<div style="word-wrap: break-word;">It sounds like this one needs a special case for the current MPICH bug. That isn’t hard and I can do that, Jeff, if you don’t want to. Let me know. It will need a configure test for the suspect cases.
<div><br>
</div>
<div>Bill</div>
<div><span><font color="#888888"><br>
<div>William Gropp<br>
Director, Parallel Computing Institute<br>
Thomas M. Siebel Chair in Computer Science<br>
Chief Scientist, NCSA<br>
University of Illinois Urbana-Champaign<br>
<br>
<br>
<br>
<br>
</div>
</font></span>
<div><br>
<div>
<div>On Dec 1, 2015, at 10:42 PM, Jeff Hammond <<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a>> wrote:</div>
<br>
<blockquote type="cite">
<div dir="ltr">Ok, I didn't understand your issue before. I thought your issue was with MPICH not agreeing with OpenMPI. That needed to be fixed anyways, so it's good that your query prompted it, but I'm sorry it wasn't what you needed.<br>
<br>
MPE already has MPE_CONST, but it will be "const" whenever MPI_VERSION>=3, which is what late-model MPICH will give you. The solution is probably to the logic below to allow for manual override, rather than OR-ing on MPI_VERSION, which cannot be overridden.
<div><br>
#if defined(HAVE_CONST_IN_MPI_DECL) || MPI_VERSION >= 3<br>
#define MPE_CONST const<br>
#else<br>
#define MPE_CONST<br>
#endif</div>
<div><br>
</div>
<div>I'll try to work up a patch later.<br>
<br>
As for configure, the documentation is rightly written for the user who downloads a release tarball, not the git repo. So yes, you should generate it with autogen.sh.<br>
<br>
Jeff<br>
<br>
On Tue, Dec 1, 2015 at 7:04 PM, Schilling, Herbert W. (GRC-VE00) <<a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a>> wrote:<br>
><br>
> Hi Jeff,<br>
><br>
> Thanks. Unfortunately, that is basically the same source code from<br>
><br>
><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=ftp-3A__ftp.mcs.anl.gov_pub_mpi_mpe_mpe2.tar.gz&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=09KUm6Ix-026rXC4EqSVYu0fyrKXoacYTihpuNfeGP8&e=" target="_blank">ftp://ftp.mcs.anl.gov/pub/mpi/mpe/mpe2.tar.gz</a><br>
><br>
> where I had the issues with the conflicting declarations as Pavan talked about.<span class="Apple-converted-space"> </span><br>
><br>
> I could remove the deprecated routines as most of the problems are caused by them, but it looks like some non-deprecated routines also have the const issue, e.g.<br>
><br>
> visual_mess.c:560: error: conflicting types for 'MPI_Issend'<br>
> /u/hschilli/local/include/mpi.h:1543: error: previous declaration of 'MPI_Issend' was here<br>
><br>
><br>
> BTW, that repo for MPE doesn't appear to have a configure file. I know I could create it with autogen.sh but the INSTALL file doesn't say that. It just says run configure. Might be confusing for some people, I think!<br>
><br>
> Thanks for everyone's help<span class="Apple-converted-space"> </span><br>
><br>
><br>
><br>
><br>
><br>
> On Dec 1, 2015, at 2:03 PM, Jeff Hammond <<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a>><br>
> wrote:<br>
><br>
> MPE lives here now:<span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__git.mpich.org_mpe.git_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=muO3nDEckVwoUMGSzekDn9NdA9_9z6g6DY7TQQXh4Kg&e=" target="_blank">http://git.mpich.org/mpe.git/</a><br>
><br>
> Jeff<br>
><br>
> On Tue, Dec 1, 2015 at 10:15 AM, Schilling, Herbert W. (GRC-VE00) <<a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a>> wrote:<br>
>><br>
>> Hi Jeff,<br>
>><br>
>> Thanks. Pardon my ignorance but I I wanted to just use MPE with an existing OpenMPI installation and it's not clear to me ( even after searching and reading ), how to do that from the full MPICH code base at that repo. I can't really even find MPE in that
code at all. What am I missing?<br>
>><br>
>> Thanks<br>
>><br>
>> On Dec 1, 2015, at 10:03 AM, Jeff Hammond <<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a>><br>
>> wrote:<br>
>><br>
>> Herbert:<br>
>><br>
>> Please try<span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_jeffhammond_mpich_tree_hammond-2Dmpi2-2Ddeprecated-2Dfunctions-2Dnoconst&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=wpHD-QIiCAD_DZYQJ__b-9fWiXzAXhAKxkG2DoZKqOI&e=" target="_blank">https://github.com/jeffhammond/mpich/tree/hammond-mpi2-deprecated-functions-noconst</a><span class="Apple-converted-space"> </span>and
let me know if you see any problems.<br>
>><br>
>> Best,<br>
>><br>
>> Jeff<br>
>><br>
>> On Tue, Dec 1, 2015 at 5:46 AM, Schilling, Herbert W. (GRC-VE00) <<a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a>> wrote:<br>
>>><br>
>>> Hi Jeff and Pavan,<br>
>>><br>
>>> Thanks for all the help on this. Jeff, when you have the fix up there, I can give it a shot!<br>
>>><br>
>>><br>
>>> On Dec 1, 2015, at 1:15 AM, Jeff Hammond <<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a>><br>
>>> wrote:<br>
>>><br>
>>> Facepalm. Indeed, changing the header but not the implementation was pretty dumb on my part. I'll fix that tomorrow.<br>
>>><br>
>>> I have no opinion on the ABI situation, particularly since I know there are other folks that Intel that do.<br>
>>><br>
>>> Jeff<br>
>>><br>
>>> On Mon, Nov 30, 2015 at 9:00 PM, Balaji, Pavan <<a href="mailto:balaji@anl.gov" target="_blank">balaji@anl.gov</a>> wrote:<br>
>>>><br>
>>>><br>
>>>> Thanks, Jeff. The actual function definitions should be modified as well, which your patch seems to miss.<br>
>>>><br>
>>>> But I think the potentially time consuming part is to get buy-in from all the ABI consortium folks for this change. It doesn't exactly break ABI for applications, but will be an annoying change for tools. Ken is looking into this.<br>
>>>><br>
>>>> -- Pavan<br>
>>>><br>
>>>> > On Nov 30, 2015, at 10:54 PM, Jeff Hammond <<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a>> wrote:<br>
>>>> ><br>
>>>> > Pavan:<br>
>>>> ><br>
>>>> > See hammond-mpi2-deprecated-functions-noconst branch on mpich-review. I found three functions where this change should be made. I do not know if that is the full list, so someone should verify.<br>
>>>> ><br>
>>>> > Best,<br>
>>>> ><br>
>>>> > Jeff<br>
>>>> ><br>
>>>> > On Mon, Nov 30, 2015 at 8:08 PM, Balaji, Pavan <<a href="mailto:balaji@anl.gov" target="_blank">balaji@anl.gov</a>> wrote:<br>
>>>> ><br>
>>>> > MPI_Type_struct is not a part of the MPI standard anymore and is replaced by MPI_Type_create_struct. Both MPICH and Open MPI decided to retain it, but followed different directions for it. MPICH decided to follow the same convention as MPI_Type_create_struct
with the const additions. Open MPI decided to keep the old prototypes as is.<br>
>>>> ><br>
>>>> > Unfortunately, MPE got stuck in between the two. The best approach would be to simply remove those functions from MPE and this problem just goes away. Would you be able to do that and contribute a patch?<br>
>>>> ><br>
>>>> > More generally, I think MPICH was overzealous in trying to constify prototypes for the deleted functions. It should have just left them as they are, like what Open MPI did. We'll figure out what to do about that internally, but that's not going to
be a quick change because of ABI and other such stuff.<br>
>>>> ><br>
>>>> > Thanks,<br>
>>>> ><br>
>>>> > -- Pavan<br>
>>>> ><br>
>>>> > > On Nov 30, 2015, at 8:14 PM, Schilling, Herbert W. (GRC-VE00) <<a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a>> wrote:<br>
>>>> > ><br>
>>>> > > Hi,<br>
>>>> > ><br>
>>>> > > I am trying to build MPE for use with OpenMPI. I built from source Version 1.10.1 of OpenMPI.<br>
>>>> > ><br>
>>>> > > I am using this version of MPE<span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=ftp-3A__ftp.mcs.anl.gov_pub_mpi_mpe_mpe2.tar.gz&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=09KUm6Ix-026rXC4EqSVYu0fyrKXoacYTihpuNfeGP8&e=" target="_blank">ftp://ftp.mcs.anl.gov/pub/mpi/mpe/mpe2.tar.gz</a><br>
>>>> > ><br>
>>>> > > Should this work fine? I followed the instructions to build like this:<br>
>>>> > ><br>
>>>> > > ${MPE_SRC_DIR}/configure MPI_CC=${OPENMPI_INSTALL_DIR}/bin/mpicc \<br>
>>>> > > CC=<C_COMPILER_used_to_build_OpenMPI> \<br>
>>>> > > MPI_F77=${OPENMPI_INSTALL_DIR}/bin/mpif77 \<br>
>>>> > > F77=<FORTRAN_COMPILER_used_to_build_OpenMPI> \<br>
>>>> > > --with-java2=/usr/local/j2sdk-1.4.2<br>
>>>> > > --prefix=<MPE_INSTALL_DIR><br>
>>>> > > make<br>
>>>> > > make install<br>
>>>> > ><br>
>>>> > ><br>
>>>> > ><br>
>>>> > ><br>
>>>> > > I keep running into problems with conflicting declarations<br>
>>>> > ><br>
>>>> > ><br>
>>>> > > log_mpi_core.c:5611: error: conflicting types for 'MPI_Type_struct'<br>
>>>> > > /u/hschilli/local/include/mpi.h:1796: error: previous declaration of 'MPI_Type_struct' was here<br>
>>>> > ><br>
>>>> > ><br>
>>>> > > I think the issue is that MPE's declaration uses some const qualifiers while OpenMPI does not.<br>
>>>> > ><br>
>>>> > ><br>
>>>> > ><br>
>>>> > > I tried hacking my way through this with the macro<br>
>>>> > ><br>
>>>> > > HAVE_CONST_IN_MPI_DECL<br>
>>>> > > and MPE_CONST but no luck so far.<br>
>>>> > ><br>
>>>> > ><br>
>>>> > ><br>
>>>> > > What am I doing wrong?<br>
>>>> > ><br>
>>>> > ><br>
>>>> > > Thanks in advance.<br>
>>>> > ><br>
>>>> > > ---------<br>
>>>> > > Herb Schilling<br>
>>>> > > Scientific Applications and Visualization Team<br>
>>>> > ><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__ocio.grc.nasa.gov_gvis&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=Ez2x7qneaHrywKva2K_y8Z0ausBAlYNqS-qKGicXseI&e=" target="_blank">http://ocio.grc.nasa.gov/gvis</a><br>
>>>> > > Office of the Chief Information Officer<br>
>>>> > > NASA Glenn Research Center<br>
>>>> > ><span class="Apple-converted-space"> </span><a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a><br>
>>>> > ><br>
>>>> > ><br>
>>>> > ><br>
>>>> > ><br>
>>>> > > _______________________________________________<br>
>>>> > > discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>>>> > > To manage subscription options or unsubscribe:<br>
>>>> > ><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>>>> ><br>
>>>> > _______________________________________________<br>
>>>> > discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>>>> > To manage subscription options or unsubscribe:<br>
>>>> ><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>>>> ><br>
>>>> ><br>
>>>> ><br>
>>>> > --<br>
>>>> > Jeff Hammond<br>
>>>> ><span class="Apple-converted-space"> </span><a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
>>>> ><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=ZEd7PeXlQBugVrUONV0tJUSg6SYatGWxL9RPKYurdh0&e=" target="_blank">http://jeffhammond.github.io/</a><br>
>>>> > _______________________________________________<br>
>>>> > discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>>>> > To manage subscription options or unsubscribe:<br>
>>>> ><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>>>><br>
>>>> _______________________________________________<br>
>>>> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>>>> To manage subscription options or unsubscribe:<br>
>>>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> --<br>
>>> Jeff Hammond<br>
>>><span class="Apple-converted-space"> </span><a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
>>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=ZEd7PeXlQBugVrUONV0tJUSg6SYatGWxL9RPKYurdh0&e=" target="_blank">http://jeffhammond.github.io/</a><br>
>>> _______________________________________________<br>
>>> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>>> To manage subscription options or unsubscribe:<br>
>>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>>><br>
>>><br>
>>> ---------<br>
>>> Herb Schilling<br>
>>> Scientific Applications and Visualization Team<br>
>>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__ocio.grc.nasa.gov_gvis&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=Ez2x7qneaHrywKva2K_y8Z0ausBAlYNqS-qKGicXseI&e=" target="_blank">http://ocio.grc.nasa.gov/gvis</a><br>
>>> Office of the Chief Information Officer<br>
>>> NASA Glenn Research Center<br>
>>><span class="Apple-converted-space"> </span><a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a><br>
>>><br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> _______________________________________________<br>
>>> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>>> To manage subscription options or unsubscribe:<br>
>>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>><br>
>><br>
>><br>
>><br>
>> --<br>
>> Jeff Hammond<br>
>><span class="Apple-converted-space"> </span><a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=ZEd7PeXlQBugVrUONV0tJUSg6SYatGWxL9RPKYurdh0&e=" target="_blank">http://jeffhammond.github.io/</a><br>
>> _______________________________________________<br>
>> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>> To manage subscription options or unsubscribe:<br>
>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
>><br>
>><br>
>> ---------<br>
>> Herb Schilling<br>
>> Scientific Applications and Visualization Team<br>
>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__ocio.grc.nasa.gov_gvis&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=Ez2x7qneaHrywKva2K_y8Z0ausBAlYNqS-qKGicXseI&e=" target="_blank">http://ocio.grc.nasa.gov/gvis</a><br>
>> Office of the Chief Information Officer<br>
>> NASA Glenn Research Center<br>
>><span class="Apple-converted-space"> </span><a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a><br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> _______________________________________________<br>
>> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
>> To manage subscription options or unsubscribe:<br>
>><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
><br>
><br>
><br>
><br>
> --<br>
> Jeff Hammond<br>
><span class="Apple-converted-space"> </span><a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=ZEd7PeXlQBugVrUONV0tJUSg6SYatGWxL9RPKYurdh0&e=" target="_blank">http://jeffhammond.github.io/</a><br>
> _______________________________________________<br>
> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
> To manage subscription options or unsubscribe:<br>
><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
><br>
><br>
> ---------<br>
> Herb Schilling<br>
> Scientific Applications and Visualization Team<br>
><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__ocio.grc.nasa.gov_gvis&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=Ez2x7qneaHrywKva2K_y8Z0ausBAlYNqS-qKGicXseI&e=" target="_blank">http://ocio.grc.nasa.gov/gvis</a><br>
> Office of the Chief Information Officer<br>
> NASA Glenn Research Center<br>
><span class="Apple-converted-space"> </span><a href="mailto:hschilling@nasa.gov" target="_blank">hschilling@nasa.gov</a><br>
><br>
><br>
><br>
><br>
><br>
> _______________________________________________<br>
> discuss mailing list <span class="Apple-converted-space"> </span><a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
> To manage subscription options or unsubscribe:<br>
><span class="Apple-converted-space"> </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=i30ClRowT_Rq93CEIztdJqwnL6wzb3yQlmiaaFrpy3c&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
<br>
<br>
<br>
<br>
--<br>
Jeff Hammond<br>
<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=2mD7C1lXoN7cWQsEh7VfZJ7ADs3IgX4EpfbYcQZUBH4&s=ZEd7PeXlQBugVrUONV0tJUSg6SYatGWxL9RPKYurdh0&e=" target="_blank">http://jeffhammond.github.io/</a><br>
<div class="gmail_extra"></div>
</div>
</div>
_______________________________________________<br>
discuss mailing list <a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
To manage subscription options or unsubscribe:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=Rg4UnNrwAMib0YNxQwoEV62igy07yi5zC0d1_0CRBu4&s=k8igU-_grjTJx7G9e-itveRuquEsc9kChkRGF0Bsoac&e=" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a></blockquote>
</div>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
discuss mailing list <a href="mailto:discuss@mpich.org" target="_blank">discuss@mpich.org</a><br>
To manage subscription options or unsubscribe:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.mpich.org_mailman_listinfo_discuss&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=Rg4UnNrwAMib0YNxQwoEV62igy07yi5zC0d1_0CRBu4&s=k8igU-_grjTJx7G9e-itveRuquEsc9kChkRGF0Bsoac&e=" rel="noreferrer" target="_blank">https://lists.mpich.org/mailman/listinfo/discuss</a><br>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
--<span class="Apple-converted-space"> </span><br>
<div>Jeff Hammond<br>
<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=Rg4UnNrwAMib0YNxQwoEV62igy07yi5zC0d1_0CRBu4&s=ykQ_lDDesQ6T4mBE9Ro8g996bvQhk3Bva8Ihr4LnxDM&e=" target="_blank">http://jeffhammond.github.io/</a></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
--<span class="Apple-converted-space"> </span><br>
<div class="gmail_signature">Jeff Hammond<br>
<a href="mailto:jeff.science@gmail.com" target="_blank">jeff.science@gmail.com</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__jeffhammond.github.io_&d=BQMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=195OD1c98cxYlIPBUDzl00KueizThEKs34a9DvL37eY&m=Rg4UnNrwAMib0YNxQwoEV62igy07yi5zC0d1_0CRBu4&s=ykQ_lDDesQ6T4mBE9Ro8g996bvQhk3Bva8Ihr4LnxDM&e=" target="_blank">http://jeffhammond.github.io/</a></div>
</div>
_______________________________________________<br>
discuss mailing list <a href="mailto:discuss@mpich.org">discuss@mpich.org</a><br>
To manage subscription options or unsubscribe:<br>
<a href="https://lists.mpich.org/mailman/listinfo/discuss">https://lists.mpich.org/mailman/listinfo/discuss</a></div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
<div apple-content-edited="true">
<div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
<div>---------</div>
<div>Herb Schilling</div>
<div>Scientific Applications and Visualization Team</div>
<div><a href="http://ocio.grc.nasa.gov/gvis">http://ocio.grc.nasa.gov/gvis</a></div>
<div>Office of the Chief Information Officer</div>
<div>NASA Glenn Research Center</div>
<div><a href="mailto:hschilling@nasa.gov">hschilling@nasa.gov</a></div>
<div><br>
</div>
</div>
<br class="Apple-interchange-newline">
<br class="Apple-interchange-newline">
</div>
<br>
</div>
</body>
</html>