<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Hi Michka,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks for the information. That is helpful. This seems to be an issue with the latest development in libfabric. It is selecting the `udp;ofi_rxd` provider, which has never been tested with MPICH. You can try force the `sockets` provider
selection by setting `MPIR_CVAR_OFI_USE_PROVIDER=sockets` or setting `FI_PROVIDER=sockets`. Alternatively, you may want force the sockets provider during configure with `--with-device=ch4:ofi:sockets`. Or you may consider disable the `ofi_rxd` provider in
libfabric. I admit either seem non-optimum. The better solution probably should be either fix or tune the provider selection logic in mpich.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">FYI, the current embedded libfabric is on version 1.10.1 and we are still working on upgrading that to version 1.11.2.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">-- <br>
Hui Zhou<o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">
<b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">Michka Popoff <michkapopoff@gmail.com><br>
<b>Date: </b>Friday, May 7, 2021 at 4:37 PM<br>
<b>To: </b>Zhou, Hui <zhouh@anl.gov><br>
<b>Cc: </b>discuss@mpich.org <discuss@mpich.org><br>
<b>Subject: </b>Re: [mpich-discuss] Mpich failure with external libfabric on macOS: OFI resource bind failed<o:p></o:p></span></p>
</div>
<p class="MsoNormal" style="margin-left:.5in">The libfabric version is 1.12.1<o:p></o:p></p>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">Here is the log as asked:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in">==== Capability set configuration ====<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">libfabric provider: udp;ofi_rxd<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_AV_TABLE: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_SCALABLE_ENDPOINTS: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_SHARED_CONTEXTS: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_MR_SCALABLE: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_MR_VIRT_ADDRESS: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_MR_ALLOCATED: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_MR_PROV_KEY: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_TAGGED: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_AM: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_RMA: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_ATOMICS: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_FETCH_ATOMIC_IOVECS: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_DATA_AUTO_PROGRESS: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_CONTROL_AUTO_PROGRESS: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_PT2PT_NOPACK: 1<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_ENABLE_HMEM: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_NUM_AM_BUFFERS: 8<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_CONTEXT_BITS: 20<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_SOURCE_BITS: 0<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_TAG_BITS: 31<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">======================================<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MAXIMUM SUPPORTED RANKS: 4294967296<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MAXIMUM TAG: 2147483648<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">======================================<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">Abort(1615247) on node 0 (rank 0 in comm 0): Fatal error in MPI_Init: Other MPI error, error stack:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIR_Init_thread(152).......:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPID_Init(597)..............:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">MPIDI_OFI_mpi_init_hook(674):<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">create_vni_context(964).....: OFI resource bind failed (ofi_init.c:964:create_vni_context:No message available on STREAM)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">…<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in">Michka<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="margin-left:.5in">On 4 May 2021, at 00:53, Zhou, Hui <<a href="mailto:zhouh@anl.gov">zhouh@anl.gov</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:12.0pt">Hi Michka,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:12.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:12.0pt">Which libfabric version are you using? Could you try setting `MPIR_CVAR_CH4_OFI_CAPABILITY_SETS_DEBUG=` to see if there is more debug messages?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:12.0pt"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:12.0pt">--<span class="apple-converted-space"> </span><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:12.0pt">Hui Zhou<o:p></o:p></span></p>
</div>
<div class="MsoNormal" align="center" style="margin-left:.5in;text-align:center">
<hr size="2" width="1093" style="width:819.5pt" align="center">
</div>
<div id="divRplyFwdMsg">
<p class="MsoNormal" style="margin-left:.5in"><b>From:</b><span class="apple-converted-space"> </span>Michka Popoff via discuss <<a href="mailto:discuss@mpich.org">discuss@mpich.org</a>><br>
<b>Sent:</b><span class="apple-converted-space"> </span>Saturday, May 1, 2021 4:33 PM<br>
<b>To:</b><span class="apple-converted-space"> </span><a href="mailto:discuss@mpich.org">discuss@mpich.org</a> <<a href="mailto:discuss@mpich.org">discuss@mpich.org</a>><br>
<b>Cc:</b><span class="apple-converted-space"> </span>Michka Popoff <<a href="mailto:michkapopoff@gmail.com">michkapopoff@gmail.com</a>><br>
<b>Subject:</b><span class="apple-converted-space"> </span>[mpich-discuss] Mpich failure with external libfabric on macOS: OFI resource bind failed<span style="font-size:9.0pt;font-family:Helvetica"><o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> <o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Hi<o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Homebrew maintainer here (<a href="https://github.com/Homebrew">https://github.com/Homebrew</a>).<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Homebrew ships mpich as a package on both MacOS and Linux.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">The issue below was found with version 3.4.1 but might have been there for longer.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:0in;margin-right:0in;margin-bottom:12.0pt;margin-left:.5in">
<span style="font-size:9.0pt;font-family:Helvetica">We noticed that mpich was building it’s own internal libfabric dependency.<br>
After reading <a href="https://lists.mpich.org/pipermail/discuss/2021-January/006092.html">https://lists.mpich.org/pipermail/discuss/2021-January/006092.html</a>,<br>
we added `--with-device=ch4:ofi` and set the libfabric path with the --with-libfabric= flag,<br>
to use our own version.<o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">The build is fine. We have a small test to check if mpich is still working fine;<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">#include <mpi.h><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">#include <stdio.h><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">int main()<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">{<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> int size, rank, nameLen;<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> char name[MPI_MAX_PROCESSOR_NAME];<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> MPI_Init(NULL, NULL);<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> MPI_Comm_size(MPI_COMM_WORLD, &size);<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> MPI_Comm_rank(MPI_COMM_WORLD, &rank);<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> MPI_Get_processor_name(name, &nameLen);<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> printf("[%d/%d] Hello, world! My name is %s.\\n", rank, size, name);<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> MPI_Finalize();<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"> return 0;<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">}<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Executing the test fails with a weird error:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">/usr/local/Cellar/mpich/3.4.1_2/bin/mpicc hello.c -o hello<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">./hello<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Abort(1615247) on node 0 (rank 0 in comm 0): Fatal error in MPI_Init: Other MPI error, error stack:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">MPIR_Init_thread(152).......: <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">MPID_Init(597)..............: <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">MPIDI_OFI_mpi_init_hook(674): <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">create_vni_context(964).....: OFI resource bind failed (ofi_init.c:964:create_vni_context:No message available on STREAM)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=1615247<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">system msg for write_line failure : Bad file descriptor<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Abort(1615247) on node 0 (rank 0 in comm 0): Fatal error in MPI_Init: Other MPI error, error stack:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">MPIR_Init_thread(152).......: <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">MPID_Init(597)..............: <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">MPIDI_OFI_mpi_init_hook(674): <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">create_vni_context(964).....: OFI resource bind failed (ofi_init.c:964:create_vni_context:No message available on STREAM)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">[unset]: write_line error; fd=-1 buf=:cmd=abort exitcode=1615247<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">system msg for write_line failure : Bad file descriptor<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">This test passes fine on Linux, and fails only on MacOS. Using the internal libfabric is fine on both platforms.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Here is the related discussion:<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><a href="https://github.com/Homebrew/homebrew-core/pull/73062">https://github.com/Homebrew/homebrew-core/pull/73062</a><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Maybe you could help us debug this issue?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Regards<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:.5in"><span style="font-size:9.0pt;font-family:Helvetica">Michka<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-left:.5in"><o:p> </o:p></p>
</div>
</div>
</body>
</html>