<!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
All, I'm trying to do some tests on a Quobyte system and we've seen confusing file write timings with Intel MPI and Open MPI. So, a bit of googling seeing if some MPI stack has a mention of Quobyte turns up: https: //www. quobyte. com/blog/quobyte-mpi-io-support-with-kernel-bypass-now-available/</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" ><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #90a4ae;background-color:#D0D8DC;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" id="pfptBannerq5k39ry" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #D0D8DC !important; background-color: #D0D8DC; border-top: 4px solid #90a4ae !important; border-top: 4px solid #90a4ae;">
<div id="pfptBannerq5k39ry" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannerq5k39ry" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannerq5k39ry" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannerq5k39ry { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #D0D8DC !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtonq5k39ry:hover, .pfptPrimaryButtonq5k39ry:focus {
background-color: #b4c1c7 !important; }
.pfptPrimaryButtonq5k39ry:active {
background-color: #90a4ae !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Calibri Light";
panose-1:2 15 3 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:"Times New Roman \(Body CS\)";
panose-1:2 11 6 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#467886;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:Consolas;
color:windowtext;
font-weight:normal;
font-style:normal;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-family:Consolas">All,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">I'm trying to do some tests on a Quobyte system and we've seen confusing file write timings with Intel MPI and Open MPI. So, a bit of googling seeing if some MPI stack has a mention of Quobyte turns up:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><a href="https://urldefense.us/v3/__https://www.quobyte.com/blog/quobyte-mpi-io-support-with-kernel-bypass-now-available/__;!!G_uCfscf7eWS!foSdMay5QSiTxv1dePpWE5p5EOqkyr5hGLVXtgYBy6sY2_p9bErxn31S50_D4xpBCr1CIJCYqJV6YIlpDH99oVGEJLU$">https://www.quobyte.com/blog/quobyte-mpi-io-support-with-kernel-bypass-now-available/</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">and, yep, quobyte seems to be in MPICH! I grabbed MPICH 4.3.0 and built it (with one bug fix[1]) and well, it seems to run Hello World.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">So, following that Quobyte page, I get to Step 10 and tried the romio tests and...I am apparently dumb. I went to my
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> build/src/mpi/romio/test<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">directory and I see 'runtests' there, but:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> > ./runtests<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"> make: *** No rule to make target 'default'. Stop.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">I also tried with -fname and:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">> ./runtests -fname=quobyte:test_mpi_file<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">./runtests: line 90: [quobyte:test_mpi_file: command not found<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">make: *** No rule to make target 'default'. Stop.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">> ./runtests -fname=quobyte:/home/mathomp4/MPI/src/mpich-4.3.0/build-ifort-2021.13/src/mpi/romio/test/test_mpi_file<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">./runtests: line 90: [quobyte:/home/mathomp4/MPI/src/mpich-4.3.0/build-ifort-2021.13/src/mpi/romio/test/test_mpi_file: No such file or directory<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">make: *** No rule to make target 'default'. Stop.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Yeah. I'm stumped. I'm guessing I've missed some simple step along the way.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">NOTE: I have no idea even how to use romio really, but I was hoping the tests could, well, help me figure that out.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Thanks for any help,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Matt<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">[1] See <a href="https://urldefense.us/v3/__https://github.com/pmodels/mpich/issues/7452__;!!G_uCfscf7eWS!foSdMay5QSiTxv1dePpWE5p5EOqkyr5hGLVXtgYBy6sY2_p9bErxn31S50_D4xpBCr1CIJCYqJV6YIlpDH99XaSWwF0$">
https://github.com/pmodels/mpich/issues/7452</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-bottom:solid windowtext 1.0pt;padding:0in 0in 1.0pt 0in">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Consolas;mso-ligatures:none"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Consolas;mso-ligatures:none"><o:p> </o:p></span></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="540" style="width:405.0pt;border-collapse:collapse">
<tbody>
<tr style="height:91.3pt">
<td width="151" style="width:113.15pt;padding:2.15pt 1.45pt 2.15pt 1.45pt;height:91.3pt">
<p class="MsoNormal" align="center" style="text-align:center"><a href="https://urldefense.us/v3/__http://www.ssaihq.com/__;!!G_uCfscf7eWS!foSdMay5QSiTxv1dePpWE5p5EOqkyr5hGLVXtgYBy6sY2_p9bErxn31S50_D4xpBCr1CIJCYqJV6YIlpDH99MYB1cYk$"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#212121;text-decoration:none"><img border="0" width="131" height="131" style="width:1.3645in;height:1.3645in" id="Picture_x0020_2" src="cid:image001.png@01DBDAB2.B1230DE0" alt="signature_3314915376"></span></a><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#212121;mso-ligatures:none"><o:p></o:p></span></p>
</td>
<td width="26" valign="bottom" style="width:19.55pt;padding:2.15pt 1.45pt 2.15pt 1.45pt;height:91.3pt">
<p class="MsoNormal" align="center" style="text-align:center;line-height:12.65pt">
<span style="font-size:11.0pt;font-family:"Calibri Light",sans-serif;color:#212121;mso-ligatures:none"><img border="0" width="2" height="145" style="width:.0208in;height:1.5104in" id="Picture_x0020_1" src="cid:image002.png@01DBDAB2.B1230DE0" alt="Image"></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#212121;mso-ligatures:none"><o:p></o:p></span></p>
</td>
<td width="363" style="width:272.3pt;padding:2.15pt 1.45pt 2.15pt 1.45pt;height:91.3pt">
<p class="MsoNormal" style="line-height:12.65pt"><b><span style="font-size:11.0pt;font-family:Helvetica;color:black;mso-ligatures:none">Matt Thompson</span></b><span style="font-size:11.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none"><o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:12.65pt"><b><span style="font-size:9.0pt;font-family:Helvetica;color:black;mso-ligatures:none">Lead Scientific Software Engineer/Supervisor</span></b><span style="font-size:11.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none"><o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:12.65pt"><span style="font-size:9.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none">Global Modeling and Assimilation Office<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:12.65pt"><span style="font-size:9.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none">Science Systems and Applications, Inc.
<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:12.65pt"><span style="font-size:9.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none">Code 610.1, 8800 Greenbelt Rd, Greenbelt, MD 20771<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:12.65pt"><span style="font-size:9.0pt;font-family:Helvetica;color:black;mso-ligatures:none">o: 301-614-6712</span><span style="font-size:11.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none">
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none"><a href="mailto:matthew.thompson@nasa.gov"><span style="color:#467886">matthew.thompson@nasa.gov</span></a></span><span style="font-size:11.0pt;font-family:Helvetica;color:#212121;mso-ligatures:none"><o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>