[mpich-discuss] [EXTERNAL] [BULK] How to make/run romio tests?

Wed Jun 11 13:43:46 CDT 2025

Rob,

Here is the head of that file:

> head src/mpi/romio/config.log
This file contains any messages produced by compilers while
running configure, to aid debugging if configure makes a mistake.

It was created by ROMIO configure 4.3.0, which was
generated by GNU Autoconf 2.69.  Invocation command line was

  $ ../../../../src/mpi/romio/configure --disable-option-checking --prefix=/home/mathomp4/MPI/mpich/4.3.0/ifort-2021.13 CC=icx CXX=icpx FC=ifort --with-file-system=ufs+nfs+quobytefs --cache-file=/dev/null --srcdir=../../../../src/mpi/romio

## --------- ##
## Platform. ##

[signature_4121572227]<https://urldefense.us/v3/__http://www.ssaihq.com/__;!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJoBrd0t8$ >

Matt Thompson
Lead Scientific Software Engineer/Supervisor
Global Modeling and Assimilation Office
Science Systems and Applications, Inc.
Code 610.1, 8800 Greenbelt Rd, Greenbelt, MD 20771
o: 301-614-6712
matthew.thompson at nasa.gov<mailto:matthew.thompson at nasa.gov>

From: Latham, Robert J. <robl at mcs.anl.gov>
Date: Wednesday, June 11, 2025 at 2:26 PM
To: discuss at mpich.org <discuss at mpich.org>
Cc: Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC] <matthew.thompson at nasa.gov>
Subject: Re: [mpich-discuss] [EXTERNAL] [BULK] How to make/run romio tests?
We could do a better job documenting the "read-only" vs "read-write" nature of these hints...

you cannot override the file system with the "romio_filesystem_type" hint, only confirm the file system is what you thought it was.

you should be able to with the ROMIO_FSTYPE_FORCE environment variable.

These symptoms suggest you requested quobyte support but ROMIO's configure could not find the development headers.... except ROMIO doesn't check for any development headers.

Can you share with me the first few lines of ROMIO's config.log?  From your build directory, that would be `
head mpich/src/mpi/romio/config.log`  (the whole config.log is too much... for now)

==rob

________________________________________
From: Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC] via discuss <discuss at mpich.org>
Sent: Wednesday, June 11, 2025 10:25
To: discuss at mpich.org
Cc: Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC]
Subject: Re: [mpich-discuss] [EXTERNAL] [BULK] How to make/run romio tests?

An addendum, it's possible my "bugfix" as detailed in https: //github. com/pmodels/mpich/issues/7452<https:// /github. com/pmodels/mpich/issues/7452> might not be enough. I have a code that uses `MPI_Info_set` to, well, set infos and I can't seem to affect the fs type. First I set: 
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd
An addendum, it's possible my "bugfix" as detailed in https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Fgithub.com*2Fpmodels*2Fmpich*2Fissues*2F7452&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846576753*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=hm0EARZ2XroPcOnlU0JfeiZ7G3baa2VLnOqBD8rKp5w*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJ1WR4ioQ$ <https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.us*2Fv3*2F__https*3A*2F*2Fgithub.com*2Fpmodels*2Fmpich*2Fissues*2F7452__*3B!!G_uCfscf7eWS!aqjYcygbr3I8ZbKEHR9uOfQmiIa7WR2lVajdfRCYksA9leIz6X8t0pUZ9m8BzT8XyErKAf5BrG_M2fsmgucN-O7Wg10*24&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846606996*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=3JtRInLaEUtmtSgzcAQ*2F6N*2BMSQmH7Xsyh5xlgDpvYvQ*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJp6_lzoQ$ ><https://urldefense.us/v3/__https://github.com/pmodels/mpich/issues/7452__;!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJTIe7kWc$ > might not be enough.

I have a code that uses `MPI_Info_set` to, well, set infos and I can't seem to affect the fs type.

First I set:

  export ROMIO_PRINT_HINTS=1

and then in my code I added:

        call MPI_INFO_SET(info,"romio_filesystem_type","QUOBYTEFS:", status)

but, well:

  key = romio_filesystem_type     value = UFS: Generic ROMIO driver for all UNIX-like file systems

I also tried it in lowercase as well. No joy.

I've also tried:

  export ROMIO_FSTYPE_FORCE="QUOBYTEFS:"

and:

  export ROMIO_FSTYPE_FORCE="quobytefs:"

but in each case, it's still UFS. I do know my Infos are being seen by MPICH because if I toggled:

        call MPI_INFO_SET(info,"romio_cb_write","enable", status)

from enable to disable, the ROMIO_PRINT_HINTS show the change.

Matt

[signature_3627681122]<https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.us*2Fv3*2F__http*3A*2F*2Fwww.ssaihq.com*2F__*3B!!G_uCfscf7eWS!aqjYcygbr3I8ZbKEHR9uOfQmiIa7WR2lVajdfRCYksA9leIz6X8t0pUZ9m8BzT8XyErKAf5BrG_M2fsmgucNFDu3aGQ*24&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846626606*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=5QycwIR94NfkMWhDXU4WJudfa5Cyds*2FwkU4hy4Fiy3E*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSU!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJ01GsjQc$ >

Matt Thompson
Lead Scientific Software Engineer/Supervisor
Global Modeling and Assimilation Office
Science Systems and Applications, Inc.
Code 610.1, 8800 Greenbelt Rd, Greenbelt, MD 20771
o: 301-614-6712
matthew.thompson at nasa.gov<mailto:matthew.thompson at nasa.gov>

From: Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC] via discuss <discuss at mpich.org>
Date: Wednesday, June 11, 2025 at 9:37 AM
To: discuss at mpich.org <discuss at mpich.org>
Cc: Thompson, Matt (GSFC-610.1)[SCIENCE SYSTEMS AND APPLICATIONS INC] <matthew.thompson at nasa.gov>
Subject: [EXTERNAL] [BULK] [mpich-discuss] How to make/run romio tests?
All, I'm trying to do some tests on a Quobyte system and we've seen confusing file write timings with Intel MPI and Open MPI. So, a bit of googling seeing if some MPI stack has a mention of Quobyte turns up: https: //www. quobyte. com/blog/quobyte-mpi-io-support-with-kernel-bypass-now-available/<https:// /www. quobyte. com/blog/quobyte-mpi-io-support-with-kernel-bypass-now-available/>
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd
All,

I'm trying to do some tests on a Quobyte system and we've seen confusing file write timings with Intel MPI and Open MPI. So, a bit of googling seeing if some MPI stack has a mention of Quobyte turns up:

https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Fwww.quobyte.com*2Fblog*2Fquobyte-mpi-io-support-with-kernel-bypass-now-available*2F&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846642098*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=gk*2FSx8u3dy*2FkPO9vy5EQULuWi9xLU0*2F5Q6d*2BdadmqU4*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJXSgbbFE$ <https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.us*2Fv3*2F__https*3A*2F*2Fwww.quobyte.com*2Fblog*2Fquobyte-mpi-io-support-with-kernel-bypass-now-available*2F__*3B!!G_uCfscf7eWS!foSdMay5QSiTxv1dePpWE5p5EOqkyr5hGLVXtgYBy6sY2_p9bErxn31S50_D4xpBCr1CIJCYqJV6YIlpDH99oVGEJLU*24&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846656367*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=YDbhlMHvnXFAoNsaERg471pqH5iUFPzJOe2P08nsW14*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUl!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJD43uKqQ$ ><https://urldefense.us/v3/__https://www.quobyte.com/blog/quobyte-mpi-io-support-with-kernel-bypass-now-available/__;!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJX6PTTaY$ >

and, yep, quobyte seems to be in MPICH! I grabbed MPICH 4.3.0 and built it (with one bug fix[1]) and well, it seems to run Hello World.

So, following that Quobyte page, I get to Step 10 and tried the romio tests and...I am apparently dumb. I went to my

  build/src/mpi/romio/test

directory and I see 'runtests' there, but:

  > ./runtests
  make: *** No rule to make target 'default'.  Stop.

I also tried with -fname and:

> ./runtests -fname=quobyte:test_mpi_file
./runtests: line 90: [quobyte:test_mpi_file: command not found
make: *** No rule to make target 'default'.  Stop.

> ./runtests -fname=quobyte:/home/mathomp4/MPI/src/mpich-4.3.0/build-ifort-2021.13/src/mpi/romio/test/test_mpi_file
./runtests: line 90: [quobyte:/home/mathomp4/MPI/src/mpich-4.3.0/build-ifort-2021.13/src/mpi/romio/test/test_mpi_file: No such file or directory
make: *** No rule to make target 'default'.  Stop.

Yeah. I'm stumped. I'm guessing I've missed some simple step along the way.

NOTE: I have no idea even how to use romio really, but I was hoping the tests could, well, help me figure that out.

Thanks for any help,
Matt

[1] See https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Fgithub.com*2Fpmodels*2Fmpich*2Fissues*2F7452&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846671074*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=woRFGafqds2PHXAZP4FY*2FyCPBN8ivmIPNWmJoujFE1w*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJKMN2hTw$ <https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.us*2Fv3*2F__https*3A*2F*2Fgithub.com*2Fpmodels*2Fmpich*2Fissues*2F7452__*3B!!G_uCfscf7eWS!foSdMay5QSiTxv1dePpWE5p5EOqkyr5hGLVXtgYBy6sY2_p9bErxn31S50_D4xpBCr1CIJCYqJV6YIlpDH99XaSWwF0*24&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846689321*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=dPQcsAydLQHQgARIRDYygmrYBVc2FAxQDaCthgzeJr4*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJC1r_iMU$ ><https://urldefense.us/v3/__https://github.com/pmodels/mpich/issues/7452__;!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJTIe7kWc$ >

[signature_3314915376]<https://urldefense.us/v3/__https://gcc02.safelinks.protection.outlook.com/?url=https*3A*2F*2Furldefense.us*2Fv3*2F__http*3A*2F*2Fwww.ssaihq.com*2F__*3B!!G_uCfscf7eWS!foSdMay5QSiTxv1dePpWE5p5EOqkyr5hGLVXtgYBy6sY2_p9bErxn31S50_D4xpBCr1CIJCYqJV6YIlpDH99MYB1cYk*24&data=05*7C02*7Cmatthew.thompson*40nasa.gov*7C3b716c7a8d6d477b82ab08dda9156519*7C7005d45845be48ae8140d43da96dd17b*7C0*7C0*7C638852631846705087*7CUnknown*7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ*3D*3D*7C0*7C*7C*7C&sdata=qhWucbLAEiNptzn45LdLti6KnhDAoPLTaXkg7HBXDdI*3D&reserved=0__;JSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJSUlJQ!!G_uCfscf7eWS!fMuLGLjht6XKRXDIOdnpNyCtJcnTo_DS4vrH2kfjZ_JfdNEBQPvYbTpTuQ50UMlzNzAiLQLhLkzmAUs19icJyGv1d0A$ >

Matt Thompson
Lead Scientific Software Engineer/Supervisor
Global Modeling and Assimilation Office
Science Systems and Applications, Inc.
Code 610.1, 8800 Greenbelt Rd, Greenbelt, MD 20771
o: 301-614-6712
matthew.thompson at nasa.gov<mailto:matthew.thompson at nasa.gov>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mpich.org/pipermail/discuss/attachments/20250611/8ec093f1/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 63716 bytes
Desc: image001.png
URL: <http://lists.mpich.org/pipermail/discuss/attachments/20250611/8ec093f1/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 358 bytes
Desc: image002.png
URL: <http://lists.mpich.org/pipermail/discuss/attachments/20250611/8ec093f1/attachment-0003.png>