[mpich-discuss] stdin redirection
Thakur, Rajeev
thakur at mcs.anl.gov
Wed Jun 8 08:02:19 CDT 2016
You could read the input parameters by storing them in a text file and then using fopen and fscanf.
Rajeev
> On Jun 8, 2016, at 7:50 AM, Filippone, Salvatore <Salvatore.Filippone at cranfield.ac.uk> wrote:
>
> The key term here is "larg(ish)", which I used in my original email to
> mean something larger than the limit I was hitting (64KB) but not
> *really* large (in my original case I was using a file of around 300KB).
> I naturally moved to normal file I/O; MPI I/O was not quite called for,
> because these were just the control parameters for a series of benchmark
> runs, not actual input data (which was read and handled separately).
>
> Thanks
> Salvatore
>
> On Wed, 2016-06-08 at 12:46 +0000, Balaji, Pavan wrote:
>> If you want to read large files, you should really use MPI-I/O, not
>> stdin. We support reading from stdin for users who migrate from
>> sequential programs to parallel programming, but that's not meant to be
>> the real mechanism to read files. I'm not supportive of trying to
>> modify mpich for such use cases.
>>
>> -- Pavan
>>
>>> On Jun 5, 2016, at 11:18 AM, Seo, Sangmin <sseo at anl.gov> wrote:
>>>
>>> Hello Salvatore,
>>>
>>> The current MPICH uses pipe to redirect stdin to processes, but pipe
>> has a limited capacity (e.g., 64KB in Linux. Please refer to
>> http://man7.org/linux/man-pages/man7/pipe.7.html). Therefore, if we
>> redirect a file, which is larger than the pipe capacity, to stdin, the
>> current MPICH implementation is not handling it properly because write()
>> does not succeed to write a large data (> the pipe capacity) to the pipe
>> for stdin.
>>>
>>> I created a ticket for this issue
>> (https://trac.mpich.org/projects/mpich/ticket/2336), but I'd recommend
>> you to use file I/O in order to handle a large file instead of using
>> stdin redirection.
>>>
>>> — Sangmin
>>>
>>>
>
> _______________________________________________
> discuss mailing list discuss at mpich.org
> To manage subscription options or unsubscribe:
> https://lists.mpich.org/mailman/listinfo/discuss
_______________________________________________
discuss mailing list discuss at mpich.org
To manage subscription options or unsubscribe:
https://lists.mpich.org/mailman/listinfo/discuss
More information about the discuss
mailing list