<div dir="ltr">Hello,<div><br></div><div>I am using mpi4py to call MPI from python, and when I increase the number of ranks at the command line so something like:</div><div><div><br></div><div>[jlarson@mintthinkpad test]$ mpiexec -n 30 python script.py </div>
</div><div><br></div><div>I receive the following error messages:</div><div><br></div><div><div>[mpiexec@mintthinkpad] handle_pmi_cmd (pm/pmiserv/pmiserv_cb.c:52): Unrecognized PMI command: | cleaning up processes</div>
<div>
[mpiexec@mintthinkpad] control_cb (pm/pmiserv/pmiserv_cb.c:280): unable to process PMI command</div><div>[mpiexec@mintthinkpad] HYDT_dmxu_poll_wait_for_event (tools/demux/demux_poll.c:76): callback returned error status</div>
<div>[mpiexec@mintthinkpad] HYD_pmci_wait_for_completion (pm/pmiserv/pmiserv_pmci.c:198): error waiting for event</div><div>[mpiexec@mintthinkpad] main (ui/mpich/mpiexec.c:336): process manager error waiting for completion</div>
</div><div><br></div><div>When I search online for help with these error messages, I am only pointed towards the repository containing the files that are themselves throwing the error. For example: Googling for "handle_pmi_cmd Unrecognized PMI command" only returns:</div>
<div><br></div><div><a href="https://svn.mcs.anl.gov/repos/mpi/mpich2/tags/release/mpich2-1.3a1/src/pm/hydra/pm/pmiserv/pmiserv_cb.c">https://svn.mcs.anl.gov/repos/mpi/mpich2/tags/release/mpich2-1.3a1/src/pm/hydra/pm/pmiserv/pmiserv_cb.c</a><br>
</div><div><br></div><div><br></div><div>Note that my script is using very few resources; each rank is spawning a simple external function. The function takes a vector and then sums all the entries, squares them, and returns the number to each rank. The script works as expected when the number of initial ranks is small.</div>
<div><br></div><div>Thank you for your help.<br>Jeffrey Larson</div></div>