<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Gus,<br>
thanks for your suggestions and links to more info; I was
contemplating using any of the three unused ethernet interfaces at
the back of each of the three computers, and using a cluster-only
subnet for the inversion. You comments about a separate hostname and
so forth are great, and I can re-activate iptables on those
interfaces connected to the outside world. <br>
<br>
Thanks,<br>
Ron<br>
<div class="moz-cite-prefix">On 4/03/2014 08:54, Gus Correa wrote:<br>
</div>
<blockquote cite="mid:53150829.60305@ldeo.columbia.edu" type="cite">
<br>
On 03/03/2014 04:36 PM, Ron Palmer wrote:
<br>
<blockquote type="cite">Thanks Reuti for your comments. I will
peruse that FAQ detail.
<br>
<br>
I just thought of the fact that each of these rack computers
have 4
<br>
ethernet sockets, eth0 - eth3... I could connect the cluster on
a
<br>
separate ethernet sockets via an extra switch not connected to
the
<br>
internet or any other computers, and accept all communication
among
<br>
them, and keep iptables up on the ethx connected to the outside
world. I
<br>
guess I would have to set up routing tables or something. Ah,
more
<br>
reading :-)
<br>
<br>
Thanks for your help.
<br>
Ron
<br>
<br>
</blockquote>
Hi Ron
<br>
<br>
If those extra interfaces are not in use,
<br>
and if you have a spare switch,
<br>
you can setup a separate private subnet exclusively for MPI.
<br>
You need to configure the interfaces consistently (IP, subnet
mask,
<br>
perhaps a gateway). Configuring them statically is easy:
<br>
<br>
<a class="moz-txt-link-freetext" href="https://access.redhat.com/site/documentation//en-US/Red_Hat_Enterprise_Linux/6/html-single/Deployment_Guide/index.html#s2-networkscripts-interfaces-eth0">https://access.redhat.com/site/documentation//en-US/Red_Hat_Enterprise_Linux/6/html-single/Deployment_Guide/index.html#s2-networkscripts-interfaces-eth0</a>
<br>
<br>
Use a subnet that doesn't intersect the existent/original IP
range.
<br>
<br>
<a class="moz-txt-link-freetext" href="http://en.wikipedia.org/wiki/Private_network">http://en.wikipedia.org/wiki/Private_network</a>
<br>
<br>
You could also create host names associated to those IPs (say
<br>
node01, node02, node02), resolve them via /etc/hosts on each
computer,
<br>
set passwordless ssh across these newly named "hosts".
<br>
This may simpler/safer than messing with the iptables.
<br>
<br>
[Actually, the IP addresses you showed 192.168.X.Y, sound as a
private
<br>
subnet already, not Internet, but that may be the subnet for your
<br>
organization/school/department already. So, you may set up a
different
<br>
one on these three computers for MPI and very-local access.]
<br>
<br>
OpenMPI allows you to choose the interface that it will use,
<br>
so you can direct it to your very-local subnet:
<br>
<br>
<a class="moz-txt-link-freetext" href="http://www.open-mpi.org/faq/?category=tcp#tcp-selection">http://www.open-mpi.org/faq/?category=tcp#tcp-selection</a>
<br>
<br>
I hope this helps,
<br>
Gus
<br>
<br>
<br>
<blockquote type="cite">On 4/03/2014 00:13, Reuti wrote:
<br>
<blockquote type="cite">Am 03.03.2014 um 01:34 schrieb Ron
Palmer:
<br>
<br>
<blockquote type="cite">Gus,
<br>
I have just replied with the details of the success, but I
will
<br>
clarify your questions here, if it helps next time.
<br>
<br>
Re the actual application to be run, 'inversion', I have
only
<br>
received binaries. I used to run them on gainsborough
(without mpi)
<br>
and that worked fine.
<br>
<br>
Home directories are not nfs shared, they are individual and
<br>
separate, only the name is repeated.
<br>
<br>
I had tried password free ssh in all directions and
permutations.
<br>
<br>
I had iptables down on sargeant and up on the other two.
<br>
<br>
Yes, I installed the gcc-gfortran.x86_64 AFTER I took those
<br>
screnshots, and the post install output was identical to the
top one
<br>
(sargeant).
<br>
<br>
I am unsure about cpi and fortran...
<br>
<br>
Stuff remaining to get sorted out:
<br>
1. Get that hyperthreading set up - what is your
suggestions? Disable
<br>
and let mpi manage the cores?
<br>
</blockquote>
It depends on your applications, whether you can make use of
it. Test
<br>
it with HT switched off, switched on and increase the number
of
<br>
processes, until you see that any process is no longer running
at 100%
<br>
and you judge that you don't tolerate this slow down.
<br>
<br>
It's not uncommon to see an improvement up to 150% with HT
turned on,
<br>
but not 200% (depending on the workload).
<br>
<br>
<br>
<blockquote type="cite">2. run mpiexec with iptables up, need
to figure out what traffic to
<br>
allow.
<br>
</blockquote>
<a class="moz-txt-link-freetext" href="https://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_How_do_I_control_which_ports_MPICH_uses.3F">https://wiki.mpich.org/mpich/index.php/Frequently_Asked_Questions#Q:_How_do_I_control_which_ports_MPICH_uses.3F</a>
<br>
<br>
<br>
-- Reuti
<br>
<br>
<br>
<blockquote type="cite">Great many thanks to all, and Gus,
Reuti and Rajeev in particular.
<br>
<br>
Cheers,
<br>
Ron
<br>
<br>
On 3/03/2014 10:09, Gustavo Correa wrote:
<br>
<blockquote type="cite">Hi Ron
<br>
<br>
</blockquote>
</blockquote>
</blockquote>
<br>
<br>
<br>
_______________________________________________
<br>
discuss mailing list <a class="moz-txt-link-abbreviated" href="mailto:discuss@mpich.org">discuss@mpich.org</a>
<br>
To manage subscription options or unsubscribe:
<br>
<a class="moz-txt-link-freetext" href="https://lists.mpich.org/mailman/listinfo/discuss">https://lists.mpich.org/mailman/listinfo/discuss</a>
<br>
</blockquote>
<br>
_______________________________________________
<br>
discuss mailing list <a class="moz-txt-link-abbreviated" href="mailto:discuss@mpich.org">discuss@mpich.org</a>
<br>
To manage subscription options or unsubscribe:
<br>
<a class="moz-txt-link-freetext" href="https://lists.mpich.org/mailman/listinfo/discuss">https://lists.mpich.org/mailman/listinfo/discuss</a>
<br>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<meta http-equiv="CONTENT-TYPE" content="text/html;
charset=ISO-8859-1">
<title></title>
<meta name="GENERATOR" content="OpenOffice.org 3.3 (Win32)">
<meta name="AUTHOR" content="Ron Palmer">
<meta name="CREATED" content="20120715;16240238">
<meta name="CHANGEDBY" content="Ron Palmer">
<meta name="CHANGED" content="20120715;16254174">
<style type="text/css">
<!--
@page { margin: 2cm }
P { margin-bottom: 0.21cm }
P.western { so-language: en-AU }
A:link { so-language: zxx }
-->
</style>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"><font
color="#0000a2"><font face="Times New Roman"><font size="3"><span
lang="en"><b>Ron
Palmer</b></span></font></font></font><font
color="#000000"> </font><font color="#000000"><font size="2"><span
lang="en">MSc
MBA</span></font></font><font color="#000000"><span
lang="en">. </span></font>
</p>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"
lang="en">
<font color="#000000"><font face="Times New Roman"><font
size="3">Principal
Geophysicist</font></font></font></p>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"><a
href="mailto:ron.palmer@pgcgroup.com.au"><font color="#0000a2"><font
face="Times New Roman"><font size="3"><span lang="en">ron.palmer@pgcgroup.com.au</span></font></font></font></a></p>
<p class="western" style="margin-bottom: 0cm; line-height: 100%"
lang="en">
<font color="#000000"><font face="Times New Roman"><font
size="3">0413
579 099</font></font></font></p>
<p class="western" style="line-height: 100%" lang="en"><font
color="#000000"><font face="Times New Roman"><font size="3">07
3103 4963</font></font></font></p>
<p class="western" style="margin-bottom: 0cm"><br>
</p>
</div>
</body>
</html>