View source for Ubuntu HPC Install Openmpi from master node

[[Main Page|Home]] > [[Ubuntu]] > [[Ubuntu HPC setup with openpbs and openmpi|HPC setup with openpbs and openmpi]] > [[Ubuntu HPC Install Openmpi from master node|Install Openmpi from master node]]

We can install OpenMPI using source code by using:
#Create temporary directory for compilation of sources.  Download openmpi tar ball and extract sources in temporary compilation folder.
#:<pre>
#:: mkdir -p /export/apps/temp
#:: cd /export/apps/temp
#:: wget https://www.open-mpi.org/software/ompi/v4.1/downloads/openmpi-4.1.1.tar.gz
#:: tar xzf openmpi-4.1.1.tar.gz
#:</pre>
#Create directory for openmpi installation
#:<pre>
#:: mkdir -p /export/apps/mpi/openmpi-4.1.1
#:</pre>
#Install openmpi
#:<pre>
#:: cd /export/apps/temp/openmpi-4.1.1
#:: ./configure --enable-orterun-prefix-by-default --prefix=/export/apps/mpi/openmpi-4.1.1
#:: make -j 10
#:: make install
#:</pre>
#: In place of '<tt>make -j 10</tt>' we can run '<tt>nproc</tt>' and give higher value as parameter to '<tt>-j</tt>'.   The higher value indicates we can do more parallel compilation, if there are multiple concurrent compilation options within the sources.
# Disable StrictHostKeyChecking by editing '<tt>/etc/ssh/ssh_config</tt>' file and under '<tt>Host *</tt>' set:
#:<pre>
#:: StrictHostKeyChecking no
#:</pre>
#Set Passwordless authentication for HPC users.  (Eg user1 in below example)
#:<pre>
#:: ssh user1@<master>    #Or su - user1, if already on master node
#:: ssh-keygen  #Leave all prompts blank, just press enter-enter-enter
#:: cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys;  chmod 600 ~/.ssh/authorized_keys     #OR ssh-copy-id user@<compute1>
#:</pre>
#: Due to home folder sharing between nodes the above should result into user1 password-less SSH to all nodes in the cluster. 
#Set mpi path for user1 account
#:<pre>
#:: su - user1
#:: export PATH=/export/apps/mpi/openmpi-4.1.1/bin:$PATH
#:: export LD_LIBRARY_PATH=/export/apps/mpi/openmpi-4.1.1/lib:$LD_LIBRARY_PATH
#:</pre>
#: '''The above export PATH and export LD_LIBRARY_PATH approach is used only for testing mpi.  We will ideally setup modules [[Ubuntu HPC Install and Configure Modules]] to configure above settings for each user before they run/compile a program that depends on particular version of mpi.'''
#Check mpi version and path from user1
#:<pre>
#:: mpirun --version
#:: which mpirun
#:: echo $PATH
#:: echo $LD_LIBRARY_PATH
#:</pre>
#Run parallel job
#:<pre>
#:: mpirun -host master,<node-1>,<node-2> -n 3 /usr/bin/stress --cpu 4 --vm 2 --vm-bytes 300M --timeout 60s
#:</pre>
# While above command is executing, in parallel on each node open a terminal / shell and run
#:<pre>
#:: htop   #or top
#:</pre>
#:: and validate that at least 4CPU on each node are utilized up to 100% for 60 seconds during the above mpirun.



[[Main Page|Home]] > [[Ubuntu]] > [[Ubuntu HPC setup with openpbs and openmpi|HPC setup with openpbs and openmpi]] > [[Ubuntu HPC Install Openmpi from master node|Install Openmpi from master node]]