Ubuntu HPC Common setup of all HPC nodes

From Notes_Wiki
Revision as of 10:27, 19 May 2023 by Saurabh (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Home > Ubuntu > HPC setup with openpbs and openmpi > Common setup of all HPC nodes

Plan is to create an Ubuntu 20.04 template using below steps. Then we can clone the template to master / execution nodes and configure those nodes individually separately.

For common node (template) setup use:

  1. Install Ubuntu 20.04 Desktop with most default values. Non-root user can be admin1.
  2. Login with non-root user creation during OS installation (eg admin1) and disable screen lock and blanking of screen
  3. Configure history retention as explained at Storing date / time along with commands in history
  4. Install ssh, vim and other required packages via: 
    sudo su -
    

    apt update
    

    apt -y install openssh-server vim htop stress
  5. Set desired root password: 
    passwd
  6. Enable root SSH by editing '/etc/ssh/sshd_config' 
    PermitRootLogin yes
  7. Restart sshd for changes to take effect: 
    systemctl restart sshd
  8. Install OpenPBS dependencies 
    apt-get -y install gcc make libtool libhwloc-dev libx11-dev libxt-dev libedit-dev libical-dev ncurses-dev perl python-dev tcl-dev tk-dev swig libexpat-dev libssl-dev libxext-dev libxft-dev autoconf automake expat libedit2  python sendmail-bin sudo tcl tk libpq5
  9. Install libhwloc for mpi /openpbs etc. 
    wget http://archive.ubuntu.com/ubuntu/pool/universe/h/hwloc/libhwloc5_1.11.9-1_amd64.deb
    

    dpkg -i libhwloc5_1.11.9-1_amd64.deb
  10. Install python 3.6 for openpbs 
    add-apt-repository ppa:deadsnakes/ppa
    

    apt -y install python3.6 libpython3.6
  11. Set python3.6 as default python 
    update-alternatives --install /usr/bin/python python /usr/bin/python3.6 1
    

    python --version
  12. In case of infiband we can install appropriate drivers via: 
    sudo add-apt-repository universe
    

    apt-get update
    

    apt-get install ibutils rdma-core libibmad5 opensm
  13. Install support for modules using: 
    apt install -y environment-modules
    After this logout and login into each node again for module command to work.
  14. Configure modules directory as module path in all nodes by editing '/etc/environment-modules/modulespath' and adding: 
    /export/modules


Home > Ubuntu > HPC setup with openpbs and openmpi > Common setup of all HPC nodes

Retrieved from "http://www.sbarjatiya.com/notes_wiki/index.php?title=Ubuntu_HPC_Common_setup_of_all_HPC_nodes&oldid=7905"