PBS job queue creation

Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation

Adding compute or execution nodes to PBS queue management

To Add the nodes in pbs login to master node and use:

qmgr

create node master
create node compute-0-0
create node compute-0-1
quit

• On each and every node ensure that

  ping <master-hostname>    (eg ping rocks)

  results in master private IP and not public IP. In case of rocks cluster we might have to edit /etc/hosts on client for this to happen.

After adding the node, restart the pbs service in all nodes (Master + All compute nodes)

/root/restart-pbs.sh

#Repeat below for all compute nodes
ssh compute-0-0 "systemctl restart pbs"    

Looking at PBS nodes information

• List of all nodes present in PBS

  pbsnodes -a

  For working setup, In the output, state should be free and able to see the resources.

• To get details of all nodes and vnodes

  pbsnodes -av

To get only state information for all nodes, we can filter for state and node name via grep:

pbsnodes -a | grep '^[^ ]\|state' | grep -v last

• To get specific node or vnode information

  pbsnodes <node-or-vnode-name>

  For example

  pbsnodes compute-0-0

Create job queue for submitting jobs

1. Login to master server
2. Create execution queue

   qmgr -c "create queue nongpu queue_type=execution"
   qmgr -c "set queue nongpu started=true"
   qmgr -c "set queue nongpu enabled=true"
   qmgr -c "set queue nongpu resources_default.nodes=1"
   qmgr -c "set queue nongpu resources_default.walltime=3600"

3. Set server default queue

   qmgr -c "set server default_queue = nongpu"

4. Enable the scheduling

   qmgr -c "set server scheduling=true"

5. Enable job history

   qmgr -c "set server job_history_enable=true"

6. We can see the list of all parameters and their values using:

   qmgr -c "print server"

Refer:

• http://docs.adaptivecomputing.com/torque/2-5-12/help.htm#topics/4-serverPolicies/exampleQueueConfig.htm
• https://zhanggroup.org/docs/node29.html

Enable jobs submission as root user

By default Jobs cannot be submitted by root user. To submit jobs as root, please run the below command:

qmgr -c “set server acl_roots=root”

Home > CentOS > CentOS 7.x > CentOS 7.x Rocks cluster 7.0 > PBS job queue creation