Mission directorate shares have been implemented on HECC systems for more than ten years. Implementing shares guarantees that each mission directorate gets its fair share of resources.
The share to which a job is assigned is based on the project group ID (GID) used by the job. After all the cores within a mission directorate's share have been assigned, other jobs assigned to that share must wait. This is true even if cores are available in a different mission directorate's share, with the following exception:
When a mission directorate is not using all of its cores, other mission directorates can borrow those cores, but only for jobs that will finish within 4 hours. When part of the resource is unavailable, the total number of cores decreases, and each mission directorate loses a proportionate number of cores.
You can display the share distribution by adding the -W shares=- option to the qstat command. For example:
Mission shares are calculated by combining the mission's HECC share of the shared assets with the mission-specific assets. The second column of the sample output above shows the mission shares. Other information displayed includes: the amount of resources used and borrowed by each mission, the amount of resources available to each mission, and the resources each mission is waiting for.
The qs utility (available under /u/scicon/tools/bin/qs) provides similar information, and also includes details that break the resources into the different processor types. In addition, the utility can show the remaining time for jobs that are running, or how much time was requested by waiting jobs.
Specify the -h option of qs for instructions on how to use it. For example:
% /u/scicon/tools/bin/qs -h
usage: qs [-d] [-D] [-h] [-M] [-n N] [-o] [-r] [-s svr] [-t] [-u] [-v] [-w]
[-x] [--audit f] [--file f] [--runout f] [--user U]
-d : darker colored resource bars (for a light background)
-D : show count of offline & down nodes
-h : provide this message
-n NUM : show time remaining before NUM nodes are free
-N NUM : show time remaining before NUM nodes are free; suppress
other output
-o : show old-style resource usage without time information
-r : show runout times & expansion factors
-s svr : show data for PBS server svr [default: pbspl1]
-t : show time remaining & nodes used for each running job
-u : highlight resources for jobs of user running qs
-v : (verbose) provide explanation of display elements
-w : have resource bars show wait time, not remaining time
(cannot be used with -n, -o, -t, or -x)
-x : have resource bars show expansion factor of jobs,
not remaining time (cannot be used with -n, -o, -t or -w)
--audit f : reserved for debugging
--file f : reserved for debugging
--runout f : put runout information in file f
--user U : highlight resources for jobs of users U (comma-separated list)
--noShares : highlight resources for jobs that could start now if no shares
--1node : highlight resources for jobs that use only 1 node