Mission Shares Policy

Article ID: 168
Last updated: 13 May, 2021

Mission directorate shares have been implemented on HECC systems for more than ten years. Implementing shares guarantees that each mission directorate gets its fair share of resources.

The share to which a job is assigned is based on the project group ID (GID) used by the job. After all the cores within a mission directorate's share have been assigned, other jobs assigned to that share must wait. This is true even if cores are available in a different mission directorate's share, with the following exception:

When a mission directorate is not using all of its cores, other mission directorates can borrow those cores, but only for jobs that will finish within 4 hours. When part of the resource is unavailable, the total number of cores decreases, and each mission directorate loses a proportionate number of cores.

You can display the share distribution by adding the -W shares=- option to the qstat command. For example:

%qstat -W shares=-

Group   Share% Use%  Share Exempt    Use  Avail Borrowed Ratio Waiting
------- ------ ---- ------ ------ ------ ------ -------- ----- -------
Overall    100    0 405070      0     44 405026        0  0.00   47680
 ARMD       27   28 110166    747 116736      0     6570  1.06  392206
 HEOMD      23   21  93560   1360  87952   5608        0  0.94  125004
 SMD        33   33 136088     16 136696      0      608  1.00  390340
 ASTRO      14    7  56703      0  30724  25979        0  0.54  131656
 NAS         2    0   8505      0   3080   5425        0  0.36   67488

Mission shares are calculated by combining the mission's HECC share of the shared assets with the mission-specific assets. The second column of the sample output above shows the mission shares. Other information displayed includes: the amount of resources used and borrowed by each mission, the amount of resources available to each mission, and the resources each mission is waiting for.

The qs utility (available under /u/scicon/tools/bin/qs) provides similar information, and also includes details that break the resources into the different processor types. In addition, the utility can show the remaining time for jobs that are running, or how much time was requested by waiting jobs.

Specify the -h option of qs for instructions on how to use it. For example:

% /u/scicon/tools/bin/qs -h

usage: qs [-d] [-D] [-h] [-M] [-n N] [-o] [-r] [-s svr] [-t] [-u] [-v] [-w]
               [-x] [--audit f] [--file f] [--runout f] [--user U]
       -d         : darker colored resource bars (for a light background)
       -D         : show count of offline & down nodes
       -h         : provide this message
       -n NUM     : show time remaining before NUM nodes are free
       -N NUM     : show time remaining before NUM nodes are free; suppress
                    other output
       -o         : show old-style resource usage without time information
       -r         : show runout times & expansion factors
       -s svr     : show data for PBS server svr [default: pbspl1]
       -t         : show time remaining & nodes used for each running job
       -u         : highlight resources for jobs of user running qs
       -v         : (verbose) provide explanation of display elements
       -w         : have resource bars show wait time, not remaining time
                    (cannot be used with -n, -o, -t, or -x)
       -x         : have resource bars show expansion factor of jobs,
                    not remaining time (cannot be used with -n, -o, -t or -w)
       --audit f  : reserved for debugging
       --file f   : reserved for debugging
       --runout f : put runout information in file f
       --user U   : highlight resources for jobs of users U (comma-separated list)
       --noShares : highlight resources for jobs that could start now if no shares
       --1node    : highlight resources for jobs that use only 1 node

Here is a sample output file of qs:

Also read

Contact Us

General User Assistance

Security

  • Report security issues 24x7x365
  • Toll-free: 1-877-NASA-SEC (1-877-627-2732)
  • E-mail: soc@nasa.gov

User Documentation

High-End Computing Capability (HECC) Portfolio Office

NASA High-End Computing Program

Tell Us About It

Our goal is furnish all the information you need to efficiently and effectively use the HECC resources needed for your NASA computational projects.

We welcome your input on features and topics that you would like to see included on this website.

Please send us email with your wish list and other feedback.