Streamlining PBS Job File Transfers to Lou

Article ID: 125
Last updated: 31 Dec, 2025

Some users prefer to streamline the storage of files (created during a job run) to Lou, within a PBS job. Because direct access to the Lou storage nodes from the NAS compute nodes has been disabled, all file transfers to Lou within a PBS job must first go through one of the appropriate front-end systems (for example, PFEs for bro_ele, sky_ele, cas_ait, rom_ait).

Here is an example of what you can add to your PBS script to accomplish this:

  1. ssh to a PFE (for example, pfe21) and create a directory on lou where the files are to be copied.

    ssh -q pfe21 "ssh -q lou mkdir -p $SAVDIR" 

    Here, $SAVDIR is assumed to have been defined earlier in the PBS script. Note the use of -q for quiet-mode, and double quotes so that shell variables are expanded prior to the ssh command being issued.

  2. Use scp via a PFE to transfer the files.

    ssh -q pfe21 "scp -q $RUNDIR/* lou:$SAVDIR" 

    Here, $RUNDIR is assumed to have been defined earlier in the PBS script.

Also read

Contact Us

General User Assistance

Security

  • Report security issues 24x7x365
  • Toll-free: 1-877-NASA-SEC (1-877-627-2732)
  • E-mail: soc@nasa.gov

User Documentation

High-End Computing Capability (HECC) Portfolio Office

NASA High-End Computing Program

Tell Us About It

Our goal is furnish all the information you need to efficiently and effectively use the HECC resources needed for your NASA computational projects.

We welcome your input on features and topics that you would like to see included on this website.

Please send us email with your wish list and other feedback.