The Shift automated transfer tool has been upgraded to make numerous fixes and add new features to improve scalability, optimize file batch handling, and reduce the tool's file tracking overhead.

Below are some key changes to help you understand the Shift option upgrades:

• Multi-threaded the "find" (directory traversal) stage. Previously, traversal was parallelized across multiple clients on the same or different hosts; now it can also be divided among multiple threads within the same client.
• Multi-threaded portions of the "chattr" (attribute preservation) stage that require external tools (striping, preallocation, acls, xattrs). This stage is now fully multi-threaded.
• Added an --interval=SECS option that dynamically adjusts batch size based on current rates being achieved so clients will keep busy for a minimum of --interval seconds (30 by default). The --files and --size settings have been changed to be minimum values, so --interval will only adjust upward.
• Added a --no-silent option to disable silent corruption detection. The long-term sums will not be accessed or stored when this option is active.

See a complete list of the Shift Command Options.

if you have any questions, please contact the Control Room at (800) 331-8737, (650) 604-4444, or support@nas.nasa.gov.