Shift Transfer Tool Upgrade Provides New Features

23 May, 2016

The latest upgrade to the Shift transfer tool, shiftc, provides the following enhancements to automated transfer components:

  • Six new dedicated nodes are now transparently available for Shift transfers. All six nodes have access to the Pleiades file systems, and two of the nodes also have access to Lou file systems. When you transfer files and data using Shift, the transfer operation will be automatically parallelized on these nodes.
  • The tool's built-in transports and sum/checksum code are now multi-threaded, providing significant performance gains in many cases.
  • A new built-in transport called fish-tcp supports direct unencrypted TCP data channels, as bbftp does, but unlike bbftp it does not require a separate installation.
  • All remote transports can now also be used for local transfer operations.
  • The --encrypt option has been deprecated in favor of --secure, which also selects different SSH ciphers and MAC algorithms.
  • Several new tuning options allow greater control over underlying transports. These include: --bandwidth, --buffer, --ports, --streams, --threads, and --window. You should not need to adjust these settings unless the default settings are deemed inadequate.

Required for remote Shift users: You must upgrade your SUP client. Without the upgrade, your remote Shift transfers will not run correctly. You will be automatically prompted to upgrade during key generation, or you can manually force an upgrade using the command sup -g. Answer “y” to the upgrade prompt in either case.

For more information about using Shift, see man shiftc and the following Knowledge Base articles:

If you have any questions, please contact the Control Room at (800) 331-8737, (650) 604-4444, or support@nas.nasa.gov.

Contact Us

General User Assistance

Security

  • Report security issues 24x7x365
  • Toll-free: 1-877-NASA-SEC (1-877-627-2732)
  • E-mail: soc@nasa.gov

User Documentation

High-End Computing Capability (HECC) Portfolio Office

NASA High-End Computing Program

Tell Us About It

Our goal is furnish all the information you need to efficiently and effectively use the HECC resources needed for your NASA computational projects.

We welcome your input on features and topics that you would like to see included on this website.

Please send us email with your wish list and other feedback.