Downloading Datasets from the NAS Data Portal

Article ID: 575
Last updated: 27 Jul, 2022

To download shared datasets submitted by other NAS users, visit the NAS Data Portal download site:

The homepage lists all of the datasets available for download. You can also search for a specific dataset by its name, owner, or tag.

  • Public datasets: No login is required.
  • Restricted datasets: To view and download restricted datasets for which you have been specified as a collaborator, use LaunchPad to authenticate. This will enable you to gain access to your datasets.
    Note: If you are a non-NASA collaborator, you will authenticate using the email address and password that was set up for your LaunchPad Guest Account.

For more information about dataset types and security requirements, see NAS Data Portal: Overview.

Downloading Files in Bulk

In order to download all the files in a directory, you can use the following command:

for i in `lynx -dump -listonly download_directory_URL | grep download_data.php | awk '{print $2}'`; \
do file=`basename $i`; wget -O $file $i ; done

where download_directory_URL is the URL of the NAS Data Portal directory containing the desired download files.
For example: https://data.nas.nasa.gov/ecco/data.php?dir=/eccodata/llc_270/iter42/input

Note: The command line above is too long to be formatted as one line, so it is broken with a backslash (\).

You can make this command into a shell script and pass the download URL to the script. For example:

Sample Script: get_download_data.sh

#!/bin/bash
 
for i in `lynx -dump -listonly $1 | grep download_data.php | awk '{print $2}'`
do
file=`basename $i`
wget -O $file $i
done

Run the script as follows:

./get_download_data.sh download_directory_URL

This article was:  
Also read

Contact Us

General User Assistance

Security

  • Report security issues 24x7x365
  • Toll-free: 1-877-NASA-SEC (1-877-627-2732)
  • E-mail: soc@nasa.gov

User Documentation

High-End Computing Capability (HECC) Portfolio Office

NASA High-End Computing Program

Tell Us About It

Our goal is furnish all the information you need to efficiently and effectively use the HECC resources needed for your NASA computational projects.

We welcome your input on features and topics that you would like to see included on this website.

Please send us email with your wish list and other feedback.