The Alaska Satellite Facility Distributed Active Archive Center (ASF DAAC) bulk download service provides an easy way to give users a bulk download script that aids in downloading multiple products. The service will either embed a specified list of fully-qualified product URLs directly in the script, or provide a blank "dummy" script for use in downloading products using metalink or CSV files. You can also use the command line in ASF DAAC’s Search and Download application program interface (API) to bulk download.
Because using this service requires nothing more than crafting a link or posting form data, it is easy to use and flexible. Links to the service can be used anywhere a typical link can be used: use it on your website, your data archive search app, post it on facebook and reddit, tweet it, run it through a URL-shortener and text it to your friend, or put it in a QR code and stick it to a lamp post.
About the Bulk Download Script
For a full description and guide on using the bulk download script itself, please see our related data recipes: Bulk Data Download Using a Python Script in Vertex and Bulk Data Download Using a Python Script and CSV or METALINK File.
The bulk download script provided by this service uses Earthdata Login for authentication and is compatible with any provider that authenticates against the same, or does not require authentication. The script stores its Earthdata session information in ~/.bulk_download_cookiejar.txt. If that file does not exist, or the session is not valid, the user will be asked for credentials and a session will be established and stored for future re-use.
The bulk download script provided by this service is compatible with python >= 2.6.5, 2.7.5, 3.0.
Available Options
products=
A comma-separated list of fully-qualified URLs of products to be embedded in the script. Each URL should reference a specific file. This parameter can be specified multiple times, each containing one or more product URLs to be included in the generated script.
Example 1: (comma-separated list) https://bulk-download.asf.alaska.edu/?products=http%3A%2F%2Fhost.com%2F…
Example 2: (multiple products=) https://bulk-download.asf.alaska.edu/?products=http%3A%2F%2Fhost.com%2F…
Example 3: (combination of both) https://bulk-download.asf.alaska.edu/?products=http%3A%2F%2Fhost.com%2F…
filename=
A specific filename to be used when generating the script. By default, the filename will incorporate a timestamp and be of the form "download-all-YYYY-MM-DD_HH24-MI-SS.py" but this parameter will override that. The filename (whether specified or the default) will be used as the name of the file downloaded by the user, and is also embedded in the brief help block at the start of the script.
Example: https://bulk-download.asf.alaska.edu/?filename=Notable_Event_Products.py
/view
Using this path prior to the query string will override the default Content-Disposition and wrap the script in html for display in the browser. Any specified parameters still apply, although filename= will only affect the descriptive block at the start of the script.
Example: https://bulk-download.asf.alaska.edu/view
/help
View this document.
Example: https://bulk-download.asf.alaska.edu/help
Example Usage of this Service
| Empty Script | ||
| 1 product | ||
| 10 products | ||
| Named script | ||
| Provider smorgasbord |