Downloading Datasets
Finding Datasets
If you do not have a direct link to a FRDR-hosted dataset you can browse through available datasets using the FRDR Discovery.
Finding the File Listing for a Dataset and Downloading with a Web Browser
The file browsing widget for each dataset is located near the bottom of the data landing page.
To download data through a web browser, you can either click on the file name to download a specific file to your device, or you can use the ‘Download as Zip’ function to create a Zip file with the data you want to access.
If you need to create a stable download link for an individual file, for example, to include in a publication or in a script, please see Creating individual download links below.
Downloading Datasets as Zip
To download the full dataset, or a subset of files and folders, via your web browser, you can request that FRDR Zip the contents for you. No FRDR account or registration is required, but if you are not signed in to an existing FRDR account, you will be asked to provide a valid email address so FRDR can send you a link to access the data.
To get started:
To get started, click the “Download as Zip” button below the file listing. If you are signed into your FRDR account, we will use the email we have on file, and you will be directed to the download request form. If you are not signed in to FRDR, please provide an email address and click “Request”. Check your email for a message from FRDR support, and click the link provided to open the download request form.
Download Request Form / Create your Zip file:
Select the files and folders you want to download. If you choose a folder, FRDR will automatically include all of the contents (files and sub-folders) in your Zip archive. You can navigate into any folder to select or deselect items as necessary. FRDR will automatically include the dataset LICENSE, a recommended citation, a README file from the top-level directory, and the names and checksums of all files in the dataset, for your reference.
We have set a 20 GB limit per download request. As you select files and folders, FRDR will calculate the approximate size of your request and display it next to the “Create Zip File” button. If you need to download more than 20 GB, we recommend splitting your request into multiple Zip files or using Globus Transfer to download the dataset.
When you have completed your selection, click “Create Zip File”. If your request was submitted successfully, you will see a message with next steps. If you receive an error message or encounter another issue, please contact support@frdr-dfdr.ca for assistance.
Download your Zip file:
When it is ready to download, FRDR will send you an email with a link to access your Zip file, or you can click “Return to Download Request Form” and refresh/reload the page to check the status of your request (requested, processing, or complete). Processing time will vary based on the number and size of files selected.
When your Zip file is ready to download, the file name will be hyperlinked under “Current Zip files for this dataset”. The Zip file you requested will remain accessible for 14 days at the link FRDR provided, after which it will be removed from our system.
To request another Zip file for the same dataset, you must first delete any active/current Zip file.
Creating individual download links
FRDR mirrors data on multiple servers. In order to generate a stable download link for an individual file, which will work regardless of which server we are pointing to, right-click on the file name (control-click on a Mac), select “Copy Link Address” and paste the result. The file name will have a path similar to this: https://www.frdr-dfdr.ca/repo/files/1/published/publication_NNN/submitted_data where “NNN” will be replaced by a publication number unique to the dataset in FRDR.
While these links are relatively stable, they are not intended to replace the dataset DOI. The DOI is a unique, persistent identifier, which will always lead to a record of your dataset. If you plan to include a download link in a publication, a script file, or on your website, we recommend that you also reference the dataset DOI. If you have questions, or if you need to generate stable download links for a large number of files in a dataset, please contact the FRDR support desk for assistance support@frdr-dfdr.ca.
Downloading Datasets with Globus Transfer
Globus is a free software that allows for reliable, high-speed file transfers. It is the best method for downloading large amounts of data from FRDR. To use Globus, you either need access to a server with Globus pre-installed, such as most Digital Research Alliance of Canada national host sites, or you will need to set up your own Globus account and install Globus Connect Personal on your device.
The video below goes through the detailed steps to get a working Globus Transfer endpoint:
