Using the Globus Data Transfer Tool

Quest and Kellogg Linux Cluster Downtime, December 14 - 18.

Quest, including the Quest Analytics Nodes, the Genomics Compute Cluster (GCC), the Kellogg Linux Cluster (KLC), and Quest OnDemand, will be unavailable for scheduled maintenance starting at 8 A.M. on Saturday, December 14, and ending approximately at 5 P.M. on Wednesday, December 18. During the maintenance window, you will not be able to login to Quest, Quest Analytics Nodes, the GCC, KLC, or Quest OnDemand submit new jobs, run jobs, or access files stored on Quest in any way including Globus. For details on this maintenance, please see the Status of University IT Services page.

Quest RHEL8 Pilot Environment - November 18.

Starting November 18, all Quest users are invited to test and run their workflows in a RHEL8 pilot environment to prepare for Quest moving completely to RHEL8 in March 2025. We invite researchers to provide us with feedback during the pilot by contacting the Research Computing and Data Services team at quest-help@northwestern.edu. The pilot environment will consist of 24 H100 GPU nodes and seventy-two CPU nodes, and it will expand with additional nodes through March 2025. Details on how to access this pilot environment will be published in a KB article on November 18.

This document provides an overview of how Globus works and how to use Globus to transfer files.

Overview

Transferring and sharing files is a major bottleneck in data workflows. The Globus service allows users to automate file transfer between data storage and compute systems as well as share data with any other Globus user quickly and securely. The Globus web interface allows users to easily initiate and schedule file transfers in a point and click interface. 

Once a file transfer begins, Globus handles the rest:

  • Globus maximizes use of your network bandwidth to prevent connectivity problems.
  • If you lose network connection, Globus will continue where you left off.
  • When your file transfer is complete, Globus checks for data integrity and will notify you of any problems.
  • If your file transfer fails, Globus will restart the transfer automatically.

This document describes how to use Globus to transfer and share data using Northwestern University's subscription. 

Restrictions

Globus should not be used to transfer legally and contractually restricted data, such as data subject to HIPAA and FISMA.

Endpoints and Collections

Globus refers to the places that data are stored (such as your computer, Quest, RDSS, the cloud) as endpoints. Data stored on these endpoints are organized in collections. 

See Globus Endpoints and Collections for more information on the endpoints and collections you can use with Globus.

Transferring data

Once your endpoints are configured, you can use Globus to initiate file transfers between these endpoints.

See Transferring files using Globus for instructions on how to transfer files using Globus. 

Advanced features

You can do much more with Globus than transfer data. See the following sections for more information on Sharing data and automating data workfows using Globus timer and Globus's command line interface. 

See Advanced Globus Features for more information.

Need Help?

The following Globus resources are available to you:

At Northwestern

Contact Northwestern data management specialists by emailing globus-help@northwestern.edu

Also see our Research Data Management Guide for quick links to our help documentation. 

From Globus

Research Data Management Support at Northwestern University

Research computing data services partners with the Office for Research, University Libraries and Galter Health Sciences Library to provide research data management support throughout the research process. Please see the Research Data Management and Sharing page for more information

Was this helpful?
0 reviews
Print Article

Related Articles (9)

An outline of advanced features available for Globus
How to identify the full path of your RDSS/FSMResfiles share to set up access to the RDSS Globus endpoint.
How to initiate file transfers using the Globus data transfer tool
How to use the Globus timer feature to automate and schedule data transfers
How to use Globus to transfer data to/from Amazon S3 storage
How to transfer data to/from OneDrive and SharePoint using Globus
How to set up and use the Quest Globus endpoint
How to transfer data between RDSS/FSMResfiles and Quest using Globus