Using Globus with Amazon S3 storage

The Globus data transfer service can be used to transfer data to and from Amazon's S3 cloud storage service. For more information on why and how to use Amazon S3 storage, see Using Amazon S3 Storage

Setup

To use Globus with Amazon S3, you need to: create a bucket (if you don't have one already), create an IAM access key with permission to write to the bucket, and install the access key on the endpoint.

  1. Create an Amazon S3 bucket
  2. Create an AWS IAM access key that has permission to read from and write to the bucket
  3. Give Globus access to the bucket via the IAM access key you created (see below).

Authenticate in the Globus interface

Once you have an AWS Access Key ID, you can use these credentials to authenticate in the Globus interface. 

  1. First, log into Globus File Manager using your Northwestern NetID
  2. Then search for the Northwestern AWS endpoints. 

    Northwestern has 3 endpoints to transfer data to Amazon Web Service S3 storage.

    These endpoints are now region-agnostic and can be used to transfer data stored in any AWS region. 

  • Northwestern AWS us-east-1 N. Virginia
  • Northwestern AWS us-east-2 Ohio
  • Northwestern AWS us-west-2 Oregon
  1. Once you have selected an endpoint, follow the instructions in Globus's How to Access Your Files on AWS S3 with Globus documentation.

Need help?

Email globus-help@northwestern.edu for additional support in setting up Globus with Amazon S3.

Also see our Research Data Management Guide for links to all of our help articles.

Research Data Management Support at Northwestern University

Research computing data services partners with the Office for Research, University Libraries and Galter Health Sciences Library to provide research data management support throughout the research process. Please see the Research Data Management and Sharing page for more information

Was this helpful?
0 reviews

Details

Article ID: 1968
Created
Thu 10/6/22 2:33 PM
Modified
Fri 4/12/24 11:15 AM

Related Articles (7)

An outline of advanced features available for Globus
How to initiate file transfers using the Globus data transfer tool
Overview of how to use Globus with links to how to articles.

Related Services / Offerings (2)

Northwestern faculty, staff, and researchers can request a new public cloud account.
Northwestern has agreements with Amazon Web Services, Google, and Microsoft Azure, to provide discounted cloud hosting options for Northwestern faculty and staff.