Globus - Moving data to Research Object Storage (S3) from ResearchDrive

Request a ResearchDrive Globus collection

If you have not already requested a Globus Collection for your ResearchDrive account, please request one by emailing researchdrive@wisc.edu.  This is a required step.

Access Globus with your UW-Madison Login

1. Go to https://app.globus.org.

2. Select University of Wisconsin–Madison from the organization list.

3. Sign in using your NetID and password.

4. Complete MFA if prompted.

5. Once signed in, you will land on the Globus File Manager.

Give Globus permission to access your Research Object Storage (S3)

Before you make your first transfer, you must give Globus permission to access your Research Object Storage (S3) account. 

Please note, the Research Object Storage (S3) Globus collection is a temporary collection that will eventually be replaced by a permanent collection.  We discourage building extensive automation around this collection.

1. In the left navigation, open Collections.

2. Deselect Recent Tasks (if selected)

3. Search for “wisc-s3-container-mode”.

4. Select the collection.

5. Select the Credentials tab.

6. Click the Add a Credential button.

7. Enter your access key and secret key for your Research Object Storage (S3) in the box asking for your AWS IAM key/secret.  This information was sent to you via email upon account creation.
   
   
8. Click Save. You should now see your Research Object Storage (S3) access key listed under the “Credentials” tab. 

Note:  you only need to complete this setup once. 

Setup the data transfer

Access your ResearchDrive collection

1. In the left navigation, open File Manager.

2. In the File Manager, make sure you have "Two panes" selected in the Panels options.

3. Click the left pane.

4. Search for wisc-researchdrive-<netid>.  Please replace "netid" with your netid.  Ex:  wisc-researchdrive-bbadger

5. Select the collection.

6. Authenticate using your university login if prompted.

7. Navigate to the specific folder you want to transfer from.

Access your Research Object Storage collection

1. Click the right pane.

2. Search for wisc-s3-container-mode.  

3. Select the collection.

4. Authenticate using your university login if prompted.

5. Select the bucket you wish to transfer to.  In most situations, we recommend you use the default bucket named "<netid>-bucket-01" (ex:  bbadger-bucket-01)

6. If you wish, navigate to the specific folder you want to transfer to.

Optional: open the Transfer & Timer Options menu and check the box labeled Skip files on source with errors.  With this selected, files on source with "file not found" and "permission denied" errors will be skipped rather than cause the transfer to fail.  Globus will document any skipped files in the Activity tab for your review.

Start the data transfer

1. Make sure you have selected the files or folders you want to transfer on the left pane as well as the location you want to transfer to on the right pane.

2. In the left ResearchDrive pane, click the blue Start button.

3. Globus will queue the transfer and run it in the background. You can close your browser if you like—Globus will continue the job.

Note:  very large transfers could take hours or even days to complete.  You may check the transfer's status in the status under the Activity menu item.

Monitor the transfer

• In the left navigation, open the Activity tab.

• Select the transfer you wish to monitor.

• View the status and other details of your transfer.  Make note of the "Event log" sub tab, where you can view more details.

• You will also receive email notifications when the transfer completes.