Skip to content

Using Globus

All RCC storage systems are configured as Globus endpoints to facilitate the transfer of data. As an alternative to SFTP, Globus is a more fully-featured and reliable tool for transferring large datasets.

Globus can be used in a number of different ways:

  • Transfer large amounts of data between RCC storage systems (e.g. Archival to HPC/GPFS or vice versa)
  • Transfer large amounts of data from RCC storage systems to a personal computer with Globus Connect Personal
  • Transfer large amounts of data between RCC storage systems and storage systems at other institutions.
  • Publish and curate data sets with Globus Data Publication
  • Set up automated transfers using the Globus CLI utility or your own application/script using the Globus APIs

RCC Endpoints Reference#

Important Note

As of November 9, 2023, we are currently transitioning the backend for our Archival Storage system. Users who previously connected to fsurcc#archival#2 will now instead use fsurcc#archival.

The new storage system will be unified, and all archival volumes will be on the same filesystem in early 2024. We will notify individual groups as we proceed.

Storage System Globus Endpoint Name
Research Archival Storage 1 fsurcc#archival#1
Research Archival Storage 2 fsurcc#archival
GPFS: Home Directories fsurcc#GPFS#home
GPFS: Research Directories fsurcc#GPFS#research

Setting up a Globus account and endpoint#

Before you can transfer data to our from an RCC storage system, you must activate your Globus account and create a Globus Connect Personal endpoint.

  1. Visit https://globus.org and click the "Log In" button.
    1. Select Florida State University from the dropdown menu, and click the Continue button. Select "Florida State University" from the dropdown menu, and click the "Continue" button.
    2. Follow the prompts to finish activating your Globus account.
  2. Link your RCC user account to your Globus identity
    1. Browse to the "File Manager" page in the left-hand navigation bar.
    2. Enter fsurcc#GPFS#home in the Collection box.
    3. You will see a banner that says "Authentication Required". Click the Continue button. Enter fsurcc#GPFS#home in the _Collection_ box. You will see a banner that says "Authentication Required". Click the _Continue_ button.
    4. You will see another page appear with the heading "Identity Required". Click the "FSU RCC OpenID Connect Server (oidc.rcc.fsu.edu)" You will see another page appear with the heading "Identity Required". Click the "FSU RCC OpenID Connect Server"
    5. An FSU branded login page will appear. Enter your RCC User Account username and password, and click the "Log In" button. An FSU branded login page will appear. Enter your RCC User Account username and password, and click the "Log In" button
    6. Click on the new identity in the list to link your RCC user account to your Globus login. You may be prompted to enter your credentials again, and then you will be taken back to the File Manager screen. Click on the new identity in the list to link your RCC user account to your Globus login
  3. Download the Globus Connect Personal client. Globus Connect Personal is available for Windows, Mac, and Linux. Download the GCP app (note: click on the "Show me other supported operating systems" for Mac or Linux)
  4. Install the client on your computer

First time setup of Globus connect personal#

There are some steps that you will need to complete the first time you set up Globus Connect Personal (GCP).

  1. Open GCP on your computer, and click the Log In button. This will open a browser window. Open GCP on your computer, and click the "Log In" button. This will open a browser window.
  2. On the webpage that appears, verify the permissions are okay, and provide a label. Click the Allow button. On the webpage that appears, verify the permissions are okay, and provide a label. Click the "Allow" button.
  3. Return to the Globus Connect Personal application on your computer and create a collection.
    1. Ensure the Owner identity field matches YOUR-FSUID@fsu.edu.
    2. Create a collection name (we recommend all lower-case and no spaces). You can enter whatever you like in the description field.
    3. Leave the High Assurance box unchecked.
    4. Click the Save button. Ensure the "Owner Identity" field matches your FSUID (@fsu.edu) and fill out the other fields as indicated.
  4. The GCP window should show as Connected now.
    The GCP window should show as "Connected" now.
  5. You can also refer to the Collections page on the Globus website to ensure that it is indeed online and ready.

Transferring data#

  1. Start the Globus Connect Personal (GCP) client, and click the Connect button. Start the Globus Connect Personal (GCP) client, and click the "Connect" button
  2. Login to the Globus website, and browse to the "File Manager" page. Login to the Globus website, and browse to the "File Manager" page
  3. Click the multi-panel button in the upper right hand corner to toggle the two-panel view in the File Manager. Click the multi-panel button in the upper right hand corner to toggle the two-panel view in the File Manager
  4. On either the right or left panes, click the Search bar, and select the Your Collections tab. You should see your GCP client listed. On either the right or left panes, click the _Search_ bar, and select the _Your Collections_ tab. You should see your GCP client listed
  5. You will now see a file listing of the contents of your Collection in the File Manager page. You will now see a file listing of the contents of your Collection in the File Manager page
  6. Click on the other pane, and then type the name of an RCC Endpoint. In the below example, we'll use the fsurcc#GPFS#home endpoint. Click on the other pane, and then type the name of an RCC Endpoint
  7. Browse to and select the data you want to transfer, and then click the Start button to initiate the transfer. You will see an indicator that the transfer request was submitted. Browse to and select the data you want to transfer, and then click the "Start" button to initiate the transfer
  8. Your files will now be queued for transfer. You can monitor the progress of your transfer by browsing to the Activity tab in the left-hand navigation bar.
  9. When the transfer is complete, you will receive an email at your FSU email address indicating the status. That message will include a link to view a detailed report.

Transferring data between Globus and Microsoft OneDrive/SharePoint#

  1. Log into both your personal SharePoint and the shared department SharePoint you want to transfer data to or from.
    1. NOTE: You only have to log into your personal SharePoint if you want to transfer data to or from that.
  2. Locate the folder that you want to move data into or from.
  3. Click Share on the destination folder and enter your FSUID.
  4. Log into Globus, and navigate to the File Management interface.
  5. On one side of the split-pane File Management window, connect to the RCC endpoint that you want data moved to or from.
  6. On the other side of the split-pane window, connect to the endpoint: fsurcc#OneDrive#MyFiles.
    1. Click "Up One Folder"
    2. Click "Shared"
    3. The folder you shared with yourself from the shared SharePoint/OneDrive in step 3 should be visible.
    4. Click on that shared folder.
  7. You are now ready to transfer data to or from OneDrive/SharePoint.

Checking your OneDrive storage quota#

FSU Faculty, students, and staff are granted free storage in OneDrive (the quota is currently 5TB). To check how much storage space you have used, do the following:

  1. Login to https://onedrive.microsoft.com using your FSU Microsoft Account.
  2. On the directory listing page, click the Settings âš™ icon.
  3. In the Settings drop-down menu, select OneDrive Settings > More Settings > Storage Metrics. The space used and total storage are in the upper right corner.

Sharing with outside research groups#

You can share data stored on RCC storage systems (HPC and Archival volumes) with research groups at other institutions using Globus.

Follow the instructions in the "How to Share Data using Globus" tutorial on the Globus website.

Globus command line interface (CLI)#

Globus provides a cross-platform CLI utility for initiating transfers and managing endpoints from the command line. This is especially useful for scripts and unattended, automated, and/or recurring transfers. Refer to the Globus CLI documentation for usage instructions.

Globus APIs#

Globus provides both HTTP and Python APIs for integrating Globus tasks into your own applications and scripts. See the Globus APIs documentation for more information.

Getting help#

If you need any help with Globus, refer to the documentation on the Globus website or request help from RCC staff.