Using Globus
All RCC storage systems are configured as Globus endpoints to facilitate the transfer of data. As an alternative to SFTP, Globus is a more fully-featured and reliable tool for transferring large datasets.
Globus can be used in a number of different ways:
- Transfer large amounts of data between RCC storage systems (e.g. Archival to HPC/GPFS or vice versa)
- Transfer large amounts of data from RCC storage systems to a personal computer with Globus Connect Personal
- Transfer large amounts of data between RCC storage systems and storage systems at other institutions.
- Publish and curate data sets with Globus Data Publication
- Set up automated transfers using the Globus CLI utility or your own application/script using the Globus APIs
RCC Endpoints Reference#
Important Note
As of June 20, 2024, the fsurcc#archival#1
and fsurcc#archival#2
endpoints have been replaced by the
new fsurcc#archival
endpoint.
Storage System | Globus Endpoint Name |
---|---|
Research Archival Storage | fsurcc#archival |
GPFS: Home Directories | fsurcc#GPFS#home |
GPFS: Research Directories | fsurcc#GPFS#research |
Setting up a Globus account and endpoint#
Before you can transfer data to our from an RCC storage system, you must activate your Globus account and create a Globus Connect Personal endpoint.
- Visit https://globus.org and click the "Log In" button.
- Link your RCC user account to your Globus identity
- Browse to the "File Manager" page in the left-hand navigation bar.
- Enter
fsurcc#GPFS#home
in the Collection box. - You will see a banner that says "Authentication Required". Click the Continue button.
- You will see another page appear with the heading "Identity Required". Click the "FSU RCC OpenID Connect Server (oidc.rcc.fsu.edu)"
- An FSU branded login page will appear. Enter your RCC User Account username and password, and click the "Log In" button.
- Click on the new identity in the list to link your RCC user account to your Globus login. You may be prompted to enter your credentials again, and then you will be taken back to the File Manager screen.
- Download the Globus Connect Personal client. Globus Connect Personal is available for Windows, Mac, and Linux.
- Install the client on your computer
First time setup of Globus connect personal#
There are some steps that you will need to complete the first time you set up Globus Connect Personal (GCP).
- Open GCP on your computer, and click the Log In button. This will open a browser window.
- On the webpage that appears, verify the permissions are okay, and provide a label. Click the Allow button.
- Return to the Globus Connect Personal application on your computer and create a collection.
- The GCP window should show as Connected now.
- You can also refer to the Collections page on the Globus website to ensure that it is indeed online and ready.
Transferring data#
- Start the Globus Connect Personal (GCP) client, and click the Connect button.
- Login to the Globus website, and browse to the "File Manager" page.
- Click the multi-panel button in the upper right hand corner to toggle the two-panel view in the File Manager.
- On either the right or left panes, click the Search bar, and select the Your Collections tab. You should see your GCP client listed.
- You will now see a file listing of the contents of your Collection in the File Manager page.
- Click on the other pane, and then type the name of an RCC Endpoint. In the below example,
we'll use the
fsurcc#GPFS#home
endpoint. - Browse to and select the data you want to transfer, and then click the Start button to initiate the transfer. You will see an indicator that the transfer request was submitted.
- Your files will now be queued for transfer. You can monitor the progress of your transfer by browsing to the Activity tab in the left-hand navigation bar.
- When the transfer is complete, you will receive an email at your FSU email address indicating the status. That message will include a link to view a detailed report.
Transferring data between Globus and Microsoft OneDrive/SharePoint#
- Log into both your personal SharePoint and the shared department SharePoint you want to transfer data to or from.
- NOTE: You only have to log into your personal SharePoint if you want to transfer data to or from that.
- Locate the folder that you want to move data into or from.
- Click Share on the destination folder and enter your FSUID.
- Log into Globus, and navigate to the File Management interface.
- On one side of the split-pane File Management window, connect to the RCC endpoint that you want data moved to or from.
- On the other side of the split-pane window, connect to the endpoint:
fsurcc#OneDrive#MyFiles
.- Click "Up One Folder"
- Click "Shared"
- The folder you shared with yourself from the shared SharePoint/OneDrive in step 3 should be visible.
- Click on that shared folder.
- You are now ready to transfer data to or from OneDrive/SharePoint.
Checking your OneDrive storage quota#
FSU Faculty, students, and staff are granted free storage in OneDrive (the quota is currently 5TB). To check how much storage space you have used, do the following:
- Login to https://onedrive.microsoft.com using your FSU Microsoft Account.
- On the directory listing page, click the Settings âš™ icon.
- In the Settings drop-down menu, select OneDrive Settings > More Settings > Storage Metrics. The space used and total storage are in the upper right corner.
Sharing with outside research groups#
You can share data stored on RCC storage systems (HPC and Archival volumes) with research groups at other institutions using Globus.
Follow the instructions in the "How to Share Data using Globus" tutorial on the Globus website.
Globus command line interface (CLI)#
Globus provides a cross-platform CLI utility for initiating transfers and managing endpoints from the command line. This is especially useful for scripts and unattended, automated, and/or recurring transfers. Refer to the Globus CLI documentation for usage instructions.
Globus APIs#
Globus provides both HTTP and Python APIs for integrating Globus tasks into your own applications and scripts. See the Globus APIs documentation for more information.
Getting help#
If you need any help with Globus, refer to the documentation on the Globus website or request help from RCC staff.