All RCC storage systems are configured as Globus endpoints to facilitate the transfer of data. As an alternative to SFTP, Globus is a more fully-featured and reliable tool for transferring large datasets.
Globus can be used in a number of different ways:
- Transfer large amounts of data between RCC storage systems (e.g. Archival to HPC/GPFS or vice versa)
- Transfer large amounts of data from RCC storage systems to a personal computer with Globus Connect Personal
- Transfer large amounts of data between RCC storage systems and storage systems at other institutions.
- Publish and curate data sets with Globus Data Publication
- Set up automated transfers using the Globus CLI utility or your own application/script using the Globus APIs
RCC Endpoints Reference#
|Storage System||Globus Endpoint Name|
|Research Archival Storage||
|Research Archival Storage (2)||
|GPFS: Home Directories||
|GPFS: Research Directories||
Setting up a Globus account and endpoint#
Before you can transfer data to our from an RCC storage system, you must activate your Globus account and create a Globus Connect Personal endpoint.
- Visit https://globus.org and click the "Log In" button.
- Download the Globus Connect Personal client. Globus Connect Personal is available for Windows, Mac, and Linux.
- Install the client on your computer
First time setup of Globus connect personal#
There are some steps that you will need to complete the first time you set up Globus Connect Personal (GCP).
- Open GCP on your computer, and click the Log In button. This will open a browser window.
- On the webpage that appears, verify the permissions are okay, and provide a label. Click the Allow button.
- Return to the Globus Connect Personal application on your computer and create a collection.
- The GCP window should show as Connected now.
- You can also refer to the Collections page on the Globus website to ensure that it is indeed online and ready.
- Start the Globus Connect Personal (GCP) client, and click the Connect button.
- Login to the Globus website, and browse to the "File Manager" page.
- On either the right or left panes, click the Search bar, and select the Your Collections tab. You should see your GCP client listed.
- You will now see a file listing of the contents of your Collection in the File Manager page.
- Click on the other pane, and then type the name of an RCC Endpoint. In the below example,
we'll use the
- Enter your RCC user credentials in the authentication dialog that appears within the pane.
- Browse to and select the data you want to transfer, and then click the Start button to initiate the transfer. You will see an indicator that the transfer request was submitted.
- Your files will now be queued for transfer. You can monitor the progress of your transfer by browsing to the Activity tab in the left-hand navigation bar.
- When the transfer is complete, you will receive an email at your FSU email address indicating the status. That message will include a link to view a detailed report.
Globus command line interface (CLI)#
Globus provides a cross-platform CLI utility for initiating transfers and managing endpoints from the command line. This is especially useful for scripts and unattended, automated, and/or recurring transfers. Refer to the Globus CLI documentation for usage instructions.
Globus provides both HTTP and Python APIs for integrating Globus tasks into your own applications and scripts. See the Globus APIs documentation for more information.