¶ Globus Connect - Fast transfer data
¶ Preview
Globus Connect is a data transfer service that enables seamless, secure, and high-speed file sharing across distributed computing resources. It facilitates efficient data transfer between your cluster and external storage systems, streamlining workflows and enhancing collaboration. With Globus Connect, users can easily transfer, share, and manage large datasets, optimizing data access and accelerating research processes on your cluster.
Globus offers faster, more reliable, and user-friendly data transfers compared to alternatives like SSH (FTP), with features such as parallelism and automatic error recovery. Its centralized management simplifies complex workflows and enhances collaboration, making it a superior choice for large-scale, distributed data movement.
¶ Logging in
Browse to https://www.globus.org/
Click ‘Log in’ in the top right corner.
Enter ‘IUCC’ (Inter-University Computation Center - known as MACHB”A) In the option of using existing organizational login.
Select ‘HUJI’ in the identity provider
Enter your details
Then you should get a globus web interface
¶ Download and install client
Globus supports Windows, Mac and Linux operating systems.
Download Globus connect client from here.
Choose your operating system version:
This guide refers to windows but there is also Linux & Mac installation guides
Linux - https://docs.globus.org/globus-connect-personal/install/linux/
Mac - https://docs.globus.org/globus-connect-personal/install/mac/
Launch the application installer
Notice that if you do not have a local administrator permissions you will get an error
If you are getting this error choose a path that you have read/write permissions.
After the installation is done click ‘Log in’
Grant the required consents to GCP Setup.
Enter the details for your Collection
And ‘Save’
Now if you will go back to the web interface
(You can also right click on globus connect on the bottom right icons [Windows version only] )
Or login from the web.
You will have on ‘Your Collections’
The Collection you set up earlier
¶ Transfer files
Click on ‘Transfer or Sync to’
Choose ‘CSE HUJI RCS Labs’ OR ’HUJI RCS’ in the second collection and press ‘Continue’
Press on the link below
Enter your ‘hurcs’ credentials.
And press ‘Allow’ to grant permission to globus
Then you can transfer files between the collections
¶ Add permissions to local Collection:
When you first install Globus Connect, it allows transfers from a designated location on your computer by default. This location might be your home directory or a specific folder depending on your system.
To transfer files from other locations on your computer, you'll need to define those additional folders within Globus Connect. This process lets you control which parts of your computer's storage are accessible for file transfers through Globus Connect.
Open ‘options’ on your local globus app
Add directory:
Globus stands out for its extensive documentation, featuring a wealth of options and guides, and also provides helpful video tutorials for users.
Globus documentation :