This is a custom Confluence template that is intended to be re-used in the creation of workshops presented by ARCC on the Wiki. All of the content in these sections is intended to be replaced by the author of the workshop. The first step in this style guide is to ensure that the the page is in wide mode to maximize the real estate for content when possible. The Title of the Page should be the same as the Title of the workshop and this section should include a quick intro to the topic, why it’s important for ARCC users, and what users should expect to get out of this workshop. Next should be a Table of Contents macro in vertical format. The Table is intended to be used as an agenda section for presenter mode as well as navigation for non-presenting viewing so that users can find the documentation and navigate to what they need to brush up on. Finally, at the end of each section, there should be a divider to indicate the separation of “slides”section of the workshop expands upon the previous section on Basic Globus transfers. It is still an introductory level of content, but may not apply to all use cases.
Discussed in this section are the transfer options in Globus, sharing data with others, and then briefly touch on the Globus CLI and flows functionality.
...
| Table of Contents | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Headers and Sections
...
Code Examples
Two Column Tables are nice ways to separate content/ Background info along with a code example on the same “Slide”. Please notice the table width. This should stop scroll bars from appearing
...
Bullets are nice to include for distinct points
...
yep
...
they
...
sure
...
| Code Block |
|---|
Please use the "code snippet" in the + button when creating code examples. Also please do not go
past the width of the table. This is to prevent scroll bars appearing
This is the Max number of code lines to show on an example |
...
Straight Code - No context
| Code Block |
|---|
Limit to 16 lines in the example.
This is the end |
Same Thing With Images
...
Two Column Tables are nice ways to separate content/ Background info along with an image example on the same “Slide”. Please notice the table width. This should stop scroll bars from appearing
Bullets are nice to include for distinct points
yep
they
sure
are
This is 14 lines
Alternatively No Table
Finally The End
...
Link to Previous sub-module or Home Module
...
Globus Transfer Options
Beyond simply transferring data, Globus enables users optional features that enhance the functionality of data transfers. Here are a few that ARCC frequently uses:
Label - Because Globus keeps a record of each transfer along with the stats bout them, it can be hard to determine which transfer is which based solely on the transfer ID and date. Giving a transfer a human-readable label can help users keep track of each transfer.
Sync - to only transfer new or changed files. Selecting this option gives the ability to choose how files will be overwritten on the destination file system. The options for syncing can be where the modification time of a file is newer, the file size is different, the file on the source does not exist on the destination, or where the checksum is different. When using this option, ARCC recommends using the checksum option, to cover a vareity of scenarios
Preserve source file modification times - After transfer of a file, the modification time on the destination will reflect the modification time on the source instead of the time the transfer completed.
...
Transfer Option Example
In this example we expand the ‘Transfer and Timer Options’ window to provide a demonstration transfer that has a label, syncing, and preserving the file modification time. Notice that there are many more options that can be used as well including:
|
|
...
Notification and Scheduling Options
At the bottom of the same Transfer and Timer Options window, there are options to disable notifications of transfers as well as scheduling transfers that may or may not repeat |
|
...
Sharing with Globus
Sharing with guest collections is available on Globus endpoints managed by an active Subscription. You can create guest collections on Globus endpoints if you are a member of a Subscription Group.
|
|
...
The Globus CLI
Globus does have a command line interface (CLI) that can be used within HPC workflows as well. ARCC does not have this installed by default, but a user can install it using the miniconda module on MedicineBow.
|
|
...
Globus Flows
Globus flows enables the automation of data transfers. ARCC is still investigating how this works, but generally speaking, you have to have access to each endpoint you are wanting to transfer to and from and then do three things to deploy a Flow:
|
|
...
Next Steps
Previous | Workshop Home | Next |