Tour of an ARCC HPC
Goals: Walk through accessing an ARCC HPC and navigating directories
If users have attended previous workshops, this will be review.
Opening Screen:
Shows message of the day
Lists storage usage - across project spaces
You can see this again by calling: arccquota
Also shows directories specific to arcc HPCs
General Format:[<username>@<server/node-name> <folder>]$
[arcc-t30@mblog2 ~]$ arccquota
+----------------------------------------------------------------------+
| arccquota | Block |
+----------------------------------------------------------------------+
| Path | Used Limit % |
+----------------------------------------------------------------------+
| /home/arcc-t30 | 00.00 GB 50.00 GB 00.00 |
| /gscratch/arcc-t30 | 00.00 GB 05.00 TB 00.00 |
| /project/arccanetrain | 00.00 GB 05.00 TB 00.00 |
| |
+----------------------------------------------------------------------+
[arcc-t30@mblog1 ~]$
ARCC HPC: FileSystem
Type | Location | Description | Notes |
home | /home/<username> | Personal storage space associated with user’s account. For configuration files and smaller software installations. | Smaller allocation |
project | /project/<project-name>/ | Space to collaborate among project members. Data here is persistent and is exempt from purge policy. | All project members have read/write at this level. |
project-user | /project/<project-name>/[username] | Storage specific to username within project space. Project members can read but only you may write. |
|
project-software | /project/<project-name>/software | Storage space to install software to be shared among project group members. | Only on MedicineBow |
gscratch | /gscratch/<username> | Scratch space to perform computing for individual users. | Data here is subject to a purge policy. |
node local scratch | /lscratch | Only on compute. |
|
memory filesystem | /dev/shm | RAM-based tmpfs available as part of RAM for very rapid I/O operations; small capacity. |
|
See here for information about directory quotas
Home, Project, and Gscratch Folders:
# Home folder:
[]$ cd ~
[]$ pwd
/home/arcc-t05
[]$ cd /gscratch/arcc-t05
# Shared project space
[]$ cd /project/arccanetrain/
[arcc-t05@blog1 arccanetrain]$ ls
arcc-t01 arcc-t06 arcc-t11 arcc-t16 arcc-t21 arcc-t26 brewer salexan5
arcc-t02 arcc-t07 arcc-t12 arcc-t17 arcc-t22 arcc-t27 excotest
arcc-t03 arcc-t08 arcc-t13 arcc-t18 arcc-t23 arcc-t28 intro_to_hpc
arcc-t04 arcc-t09 arcc-t14 arcc-t19 arcc-t24 arcc-t29 lreilly
arcc-t05 arcc-t10 arcc-t15 arcc-t20 arcc-t25 arcc-t30 mkillean
Copy files:
[]$ cd
[~]$ cp -r /project/arccanetrain/intro_to_hpc/ .
[~]$ cd intro_to_hpc/
[intro_to_hpc]$ ls
Intro_to_hpc.pdf python01.py python01.py.fixed run_gpu.sh run.sh
Next Steps
Previous | Workshop Home |
Use the following link to provide feedback on this training: https://forms.gle/qQ8b7SxGJbo2U6y98 or use the QR code below.