Goals: Walk through accessing an ARCC HPC and navigating directories
If users have attended previous workshops, this will be review.
Opening Screen:
Shows message of the day
Lists storage usage - across project spaces
You can see this again by calling: arccquota
Also shows directories specific to arcc HPCs
General Format:[<username>@<server/node-name> <folder>]$ [arcc-t30@mblog2 ~]$ arccquota +----------------------------------------------------------------------+ | arccquota | Block | +----------------------------------------------------------------------+ | Path | Used Limit % | +----------------------------------------------------------------------+ | /home/arcc-t30 | 00.00 GB 50.00 GB 00.00 | | /gscratch/arcc-t30 | 00.00 GB 05.00 TB 00.00 | | /project/arccanetrain | 00.00 GB 05.00 TB 00.00 | | | +----------------------------------------------------------------------+ [arcc-t30@mblog1 ~]$
ARCC HPC: FileSystem
Type | Location | Description | Notes |
home | /home/<username> | Personal storage space associated with user’s account. For configuration files and smaller software installations. | Smaller allocation |
project | /project/<project-name>/ | Space to collaborate among project members. Data here is persistent and is exempt from purge policy. | All project members have read/write at this level. |
project-user | /project/<project-name>/[username] | Storage specific to username within project space. Project members can read but only you may write. | |
project-software | /project/<project-name>/software | Storage space to install software to be shared among project group members. | Only on MedicineBow |
gscratch | /gscratch/<username> | Scratch space to perform computing for individual users. | Data here is subject to a purge policy. |
node local scratch | /lscratch | Only on compute. | |
memory filesystem | /dev/shm | RAM-based tmpfs available as part of RAM for very rapid I/O operations; small capacity. |
See here for information about directory quotas
Home, Project, and Gscratch Folders:
# Home folder: []$ cd ~ []$ pwd /home/arcc-t05 []$ cd /gscratch/arcc-t05 # Shared project space []$ cd /project/arccanetrain/ [arcc-t05@blog1 arccanetrain]$ ls arcc-t01 arcc-t06 arcc-t11 arcc-t16 arcc-t21 arcc-t26 brewer salexan5 arcc-t02 arcc-t07 arcc-t12 arcc-t17 arcc-t22 arcc-t27 excotest arcc-t03 arcc-t08 arcc-t13 arcc-t18 arcc-t23 arcc-t28 intro_to_hpc arcc-t04 arcc-t09 arcc-t14 arcc-t19 arcc-t24 arcc-t29 lreilly arcc-t05 arcc-t10 arcc-t15 arcc-t20 arcc-t25 arcc-t30 mkillean
Copy files:
[]$ cd [~]$ cp -r /project/arccanetrain/intro_to_hpc/ . [~]$ cd intro_to_hpc/ [intro_to_hpc]$ ls Intro_to_hpc.pdf python01.py python01.py.fixed run_gpu.sh run.sh
Next Steps
Previous | Workshop Home |