Tour of an ARCC HPC

Goals: Walk through accessing an ARCC HPC and navigating directories

If users have attended previous workshops, this will be review.


Opening Screen:

  • Shows message of the day

  • Lists storage usage - across project spaces

    • You can see this again by calling: arccquota

    • Also shows directories specific to arcc HPCs

General Format:[<username>@<server/node-name> <folder>]$ [arcc-t30@mblog2 ~]$ arccquota +----------------------------------------------------------------------+ | arccquota | Block | +----------------------------------------------------------------------+ | Path | Used Limit % | +----------------------------------------------------------------------+ | /home/arcc-t30 | 00.00 GB 50.00 GB 00.00 | | /gscratch/arcc-t30 | 00.00 GB 05.00 TB 00.00 | | /project/arccanetrain | 00.00 GB 05.00 TB 00.00 | | | +----------------------------------------------------------------------+ [arcc-t30@mblog1 ~]$

ARCC HPC: FileSystem 

Type

Location

Description

Notes

home

/home/<username>

Personal storage space associated with user’s account. For configuration files and smaller software installations.

Smaller allocation

project

/project/<project-name>/

Space to collaborate among project members. Data here is persistent and is exempt from purge policy. 

All project members have read/write at this level.

project-user

/project/<project-name>/[username]

Storage specific to username within project space. Project members can read but only you may write.

 

project-software

/project/<project-name>/software

Storage space to install software to be shared among project group members.

Only on MedicineBow

gscratch

/gscratch/<username>

Scratch space to perform computing for individual users.

Data here is subject to a purge policy.

node local scratch

/lscratch

Only on compute.

 

memory filesystem

/dev/shm

RAM-based tmpfs available as part of RAM for very rapid I/O operations; small capacity.

 

See here for information about directory quotas


Home, Project, and Gscratch Folders:

# Home folder: []$ cd ~ []$ pwd /home/arcc-t05 []$ cd /gscratch/arcc-t05 # Shared project space []$ cd /project/arccanetrain/ [arcc-t05@blog1 arccanetrain]$ ls arcc-t01 arcc-t06 arcc-t11 arcc-t16 arcc-t21 arcc-t26 brewer salexan5 arcc-t02 arcc-t07 arcc-t12 arcc-t17 arcc-t22 arcc-t27 excotest arcc-t03 arcc-t08 arcc-t13 arcc-t18 arcc-t23 arcc-t28 intro_to_hpc arcc-t04 arcc-t09 arcc-t14 arcc-t19 arcc-t24 arcc-t29 lreilly arcc-t05 arcc-t10 arcc-t15 arcc-t20 arcc-t25 arcc-t30 mkillean

Copy files:

[]$ cd [~]$ cp -r /project/arccanetrain/intro_to_hpc/ . [~]$ cd intro_to_hpc/ [intro_to_hpc]$ ls Intro_to_hpc.pdf python01.py python01.py.fixed run_gpu.sh run.sh

Next Steps

Use the following link to provide feedback on this training: https://forms.gle/qQ8b7SxGJbo2U6y98 or use the QR code below.

Intro to HPC Access.png