/
Tour of an ARCC HPC

Tour of an ARCC HPC

Goals: Walk through accessing an ARCC HPC and navigating directories

If users have attended previous workshops, this will be review.


Opening Screen:

  • Shows message of the day

  • Lists storage usage - across project spaces

    • You can see this again by calling: arccquota

    • Also shows directories specific to arcc HPCs

General Format:[<username>@<server/node-name> <folder>]$ [arcc-t30@mblog2 ~]$ arccquota +----------------------------------------------------------------------+ | arccquota | Block | +----------------------------------------------------------------------+ | Path | Used Limit % | +----------------------------------------------------------------------+ | /home/arcc-t30 | 00.00 GB 50.00 GB 00.00 | | /gscratch/arcc-t30 | 00.00 GB 05.00 TB 00.00 | | /project/arccanetrain | 00.00 GB 05.00 TB 00.00 | | | +----------------------------------------------------------------------+ [arcc-t30@mblog1 ~]$

ARCC HPC: FileSystem 

Type

Location

Description

Notes

home

/home/<username>

Personal storage space associated with user’s account. For configuration files and smaller software installations.

Smaller allocation

project

/project/<project-name>/

Space to collaborate among project members. Data here is persistent and is exempt from purge policy. 

All project members have read/write at this level.

project-user

/project/<project-name>/[username]

Storage specific to username within project space. Project members can read but only you may write.

 

project-software

/project/<project-name>/software

Storage space to install software to be shared among project group members.

Only on MedicineBow

gscratch

/gscratch/<username>

Scratch space to perform computing for individual users.

Data here is subject to a purge policy.

node local scratch

/lscratch

Only on compute.

 

memory filesystem

/dev/shm

RAM-based tmpfs available as part of RAM for very rapid I/O operations; small capacity.

 

See here for information about directory quotas


Home, Project, and Gscratch Folders:

# Home folder: []$ cd ~ []$ pwd /home/arcc-t05 []$ cd /gscratch/arcc-t05 # Shared project space []$ cd /project/arccanetrain/ [arcc-t05@blog1 arccanetrain]$ ls arcc-t01 arcc-t06 arcc-t11 arcc-t16 arcc-t21 arcc-t26 brewer salexan5 arcc-t02 arcc-t07 arcc-t12 arcc-t17 arcc-t22 arcc-t27 excotest arcc-t03 arcc-t08 arcc-t13 arcc-t18 arcc-t23 arcc-t28 intro_to_hpc arcc-t04 arcc-t09 arcc-t14 arcc-t19 arcc-t24 arcc-t29 lreilly arcc-t05 arcc-t10 arcc-t15 arcc-t20 arcc-t25 arcc-t30 mkillean

Copy files:

[]$ cd [~]$ cp -r /project/arccanetrain/intro_to_hpc/ . [~]$ cd intro_to_hpc/ [intro_to_hpc]$ ls Intro_to_hpc.pdf python01.py python01.py.fixed run_gpu.sh run.sh

Next Steps

Use the following link to provide feedback on this training: https://forms.gle/qQ8b7SxGJbo2U6y98 or use the QR code below.

Intro to HPC Access.png

 

Related content

What is HPC?
What is HPC?
Read with this
Data Moving and Access
Data Moving and Access
More like this
Intro to using the Module System
Intro to using the Module System
Read with this
Data Portal
Data Portal
More like this
Required Software is Not Available
Required Software is Not Available
Read with this
The Linux File System
The Linux File System
More like this