Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

If users have attended previous workshops, this will be review.

...

Opening Screen:

  • Message Shows message of the day

  • Storage Lists storage usage - across project spaces

    • You can see this again by calling: arccquota

    • Also shows directories specific to arcc HPCs

Code Block
General Format:[<username>@<server/node-name> <folder>]$ 
[<username>@blog2arcc-t30@mblog2 ~]$ arccquota
# ‘man’ is only available on the login nodes.
# It is not available on the compute nodes.
[<username>@blog2 ~]$ man id
[<username>@blog2 ~]$ id –-version
[<username>@blog2 ~]$ id
[<username>@blog2 ~]$ groups

Which groups?

Code Block
[arcc-t05@blog1 ~]$ id
uid=10339923(arcc-t05) gid=10339923(arcc-t05) groups=10339923(arcc-t05),89997(beartooth),446824(uwit-research-arccanetraining),5735503(teton_backup),6000211(arccanetrain)
[arcc-t05@blog1 ~]$ groups
arcc-t05 beartooth uwit-research-arccanetraining teton_backup arccanetrain+----------------------------------------------------------------------+
|              arccquota              |             Block              |
+----------------------------------------------------------------------+
|                Path                 | Used       Limit     %         |
+----------------------------------------------------------------------+
| /home/arcc-t30                      | 00.00 GB   50.00 GB  00.00     |
| /gscratch/arcc-t30                  | 00.00 GB   05.00 TB  00.00     |
| /project/arccanetrain               | 00.00 GB   05.00 TB  00.00     |
|                                                                      |
+----------------------------------------------------------------------+
[arcc-t30@mblog1 ~]$ 

...

ARCC HPC: FileSystem 

Space for [username]Space defined below 

Type

Location

Description

Notes

home

/home/<username>

Personal storage space associated with user’s account. For configuration files and smaller software installations.

Smaller allocation

project

/project/<project-name>/

Space to collaborate among project members. Data here is persistent and is exempt from purge policy. 

All project members have read/write at this level.

project-user

/project/<project-name>/[username]

Storage specific to username within project space. Project members can read but only you may write.

project-software

/project/<project-name>/software

Storage space to install software to be shared among project group members.

Only on MedicineBow

gscratch

/gscratch/<username>

Scratch space to perform computing for individual users.

Data here is subject to a purge policy

.

node local scratch

/lscratch

Only on compute.

memory filesystem

/dev/shm

RAM-based tmpfs available as part of RAM for very rapid I/O operations; small capacity.

See here for information about directory quotas

...

Home, Project, and

...

Gscratch Folders:

Code Block
# Home folder:
[]$ cd ~
[]$ pwd
/home/arcc-t05
[]$ cd /gscratch/arcc-t05
# Shared project space
[]$ cd /project/arccanetrain/
[arcc-t05@blog1 arccanetrain]$ ls
arcc-t01  arcc-t06  arcc-t11  arcc-t16  arcc-t21  arcc-t26  brewer       mkilleansalexan5
arcc-t02  arcc-t07  arcc-t12  arcc-t17  arcc-t22  arcc-t27  excotest     salexan5
arcc-t03  arcc-t08  arcc-t13  arcc-t18  arcc-t23  arcc-t28  intro_to_hpc
arcc-t04  arcc-t09  arcc-t14  arcc-t19  arcc-t24  arcc-t29  lreilly lmainzer
arcc-t05  arcc-t10  arcc-t15  arcc-t20  arcc-t25  arcc-t30  lreilly mkillean

...

Copy files:

Code Block
[]$ cd 
[~]$ cp -r /project/arccanetrain/intro_to_hpc/ .
[~]$ cd intro_to_hpc/
[intro_to_hpc]$ ls
Intro_to_hpc.pdf  python01.py  python01.py.fixed  run_gpu.sh  run.sh

...

Use the following link to provide feedback on this training: https://forms.gle/qQ8b7SxGJbo2U6y98 or use the QR code below.

...