Introduction: The workshop session will provide a quick tour covering high-level concepts, commands and processes for using Linux and HPC on our Beartooth cluster. It will cover enough to allow an attendee to access the cluster and to perform analysis associated with this workshop.

...

What is HPC

HPC stands for High Performance Computing and is one of UW ARCC’s core services. HPC is the practice of aggregating computing power in a way that delivers a much higher performance than one could get out of a typical desktop or workstation. HPC is commonly used to solve large problems, and has some common use cases:

...

• We typically have multiple users independently running jobs concurrently across compute nodes.

• Resources are shared, but do not interfere with any one else’s resources.

  • i.e. you have your own cores, your own block of memory.

• If someone else’s job fails it does NOT affect yours.

• Example: The two GPU compute nodes part of this reservation each have 8 GPU devices. We can have different, individual jobs run on each of these compute nodes, without effecting each other.

...

There are 2 types of HPC systems:

1. Homogeneous: All compute nodes in the system share the same architecture. CPU, memory, and storage are the same across the system. (Ex: NWSC’s Derecho)

2. Heterogeneous: The compute nodes in the system can vary architecturally with respect to CPU, memory, even storage, and whether they have GPUs or not. Usually, the nodes are grouped in partitions. Beartooth is a heterogeneous cluster and our partitions are described on the Beartooth Hardware Summary Table on our ARCC Wiki.

...

A reservation can be considered a temporary partition.

It is a set of compute nodes reserved for a period of time for a set of users/projects, who get priority use.

...

Important Dates:

1. After the 17th of June this reservation will stop and you will drop down to general usage if you have another Beartooth project.

2. The project itself will be removed after the 24th of June. You will not be able to use/access it. Anything you require please copy out of the project.

...

• The Beartooth Shell Access opens up a new browser tab that is running on a login node. Do not run any computation on these.
  [<username>@blog2 ~]$

• The SouthPass Interactive Desktop (terminal) is already running on a compute node.
  [<username>@t402 ~]$

...

Login Node Policy

...

1. Anything compute-intensive (tasks using significant computational/hardware resources - Ex: using 100% cluster CPU)

2. Long running tasks (over 10 min)

3. Any collection of a large # of tasks resulting in a similar hardware footprint to actions mentioned previously.  

4. Not sure?  Usesallocto be on the safe side. This will be covered later.
   Ex:salloc –-account=arccanetrain -–time 40:00

5. See more on ARCC’s Login Node Policy here

...

[arc-t10@blog2 ~]$ vimtutor
===============================================================================
=    W e l c o m e   t o   t h e   V I M   T u t o r    -    Version 1.7      =
=============================================================================== 
     Vim is a very powerful editor that has many commands, too many to 
     explain in a tutor such as this. This tutor is designed to describe 
     enough of the commands that you will be able to easily use Vim as 
     an all-purpose editor. 
     ...

...

*** Break ***

...

04 Using Linux to Search/Parse Text Files

...

Since the cluster has to cater for everyone we can not provide a simple desktop environment that provides everything.

Instead we provide modules that a user will load that configures their environment for their particular needs within a session.

...

Slurm will add this job to the queue, but it will be PENDING (P) while it waits for the necessary resources to become available.

As soon as there are, this 17th job will start, and it’s status will update to RUNNING (R).

Slurm manages this for you.

...

Monitor your Job: Continued…

...