Versions Compared

Old Version 30

changes.mady.by.user TLBrewer

Saved on

compared with

New Version Current

changes.mady.by.user Lisa Stafford

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Feature

Description of Feature

fdr

Requests nodes that are connected with an Infiniband cable with a signaling rate of 14.0625 Gbit/s

edr

Requests nodes that are connected with an Infiniband cable with a signaling rate of 25.78125 Gbit/s

intel

Requests a processor that is based on an Intel processor. Includes all Intel CPU versions in Teton.

ivy

Requests an Intel Ivy Bridge CPU.

sandy

Requests an Intel Sandy Bridge CPU.

broadwell

Requests an Intel Broadwell CPU.

haswell

Requests an Intel Haswell CPU.

knl

Requests an Intel Knights Landing CPU. This is a specialized chip and not good for all work loads.

amd

Requests a processor that is based on an AMD processor. Include all AMD CPU versions in Teton.

epyc

Requests an AMD EPYC CPU.

community

This feature indicates a node shared equally among the research community. Jobs on these nodes can’t be pre-empted, but can be queued up for far longer.

GPUs and Accelerators

The ARCC Teton cluster has a number of compute nodes that contain GPUs. The following tables list each node that has GPUs and the type of GPU installed.

Partition

GPU Type

slurm value to request

# of Nodes

# of GPU device on a node

CUDA Cores

GPU Memory Size (GB)

Compute Capability

moran

GeForce GTX Titan

1

1

2688

6

3.5

moran

GeForce GTX Titan X

2

One node has 2

One node has 1

3072

12

5.2

moran

Tesla K20m

Code Block
#SBATCH --gres=gpu:k20:1

18

2

One node only has 1

2496

4.7

3.5

moran

Tesla K20Xm

14

2

One node only has 1

2688

5.7

3.5

moran

Tesla K40c

1

2

2880

11.4

3.5

moran-bigmem-gpu

Tesla K80

Code Block
#SBATCH --partition=moran-bigmem-gpu
#SBATCH --gres=gpu:x
# where x defines the number of devices

2

8

2496

11.4

3.7

teton-gpu

Tesla P100

Code Block
#SBATCH --partition=teton-gpu
#SBATCH --gres=gpu:2

8

2

3584

16

6.0

Notes: also see /wiki/spaces/BeartoothI/pages/1027637249 page for instructions on utilizing the GPUs in Moran DGX and Teton DGX.