Teton Hardware Summary Table
| Slurm Partition name | Requestable features | Node | Sockets/ | Cores/ | Threads/ | Total | RAM | Processor (x86_64) | Local Disks | OS |
---|---|---|---|---|---|---|---|---|---|---|---|
Moran Regular | moran | fdr, intel, sandy, ivy, community | 280 | 2 | 8 | 1 | 16 | 64 or 128 | Intel Ivybridge/ | 1 TB HD | RHEL 7.9 |
Moran BigMem | moran, moran-bigmem-gpu | fdr, intel, haswell | 2 | 2 | 8 | 1 | 16 | 512 | Intel Haswell | 1 TB HD | RHEL 7.9 |
Moran Debug | moran | fdr, intel, ivy, debug | 2 | 2 | 8 | 1 | 16 | 64 | Intel Ivybridge | 1 TB HD | RHEL 7.9 |
Moran HugeMem | moran, moran-hugemem | fdr, intel, haswell, community | 2 | 2 | 8 | 1 | 16 | 1024 | Intel Haswell | 1 TB HD | RHEL 7.9 |
Moran DGX | dgx | edr, intel, broadwell | 1 | 2 | 10 | 2 | 40 | 512 | Intel Broadwell | 7 TB SSD | Ubuntu 18.04.2 LTS |
Moran Test | arcc | fdr, intel, haswell | 1 | 2 | 10 | 1 | 20 | 64 | Intel Haswell | 300 GB HD | RHEL 7.9 |
Teton Regular | teton | edr, intel, broadwell, community | 180 | 2 | 16 | 1 | 32 | 128 | Intel Broadwell | 240 GB SSD | RHEL 7.9 |
Teton Cascade | teton-cascade | edr, intel, cascade, community | 56 | 2 | 20 | 1 | 40 | 192 or 768 | Intel Cascade Lake | 240 GB SSD | RHEL 7.9 |
Teton BigMem GPU | teton-gpu | edr, intel, broadwell, community | 8 | 2 | 16 | 1 | 32 | 512 | Intel Broadwell | 240 GB SSD | RHEL 7.9 |
Teton HugeMem | teton-hugemem | edr, intel, broadwell | 10 | 2 | 16 | 1 | 32 | 1024 | Intel Broadwell | 240 GB SSD | RHEL 7.9 |
Teton Massive Memory | teton-massmem | edr, amd, epyc | 2 | 2 | 24 | 1 | 48 | 4096 | AMD/EPYC | 4096 GB SSD | RHEL 7.9 |
Teton KNL | teton-knl | edr, intel, knl | 12 | 1 | 18 | 4 | 72 | 384 | Intel Knights Landing | 240 GB SSD | RHEL 7.9 |
Teton DGX | dgx | edr, intel, broadwell | 1 | 2 | 10 | 2 | 40 | 512 | Intel Broadwell | 7 TB SSD | Ubuntu 18.04.2 LTS |
Feature | Description of Feature |
---|---|
fdr | Requests nodes that are connected with an Infiniband cable with a signaling rate of 14.0625 Gbit/s |
edr | Requests nodes that are connected with an Infiniband cable with a signaling rate of 25.78125 Gbit/s |
intel | Requests a processor that is based on an Intel processor. Includes all Intel CPU versions in Teton. |
ivy | Requests an Intel Ivy Bridge CPU. |
sandy | Requests an Intel Sandy Bridge CPU. |
broadwell | Requests an Intel Broadwell CPU. |
haswell | Requests an Intel Haswell CPU. |
knl | Requests an Intel Knights Landing CPU. This is a specialized chip and not good for all work loads. |
amd | Requests a processor that is based on an AMD processor. Include all AMD CPU versions in Teton. |
epyc | Requests an AMD EPYC CPU. |
community | This feature indicates a node shared equally among the research community. Jobs on these nodes can’t be pre-empted, but can be queued up for far longer. |
GPUs and Accelerators
The ARCC Teton cluster has a number of compute nodes that contain GPUs. The following tables list each node that has GPUs and the type of GPU installed.
Partition | GPU Type | slurm value to request | # of Nodes | # of GPU device on a node | CUDA Cores | GPU Memory Size (GB) | Compute Capability |
---|---|---|---|---|---|---|---|
moran | GeForce GTX Titan |
| 1 | 1 | 2688 | 6 | 3.5 |
moran | GeForce GTX Titan X |
| 2
| One node has 2 One node has 1 | 3072 | 12 | 5.2 |
moran | Tesla K20m | #SBATCH --gres=gpu:k20:1 | 18 | 2 One node only has 1 | 2496 | 4.7 | 3.5 |
moran | Tesla K20Xm |
| 14 | 2 One node only has 1 | 2688 | 5.7 | 3.5 |
moran | Tesla K40c |
| 1 | 2 | 2880 | 11.4 | 3.5 |
moran-bigmem-gpu | Tesla K80 | #SBATCH --partition=moran-bigmem-gpu
#SBATCH --gres=gpu:x
# where x defines the number of devices | 2 | 8 | 2496 | 11.4 | 3.7 |
teton-gpu | Tesla P100 | #SBATCH --partition=teton-gpu
#SBATCH --gres=gpu:2 | 8 | 2 | 3584 | 16 | 6.0 |
Notes: also see https://arccwiki.atlassian.net/wiki/spaces/BeartoothI/pages/1027637249 page for instructions on utilizing the GPUs in Moran DGX and Teton DGX.