Storage Policy

ARCC Policies for High Performance Computing - Storage Policy


Contents

https://arccwiki.atlassian.net/wiki/spaces/DOCUMENTAT/pages/64192662/Glossary

https://arccwiki.atlassian.net/wiki/spaces/DOCUMENTAT/pages/33184/Frequently+Asked+Questions


Overview

Code-named Teton, the ARCC high-performance storage system (HPS) is a high speed, tiered storage system designed to maximize performance while minimizing cost. Teton is intended to be used for storing data that is actively being used.

The following policies discuss the use of this space. In general, the disk space is intended for support of research using the cluster, and as a courtesy to other users of the cluster, you should try to delete any files that are no longer needed or being used.

All data on the HPS, are considered to be related to your research and not to be of a personal nature. As such, all data is considered to be owned by the principal investigator for the allocation through which you have access to the cluster.

Teton is for the support of active research using the clusters. You should remove data files, etc. from the cluster promptly when you no longer actively working on the computations requiring them. This is to ensure that all users can avail themselves of these resources.

Note: None of the Teton file systems are backed up. We do data replication within the file system in order to minimize the loss of data in case of a system fault or failure.

Storage Allocations

Each individual researcher is assigned a standard storage allocation or quota on /home/project, and /gscratch. Researchers who use more than their allocated space will be blocked from creating new files until they reduce their use, or in the case of /project and /gscratch, request a one-time expansion or purchase additional storage. The chart below shows the storage allocations for individual accounts and the cost of additional space.

Directory Descriptions

/home 

  • Private user space for storing small, long term files such as environment settings, scripts, and source code.

/project 

  • Project-specific space shared among all members of a project for storing short term data, input, and output files.

/gscratch 

  • User-specific space for storing data that is actively being processed. This storage can be purged of old files as needed and is not for long term storage.

/lscratch 

  • Node specific space for storing short-term computational data relevant to jobs running on that node. Files are deleted nightly.

Directory Summary Table

Directory

Backed Up?

Default Allocation

Total Size

Media Type

Additional Storage Cost

Supported Protocols

Directory

Backed Up?

Default Allocation

Total Size

Media Type

Additional Storage Cost

Supported Protocols

/home

No

5 GB

1.2PB

Tier 1

$50 one-time setup fee and $100 / TB / year

NFS, CIFS, GPFS

/project

No

1 TB

1.2PB

Tier 1 & 2

One time proposal increase renewed every six months or $50 one-time setup fee and $100 / TB / year thereafter

NFS, CIFS, GPFS

/gscratch

No

5 TB

1.2PB

Tier 1 & 2

One time proposal increase renewed every six months or $50 one-time setup fee and $100 / TB / year thereafter

NFS, CIFS, GPFS

/lscratch

No

N/A

200GB or 1TB

N/A

N/A

N/A

Augmenting Capacity of Disk Allocation

Researchers working with or generating massive data sets that exceed the default 5 TB allocation, or having significant I/O needs should consider the following options:

  • Rent space on shared hardware: There is a set price per TB per 3 years. Please contact ARCC for the exact price.

  • Purchase additional storage disks to be incorporated into Teton: This option is appropriate for groups that need more space than the free offering, but don’t have the extreme space or performance demands that would require investing in dedicated hardware.

  • Buy your own dedicated storage hardware for Research Computing to host: If you need more than about 15 TB of storage or very high performance, dedicated hardware is more economical and appropriate. The exact choices are always evolving. Please contact ARCC for details.

File Deletion Policy

This describes ARCC's file deletion policy:

  • /home: Home directories will only be deleted after the owner has been removed from the university system.

  • /project: Project directories will be preserved for up to 6 months after project termination.

  • /gscratch: Files may be deleted as needed without warning if required for system productivity.

  • /lscratch: Files will be removed after thirty (30) days of not being used or accessed.