ARCC Commands
- Simon Alexander
This page details the use of a variety of ARCC specific cluster related commands.
Core Hour Usage for User: chu_user
Usage:
Calculate the total core usage hours for a user.
Syntax: chu_user [-u|y|m|Y|h]
options:
u <user> : optional : username to look up - if not defined will use current user.
y <year> : optional : year to look up - form YYYY e.g. 2023.
m <month> : optional : month to look up - form M e.g. 1 to 12.
: If no month defined will calculate for the entire year, or until 'now' if current year.
: If no date options define will calculate from beginning of current month.
Y : optional : Calculate from beginning of current year to 'now' - overrides 'y' and 'm' if defined.
h : optional : Print this help.
More details can be found at: https://arccwiki.atlassian.net/wiki/spaces/DOCUMENTAT/pages/1809907760/ARCC+CommandsOutput:
[]$ chu_user -u salexan5
+===========================================================================================+
| Core Hour Usage: salexan5 |
| Interval: 2023-05-01T00:00:00 to 2023-05-24T13:45:35 |
| Hours from start of month: 589.76 |
+-------------------------------------------------------------------------------------------+
| Non Investment Accounts: | | |
| Breakdown by Account | Total Jobs Total CPUHs | User Jobs User CPUHs |
| arccanetrain | 4348 1331.73 | 16 2.08 |
| matlabworkshop2022 | 54 215.09 | 0 0.0 |
| rongsongcodeoptim2022 | 18 29.89 | 0 0.0 |
+-------------------------------------------------------------------------------------------+
| Investment: inv-arcc | | |
| Size (# of cpus): 132 | | |
| Across all accounts | Total Jobs Total CPUHs | User Jobs User CPUHs |
| | 69 536.8 | 21 514.28 |
| Breakdown by Account | | |
| arcc | 69 536.8 | 21 514.29 |
+===========================================================================================+
Label | Description |
|---|---|
| The username the query is being made for. If not calling to check your own usage, you can only query users that you are associated to within your projects. |
| Starts the start to end date for the interval the query is running between. |
| Defines the number hours across the interval. |
| Lists the accounts that the user is part of, which are not associated with an investment. | Total Jobs Total CPUHs | User Jobs User CPUHs |The first two columns show the “number of jobs” and the “CPU Hour usage” across the account for ALL users. The second two columns show the “number of jobs” and the “CPU Hour usage” across the account specifically for the user. |
| A user can be part of an account that is associated with an investment. Note: An investment can have multiple accounts associated with it. |
| The total number of cores across all the investment nodes. |
| Same as |
| Same as |
Note: A user can also be part of multiple investments. If this is the case there will be an ‘Investment’ section for each investment.
Core Hour Usage for Project: chu_account
Usage:
Calculate the total core usage hours for an account and breakdown up user.
Syntax: chu_account [-a|y|m|Y|h]
options:
a <account> : required : account to look up.
y <year> : optional : year to look up - form YYYY e.g. 2023.
m <month> : optional : month to look up - form M e.g. 1 to 12.
: If no month defined will calculate for the entire year, or until 'now' if current year.
: If no date options define will calculate from beginning of current month.
Y : optional : Calculate from beginning of current year to 'now' - overrides 'y' and 'm' if defined.
h : optional : Print this help.
More details can be found at: https://arccwiki.atlassian.net/wiki/spaces/DOCUMENTAT/pages/1809907760/ARCC+CommandsOutput:
# Example 1
[]$ chu_account -a arcc
+===============================================================+
| Account Core Hour Usage: arcc |
| Interval: 2023-05-01T00:00:00 to 2023-05-24T16:14:11 |
| Hours from start of month: 592.24 |
+---------------------------------------------------------------+
| Investment: inv-arcc | |
| Size (# of cpus): 132 | |
| Days in Month: 31 | |
| Investment CPUHs: 98208 | |
| Balance: 106661.29 | |
| Across all accounts | Total Jobs Total CPUHs |
| | 69 546.71 |
+---------------------------------------------------------------+
| | Total Jobs Total CPUHs |
| arcc | 69 546.71 |
+---------------------------------------------------------------+
| By User | Num of Jobs CPUHs |
| brewer | 1 0.04 |
| jrlang | 10 0.24 |
| lreilly | 35 20.04 |
| mkillean | 2 2.19 |
| salexan5 | 21 524.19 |
+===============================================================+
# Example 2
[]$ chu_account -a matlabworkshop2022
+===============================================================+
| Account Core Hour Usage: matlabworkshop2022 |
| Interval: 2023-05-01T00:00:00 to 2023-05-24T16:16:54 |
| Hours from start of month: 592.28 |
+---------------------------------------------------------------+
| | Total Jobs Total CPUHs |
| matlabworkshop2022 | 54 215.09 |
+---------------------------------------------------------------+
| By User | Num of Jobs CPUHs |
| dpietrus | 54 215.09 |
+===============================================================+
Label | Description |
|---|---|
| The project (slurm account) the query is being made for. You can only query projects that yopu are part of. |
| Starts the start to end date for the interval the query is running between. |
| Defines the number hours across the interval. |
If the account is part of an investment: | See Example 1 |
| A user can be part of an account that is associated with an investment. Note: An investment can have multiple accounts associated with it. |
| The total number of cores across all the investment nodes. |
| Total number of days across the month/interval. |
| Total CPU hours relating to the investment over the entire month/interval. |
| The calculated as the “investment cpus + free amount - current number of CPU hours used” |
| | Total Jobs Total CPUHs |The columns show the “number of jobs” and the “CPU Hour usage” across ALL the accounts that are associated with the investment. |
Account Details |
|
<account> | | Total Jobs Total CPUHs |The columns show the “number of jobs” and the “CPU Hour usage” across the account being queries. |
By User |
|
<username> | | Num of Jobs CPUHs |Breakdown of the total jobs/CPUs by user. If the |
Core Hour Usage: Differences to (current) Monthly Reports
For calculating both user and account usage we are exploring an alternative approach to calculating usage compared to that currently implemented within the monthly reports.
Results do not include:
Jobs that were pre-empted.
Jobs that failed due to “Node Failure' - this is typically a hardware fail on the physical compute node - this is different to jobs that failed due to the application itself or experienced an out of memory issues (which is caused by the user not requesting enough memory for the job).
Job counts will typically be less as we do no include jobs that were cancelled while still pending i.e. the job had not been allocated any resources and had not started running.