{"type":"doc","content":[{"type":"extension","attrs":{"layout":"default","extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{"minLevel":{"value":"1"},"maxLevel":{"value":"6"},"outline":{"value":"false"},"type":{"value":"flat"},"separator":{"value":"pipe"},"printable":{"value":"false"}},"macroMetadata":{"macroId":{"value":"73327705-7a17-4c68-aa3e-7cf9f4c5914b"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}},"localId":"ca5c60e9-6fb9-49b8-a9f6-2f8bd4c2fcf8"}},{"type":"paragraph","content":[{"text":"This page details the use of a variety of ARCC specific cluster related commands.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Core Hour Usage for User: chu_user","type":"text"}]},{"type":"paragraph","content":[{"text":"Usage:","type":"text"}]},{"type":"codeBlock","content":[{"text":"Calculate the total core usage hours for a user.\nSyntax: chu_user [-u|y|m|Y|h]\noptions:\nu : optional : username to look up - if not defined will use current user.\ny : optional : year to look up - form YYYY e.g. 2023.\nm : optional : month to look up - form M e.g. 1 to 12.\n : If no month defined will calculate for the entire year, or until 'now' if current year.\n : If no date options define will calculate from beginning of current month.\nY : optional : Calculate from beginning of current year to 'now' - overrides 'y' and 'm' if defined.\nh : optional : Print this help.\nMore details can be found at: https://arccwiki.atlassian.net/wiki/spaces/DOCUMENTAT/pages/1809907760/ARCC+Commands","type":"text"}]},{"type":"paragraph","content":[{"text":"Output:","type":"text"}]},{"type":"codeBlock","content":[{"text":"[]$ chu_user -u salexan5\n+===========================================================================================+\n| Core Hour Usage: salexan5 |\n| Interval: 2023-05-01T00:00:00 to 2023-05-24T13:45:35 |\n| Hours from start of month: 589.76 |\n+-------------------------------------------------------------------------------------------+\n| Non Investment Accounts: | | |\n| Breakdown by Account | Total Jobs Total CPUHs | User Jobs User CPUHs |\n| arccanetrain | 4348 1331.73 | 16 2.08 |\n| matlabworkshop2022 | 54 215.09 | 0 0.0 |\n| rongsongcodeoptim2022 | 18 29.89 | 0 0.0 |\n+-------------------------------------------------------------------------------------------+\n| Investment: inv-arcc | | |\n| Size (# of cpus): 132 | | |\n| Across all accounts | Total Jobs Total CPUHs | User Jobs User CPUHs |\n| | 69 536.8 | 21 514.28 |\n| Breakdown by Account | | |\n| arcc | 69 536.8 | 21 514.29 |\n+===========================================================================================+","type":"text"}]},{"type":"paragraph"},{"type":"table","attrs":{"layout":"default","width":1800.0,"localId":"d6885592-8670-4508-8caf-8ff7872835ef"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Label","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Description","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Core Hour Usage: ","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"The username the query is being made for.","type":"text"}]},{"type":"paragraph","content":[{"text":"If not calling to check your own usage, you can only query users that you are associated to within your projects.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Interval","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Starts the start to end date for the interval the query is running between.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Hours from start of month","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Defines the number hours across the interval.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Non Investment Accounts","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Lists the accounts that the user is part of, which are not associated with an investment.","type":"text"}]},{"type":"codeBlock","content":[{"text":"| Total Jobs Total CPUHs | User Jobs User CPUHs |","type":"text"}]},{"type":"paragraph","content":[{"text":"The first two columns show the “number of jobs” and the “CPU Hour usage” across the account for ALL users.","type":"text"}]},{"type":"paragraph","content":[{"text":"The second two columns show the “number of jobs” and the “CPU Hour usage” across the account specifically for the user.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Investment","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"A user can be part of an account that is associated with an investment.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note: An investment can have multiple accounts associated with it.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Size (# of cpus)","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"The total number of cores across all the investment nodes.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Across all accounts","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Same as ","type":"text"},{"text":"Non Investment Accounts","type":"text","marks":[{"type":"code"}]},{"text":" but details totals across ALL accounts within the investment.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Breakdown by Account","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Same as ","type":"text"},{"text":"Non Investment Accounts","type":"text","marks":[{"type":"code"}]},{"text":" but details totals across individual accounts within the investment.","type":"text"}]}]}]}]},{"type":"paragraph","content":[{"text":"Note: A user can also be part of multiple investments. If this is the case there will be an ‘Investment’ section for each investment.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Core Hour Usage for Project: chu_account","type":"text"}]},{"type":"paragraph","content":[{"text":"Usage:","type":"text"}]},{"type":"codeBlock","content":[{"text":"Calculate the total core usage hours for an account and breakdown up user.\nSyntax: chu_account [-a|y|m|Y|h]\noptions:\na : required : account to look up.\ny : optional : year to look up - form YYYY e.g. 2023.\nm : optional : month to look up - form M e.g. 1 to 12.\n : If no month defined will calculate for the entire year, or until 'now' if current year.\n : If no date options define will calculate from beginning of current month.\nY : optional : Calculate from beginning of current year to 'now' - overrides 'y' and 'm' if defined.\nh : optional : Print this help.\nMore details can be found at: https://arccwiki.atlassian.net/wiki/spaces/DOCUMENTAT/pages/1809907760/ARCC+Commands","type":"text"}]},{"type":"paragraph","content":[{"text":"Output:","type":"text"}]},{"type":"codeBlock","content":[{"text":"# Example 1\n[]$ chu_account -a arcc\n+===============================================================+\n| Account Core Hour Usage: arcc |\n| Interval: 2023-05-01T00:00:00 to 2023-05-24T16:14:11 |\n| Hours from start of month: 592.24 |\n+---------------------------------------------------------------+\n| Investment: inv-arcc | |\n| Size (# of cpus): 132 | |\n| Days in Month: 31 | |\n| Investment CPUHs: 98208 | |\n| Balance: 106661.29 | |\n| Across all accounts | Total Jobs Total CPUHs |\n| | 69 546.71 |\n+---------------------------------------------------------------+\n| | Total Jobs Total CPUHs |\n| arcc | 69 546.71 |\n+---------------------------------------------------------------+\n| By User | Num of Jobs CPUHs |\n| brewer | 1 0.04 |\n| jrlang | 10 0.24 |\n| lreilly | 35 20.04 |\n| mkillean | 2 2.19 |\n| salexan5 | 21 524.19 |\n+===============================================================+\n\n# Example 2\n[]$ chu_account -a matlabworkshop2022\n+===============================================================+\n| Account Core Hour Usage: matlabworkshop2022 |\n| Interval: 2023-05-01T00:00:00 to 2023-05-24T16:16:54 |\n| Hours from start of month: 592.28 |\n+---------------------------------------------------------------+\n| | Total Jobs Total CPUHs |\n| matlabworkshop2022 | 54 215.09 |\n+---------------------------------------------------------------+\n| By User | Num of Jobs CPUHs |\n| dpietrus | 54 215.09 |\n+===============================================================+","type":"text"}]},{"type":"paragraph"},{"type":"table","attrs":{"layout":"default","width":1800.0,"localId":"764dd435-a805-4671-8fa6-1e9e7c0e86e2"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Label","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Description","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Account Core Hour Usage: ","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"The project (slurm account) the query is being made for.","type":"text"}]},{"type":"paragraph","content":[{"text":"You can only query projects that yopu are part of.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Interval","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Starts the start to end date for the interval the query is running between.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Hours from start of month","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Defines the number hours across the interval.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"If the account is part of an investment:","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"See Example 1","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Investment","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"A user can be part of an account that is associated with an investment.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note: An investment can have multiple accounts associated with it.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Size (# of cpus)","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"The total number of cores across all the investment nodes.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Days in Month: ","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Total number of days across the month/interval.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Investment CPUHs: ","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"Total CPU hours relating to the investment over the entire month/interval.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Balance: ","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph","content":[{"text":"The calculated as the “investment cpus + free amount - current number of CPU hours used”","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Across all accounts","type":"text","marks":[{"type":"code"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"codeBlock","content":[{"text":"| Total Jobs Total CPUHs |","type":"text"}]},{"type":"paragraph","content":[{"text":"The columns show the “number of jobs” and the “CPU Hour usage” across ALL the accounts that are associated with the investment.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"Account Details","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph"}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"codeBlock","content":[{"text":"| Total Jobs Total CPUHs |","type":"text"}]},{"type":"paragraph","content":[{"text":"The columns show the “number of jobs” and the “CPU Hour usage” across the account being queries.","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"By User","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"paragraph"}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[151.0]},"content":[{"type":"paragraph","content":[{"text":"","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[609.0]},"content":[{"type":"codeBlock","content":[{"text":"| Num of Jobs CPUHs |","type":"text"}]},{"type":"paragraph","content":[{"text":"Breakdown of the total jobs/CPUs by user.","type":"text"}]},{"type":"panel","attrs":{"panelType":"warning"},"content":[{"type":"paragraph","content":[{"text":"If the ","type":"text"},{"text":"username","type":"text","marks":[{"type":"code"}]},{"text":" is a list of numbers, for example ","type":"text"},{"text":"10237419","type":"text","marks":[{"type":"code"}]},{"text":" then it means that user is no longer part of the cluster.","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Core Hour Usage: Differences to (current) Monthly Reports","type":"text"}]},{"type":"paragraph","content":[{"text":"For calculating both user and account usage we are exploring an alternative approach to calculating usage compared to that currently implemented within the monthly reports.","type":"text"}]},{"type":"paragraph","content":[{"text":"Results do not include:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Jobs that were pre-empted.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Jobs that failed due to “Node Failure' - this is typically a hardware fail on the physical compute node - this is different to jobs that failed due to the application itself or experienced an out of memory issues (which is caused by the user not requesting enough memory for the job).","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Job counts will typically be less as we do no include jobs that were cancelled while still pending i.e. the job had not been allocated any resources and had not started running.","type":"text"}]}]}]}],"version":1}

Browser not supported