Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel6
outlinefalse
styledefault
typelist
printabletrue

Why invest the time and effort to learn HPC?

Learning how to use HPC will likely not be valuable for all users in all cases, but it can be valuable for a number of different use cases. exceptionally valuable and save significant time and effort in certain situations. Learning these skills provide HPC knowledgable users with a strategic advantage that can serve them throughout their academic, research, and professional careers.

Anyone with a workstation crashing due to memory problems from too much data, or anyone running time consuming computational tasks, performing repetitive computations, or wanting to scale their computational work, or just needing more compute power should consider using HPC resources for improved speed, efficiency and efficiencytime-savings.ARCC helps all UW researchers regardless of HPC experience level learn to complete their research with HPC.

Common HPC Skills

Becoming an expert in HPC requires knowledge in Linux Command Line, and mastering a number of tools. The tools that provide the greatest value to you may be different from those in other scientific domains. While this it may seem initially daunting, UW ARCC helps all researchers regardless of HPC experience level. Our department has developed a number of tutorials and we offer bi-weekly office hours allowing you to learn HPC at your own pace. Below is an expandable a very general list of common set of skill to master in order to become an expert HPC user with links to training and materials on our Wiki:

Expand
titleCommon skill sets to master to become an HPC expert (to be covered in Fall 2024 Bootcamps)
  1. Linux

    1. Introducing Linux:

      1. Getting Started

      2. Command Line and Using the Terminal

      3. The Linux File System

      4. Text Editors in Linux

      5. Viewing and Searching Files

    2. Intermediate Linux:

      1. Output, Redirection, and Piping

      2. Intermediate Command Line Features

  2. HPC

    1. Intro to ARCC HPC

      1. Beginners Guide to Accessing the Cluster

        1. OnDemand on MedicineBow

        2. Southpass on Beartooth

      2. Set up SSH Access

        1. SSH Access for MedicineBow

        2. SSH Access for Beartooth

      3. Using the Module System

      4. Intro to Job Scheduling

      5. Using HPC OnDemand

  3. Data Management

    1. Transferring Data with ARCC Services

    2. Introduction to Data Management

  4. Using Software on HPC

    1. Intro to Conda on the Cluster

    2. Using Python, Conda and Pip on the Cluster

    3. Using R/R Studio on the Cluster

    4. Using Jupyter Notebooks on the Cluster

  5. Intro to External HPC Resources

:

  1. General HPC Use and Knowledge

  2. The Linux Operating System

  3. Command Line Interface (CLI)

  4. Data Transfers and Management

  5. Common Software for HPC Clusters (Conda, Python, R, etc)

Scheduled Trainings

Due to demand, UW ARCC will host 2 HPC Bootcamps covering the topics listed above in late Summer/early Fall 2024titled Research Computing & HPC Essentials - (Getting started with ARCC's services). Each Bootcamp runs for a full week and are scheduled for the following weeks:

  • August HPC Bootcamp (Monday August 12, 2024 through Friday August 16, 2024)

  • September HPC Bootcamp (Monday September 9, 2024 through Friday September 13, 2024)

Interested These bootcamps can help train new or intermediate HPC users to use HPC, and will cover the topics in modules listed in the table below:

Week-long Bootcamp Schedule by day of the week:

Day of the Week

Topics/Modules

Monday

  • Intro to Linux and Command Line

  • Text Editors in Linux

Tuesday

  • Intro to HPC

Wednesday

  • Using Southpass/OnDemand

  • Data Management and Transfers

Thursday

  • Using Conda on HPC

  • Using Python on HPC

  • Using R/R-Studio on HPC

Friday

  • Jupyter Notebooks on HPC

  • Intro to External HPC Resources

Interested parties may sign up for either bootcamp here. Those who sign up are not required to attend all scheduled modules