R is a programming language and free software environment for statistical computing and graphics supported by the R Foundation for Statistical Computing. The R language is widely used among statisticians and data miners for developing statistical software and data analysis. Below are links to pages that are related to R. R is a free software environment for statistical computing and graphics. It compiles and runs on a wide variety of UNIX platforms, Windows and macOS.

Contents

Glossary

Frequently Asked Questions

Overview

• R Homepage

Module: Example

...

[]$ module load gcc/13.2.0 r/4.4.0
----------------------------

----------------------------

-----------------------

The 

following dependent module(s) 

are 

not 

currently 

loaded: zlib-ng/2.1.4_zen4 (required by: gcc/13.2.0), zstd/1.5.5_zen4__programs_True (required by: gcc/13.2.0)
----------------------------

----------------------------

Using

Once the modules have been loaded:

-

-

--

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

-

Note:

• This software is dependent on the following modules:

  • gcc/7.3.0

  • Due to the install process, at this moment in time, you have to explicitly load gcc before loading r. If you try loading r before gcc you will see the following message:

[]$ module load r/3.6.1
Lmod has detected the following error:  These module(s) exist but cannot be loaded as requested: "r/3.6.1"
   Try: "module spider r/3.6.1" to see how to load the module(s).

R Packages

Below we will give some guidelines on how to install and use various R packages specifically on Teton.

• Typically, packages will be installed in your home folder, within the R folder, under the platform version x86_64-pc-linux-gnu-library, then under a major.minor version (without the patch number) folder.

~/R/
  x86_64-pc-linux-gnu-library/
    3.5/
    3.6/

• Packages installed/built with one major.minor version will typically not work under another.

R Package: RStan

R and Intel/MKL

We have versions of r (3.6.1/4.0.2) built with the Intel compiler and related MKL (Maths Kernel Library) that follows a request relating to Improving R Performance by installing optimized BLAS/LAPACK libraries.
To use:

[]$ module load r/4.0.2-intel

[]$ R
R version 4.0.2 (2020-06-22) -- "Taking Off Again"
Copyright (C) 2020 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)

> sessionInfo()
R version 4.0.2 (2020-06-22)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Storage

Matrix products: default
BLAS/LAPACK: /pfs/tsfs1/apps/el7-x86_64/u/intel/18.0.1/intel-mkl/2018.2.199-pti6y2y/compilers_and_libraries_2018.2.199/linux/mkl/lib/intel64_lin/libmkl_rt.so

• The Intel built version is dependent on the following modules core:

  • intel/18.0.1

  • intel-mkl/2018.2.199

  • The module load r/*.*.*-intel line will automatically load these modules for you.

Installing Packages to Use with Intel Version

On Teton, R packages are typically installed into:

~/R/
  x86_64-pc-linux-gnu-library/
    3.5/
    3.6/

One way to install the Intel packages is the following:

• Create a folder ~/R/intel/3.6/

~/R/
  x86_64-pc-linux-gnu-library/
    3.5/
    3.6/
  intel/
    3.6/

• Use module load r/3.6.1-intel to load the Intel version.

• After starting R, use .libPaths(c("~/R/intel/3.6/")) to set your environment to use this folder.

  • If you run .libPaths() you should see something of the form:

> .libPaths()
[1] "/pfs/tsfs1/home/salexan5/R/intel/3.6"                          
[2] "/pfs/tsfs1/apps/el7-x86_64/u/opt/R/3.6.1/intel/R-3.6.1/library"

• Install packages as normal e.g. install.packages("<the package's name>")

• When running your R scripts you need to set .libPaths(c("~/R/intel/3.6/")) before loading any libraries to inform R where the appropriate packages can be found.

• Note: Currently R Package: RStan can not be installed using the intel version.

Installing Packages: Potential Problems

Trying to install install.packages("labdsv") resulted in the following error:

/apps/u/gcc/4.8.5/intel/18.0.1-7cbw2rp/include/complex(77): error #308: member "std::complex<float>::_M_value" (declared at line 1187 of "/usr/include/c++/4.8.5/complex") is inaccessible
          _M_value = __z._M_value;
...
compilation aborted for sptree.cpp (code 2)
make: *** [sptree.o] Error 2
ERROR: compilation failed for package ‘Rtsne’
* removing ‘/pfs/tsfs1/home/salexan5/R/intel/3.6/Rtsne’
ERROR: dependency ‘Rtsne’ is not available for package ‘labdsv’
* removing ‘/pfs/tsfs1/home/salexan5/R/intel/3.6/labdsv’

This appears to be a reasonably common problem:

• Installing R `forecast` package on a Linux Cluster: compiler issues?

• CHPC Univ of Utah: R: Potential Problems

and is essentially a result of conflicts between compilers when using complex data types with the workaround of disabling the diagnostic error.
To resolve the issue, create and/or update the ~/.R/Makevars file by adding the following lines:

Teton: Using Multiple CPUs

Overview

• R: is a programming language and free software environment for statistical computing and graphics supported by the R Foundation for Statistical Computing. The R language is widely used among statisticians and data miners for developing statistical software and data analysis. Below are links to pages that are related to R. R is a free software environment for statistical computing and graphics. It compiles and runs on a wide variety of UNIX platforms, Windows and macOS.

Using

Use the module name r to discover versions available and to load the application.

Pre-Installed Libraries:

Some versions of r have had common libraries pre-installed. To check, you can either try loading the library, or you can list all the libraries installed using:

> packinfo <- installed.packages(fields = c("Package", "Version")) 
> packinfo[, "Version", drop=F]

Multicore

Typically, using parallel::detectCores() to detect the number of available cores on a cluster node is a slight red herring. This returns the entire total number of cores of the node your job is allocated and not the actual number of cores you requested/allocated. For example, if you're sbatch script defines the following,

...

and you're allocated a standard Teton node that have 32 cores, parallel::detectCores() will return a value of 32 and not 8 which is what you requested!
This will probably lead to unexpected results/failures when you try and run a function expecting 32 cores when only 8 are actually available.
To remove this problem you can use, and need to pass into your R script, the value of the $SLURM_JOB_CPUS_PER_NODE slurm environment variable.Below is an example of how to do this:

Example

Batch Script: (fragments of what your script might look like):

#!/bin/bash
...
#SBATCH --nodes=1
#SBATCH --cpus-per-task=8
...
echo "SLURM_JOB_CPUS_PER_NODE:" $SLURM_JOB_CPUS_PER_NODE
...
module load swset/2018.05 gcc/7.3.0 r/3.6.1
...
Rscript multiple_cpu_test.R $SLURM_JOB_CPUS_PER_NODE
...

R Script: multiple multiple_cpu_test.R

args <- commandArgs(trailingOnly = TRUE)
if (!is.na(args[1])) {
  num_of_cores <- args[1]
  print(paste0("Num of Cores: ", num_of_cores))
}

print(paste0("detectCores: ", parallel::detectCores()))

options(mc.cores = num_of_cores)
print(paste0("mc.cores: ", getOption("mc.cores", 1L)))

...