/
oneAPI: AI Analytics Toolkit [beartooth]

oneAPI: AI Analytics Toolkit [beartooth]

Owned by Simon Alexander, created
Last updated: Oct 04, 2024
2 min read
1 Overview | 2 Using | 2.1 Example:

Overview

  • AI Kit: The AI Kit gives data scientists, AI developers, and researchers familiar Python tools and frameworks to accelerate end-to-end data science and analytics pipelines on Intel architecture. The components are built using oneAPI libraries for low-level compute optimizations.

  • Using this toolkit, you can:

    • Deliver high-performance, deep learning training on Intel® XPUs and integrate fast inference into your AI development workflow with Intel-optimized, deep learning frameworks for TensorFlow and PyTorch, pretrained models, and low-precision tools. 

    • Achieve drop-in acceleration for data preprocessing and machine learning workflows with compute-intensive Python packages, Modin, scikit-learn, and XGBoost, optimized for Intel.

Using

These come in the form of conda environments. The following are currently available:

Version

Cluster

Conda Activate

Version

Cluster

Conda Activate

2023.2

Loren

/apps/u/opt/compilers/oneapi/2023.2/tensorflow/2.13.0 /apps/u/opt/compilers/oneapi/2023.2/pytorch/2.0.1.0 /apps/u/opt/compilers/oneapi/2023.2/modin/0.23.0.0

2023.1

Beartooth

/apps/u/opt/compilers/oneapi/2023.1/tensorflow/2.10.0.0 /apps/u/opt/compilers/oneapi/2023.1/pytorch/1.13.0.0 /apps/u/opt/compilers/oneapi/2023.1/modin/0.17.0.1

2022.3

Beartooth

/apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0 /apps/u/opt/compilers/oneapi/2022.3/pytorch/1.12.0 /apps/u/opt/compilers/oneapi/2022.3/modin/0.13.3

Example:

[]$ module load miniconda3/23.1.0 []$ conda activate /apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0 (/apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0) []$ python --version Python 3.9.12 :: Intel Corporation
(/apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0) [salexan5@bmgt1 ~]$ pip list Package Version ----------------------- -------------- absl-py 0.15.0 aiohttp 3.7.4.post0 astunparse 1.6.3 async-timeout 3.0.1 attrs 21.4.0 blinker 1.4 brotlipy 0.7.0 cachetools 4.2.2 certifi 2022.6.15 cffi 1.15.1 chardet 4.0.0 charset-normalizer 2.0.12 click 8.0.4 cryptography 36.0.2 cycler 0.10.0 flatbuffers 20210226132247 gast 0.5.2 google-auth 1.33.0 google-auth-oauthlib 0.4.1 google-pasta 0.2.0 grpcio 1.42.0 h5py 3.6.0 idna 2.10 importlib-metadata 4.8.1 intel_tensorflow 2.9.1 keras 2.9.0 Keras-Preprocessing 1.1.2 kiwisolver 1.3.2 Markdown 3.3.4 matplotlib 3.4.3 mkl-fft 1.3.1 mkl-random 1.2.2 mkl-service 2.4.0 mkl-umath 0.1.1 multidict 5.1.0 numpy 1.21.2 oauthlib 3.2.0 opt-einsum 3.3.0 packaging 21.3 pdfminer.six 20220506 Pillow 8.4.0 pip 22.1.2 protobuf 3.19.1 pyasn1 0.4.8 pyasn1-modules 0.2.8 pycparser 2.21 PyJWT 2.3.0 pyOpenSSL 22.0.0 pyparsing 3.0.3 PySocks 1.7.1 python-dateutil 2.8.2 PyYAML 6.0 requests 2.25.1 requests-oauthlib 1.3.0 rsa 4.7.2 scipy 1.7.3 setuptools 58.0.4 six 1.16.0 TBB 0.2 tensorboard 2.9.0 tensorboard-data-server 0.6.0 tensorboard-plugin-wit 1.6.0 tensorflow-estimator 2.9.0 termcolor 1.1.0 typing_extensions 4.1.1 urllib3 1.26.11 Werkzeug 2.0.2 wheel 0.37.1 wrapt 1.13.3 yarl 1.6.3 zipp 3.6.0

Related content