Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 8 Current »

Overview

  • AI Kit: The AI Kit gives data scientists, AI developers, and researchers familiar Python tools and frameworks to accelerate end-to-end data science and analytics pipelines on Intel architecture. The components are built using oneAPI libraries for low-level compute optimizations.

  • Using this toolkit, you can:

    • Deliver high-performance, deep learning training on Intel® XPUs and integrate fast inference into your AI development workflow with Intel-optimized, deep learning frameworks for TensorFlow and PyTorch, pretrained models, and low-precision tools. 

    • Achieve drop-in acceleration for data preprocessing and machine learning workflows with compute-intensive Python packages, Modin, scikit-learn, and XGBoost, optimized for Intel.

Using

These come in the form of conda environments. The following are currently available:

Version

Cluster

Conda Activate

2023.2

Loren

/apps/u/opt/compilers/oneapi/2023.2/tensorflow/2.13.0
/apps/u/opt/compilers/oneapi/2023.2/pytorch/2.0.1.0
/apps/u/opt/compilers/oneapi/2023.2/modin/0.23.0.0

2023.1

Beartooth

/apps/u/opt/compilers/oneapi/2023.1/tensorflow/2.10.0.0
/apps/u/opt/compilers/oneapi/2023.1/pytorch/1.13.0.0
/apps/u/opt/compilers/oneapi/2023.1/modin/0.17.0.1

2022.3

Beartooth

/apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0
/apps/u/opt/compilers/oneapi/2022.3/pytorch/1.12.0
/apps/u/opt/compilers/oneapi/2022.3/modin/0.13.3

Example:

[]$ module load miniconda3/23.1.0
[]$ conda activate /apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0
(/apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0) []$ python --version
Python 3.9.12 :: Intel Corporation
 Python Packages:
(/apps/u/opt/compilers/oneapi/2022.3/tensorflow/2.9.1.0) [salexan5@bmgt1 ~]$ pip list
Package                 Version
----------------------- --------------
absl-py                 0.15.0
aiohttp                 3.7.4.post0
astunparse              1.6.3
async-timeout           3.0.1
attrs                   21.4.0
blinker                 1.4
brotlipy                0.7.0
cachetools              4.2.2
certifi                 2022.6.15
cffi                    1.15.1
chardet                 4.0.0
charset-normalizer      2.0.12
click                   8.0.4
cryptography            36.0.2
cycler                  0.10.0
flatbuffers             20210226132247
gast                    0.5.2
google-auth             1.33.0
google-auth-oauthlib    0.4.1
google-pasta            0.2.0
grpcio                  1.42.0
h5py                    3.6.0
idna                    2.10
importlib-metadata      4.8.1
intel_tensorflow        2.9.1
keras                   2.9.0
Keras-Preprocessing     1.1.2
kiwisolver              1.3.2
Markdown                3.3.4
matplotlib              3.4.3
mkl-fft                 1.3.1
mkl-random              1.2.2
mkl-service             2.4.0
mkl-umath               0.1.1
multidict               5.1.0
numpy                   1.21.2
oauthlib                3.2.0
opt-einsum              3.3.0
packaging               21.3
pdfminer.six            20220506
Pillow                  8.4.0
pip                     22.1.2
protobuf                3.19.1
pyasn1                  0.4.8
pyasn1-modules          0.2.8
pycparser               2.21
PyJWT                   2.3.0
pyOpenSSL               22.0.0
pyparsing               3.0.3
PySocks                 1.7.1
python-dateutil         2.8.2
PyYAML                  6.0
requests                2.25.1
requests-oauthlib       1.3.0
rsa                     4.7.2
scipy                   1.7.3
setuptools              58.0.4
six                     1.16.0
TBB                     0.2
tensorboard             2.9.0
tensorboard-data-server 0.6.0
tensorboard-plugin-wit  1.6.0
tensorflow-estimator    2.9.0
termcolor               1.1.0
typing_extensions       4.1.1
urllib3                 1.26.11
Werkzeug                2.0.2
wheel                   0.37.1
wrapt                   1.13.3
yarl                    1.6.3
zipp                    3.6.0
  • No labels