Skip to the content.

🇫🇷 | 🇬🇧 | 🇩🇪 | 🇪🇸 | 🇵🇹 | 🇮🇹 | 🇳🇱 | 🇵🇱 | 🇷🇺 | 🇨🇳 | 🇯🇵 | 🇰🇷

Ryzen AI SDK

Guide to install the AMD Ryzen AI SDK and run AI models on the NPU.

Prerequisites

Get SDK Access

  1. Create an account on AMD Ryzen AI Software Early Access Lounge
  2. Wait for approval (~2 business days)
  3. Download ryzen_ai-1.6.1.tgz

Installation

mkdir ~/ryzen_ai-1.6.1
cd ~/ryzen_ai-1.6.1
tar -xvzf ryzen_ai-1.6.1.tgz
./install_ryzen_ai.sh -a yes -p ~/ryzen-ai-env
source ~/ryzen-ai-env/bin/activate

Verification

cd ~/ryzen-ai-env/quicktest
python quicktest.py

Using with ONNX Runtime

import onnxruntime as ort

session = ort.InferenceSession(
    "model.onnx",
    providers=['VitisAIExecutionProvider', 'CPUExecutionProvider']
)

result = session.run(None, {"input": input_data})

Supported Model Types

Type Format Support
CNN INT8
CNN BF16
NLP (BERT) BF16
LLM -

Resources


← Troubleshooting Home