Skip to main content

Ctrl+K

SDK 2025.1.0 has been released on Feb 24, 2025. Please checkout SDK Release Announcement of 2025.1.0.

Overview

FuriosaAI RNGD
FuriosaAI’s Software Stack
Supported Models
What’s New
Roadmap

Getting Started

Installing Prerequisites
Quick Start with Furiosa LLM
Running MLPerf™ Inference Benchmark
Upgrading FuriosaAI’s Software

Furiosa LLM

Furiosa LLM
Model Preparation Workflow
OpenAI-Compatible Server
Model Parallelism
API Reference

Cloud Native Toolkit

Cloud Native Toolkit
Kubernetes Support

Device Management

Furiosa SMI
- Furiosa SMI CLI
- Furiosa SMI Library

Customer Support

FuriosaAI Forum
FuriosaAI Customer Portal

Other Links

FuriosaAI Homepage
FuriosaAI Warboy SDK Document

.rst

Cloud Native Toolkit

Cloud Native Toolkit#

FuriosaAI Cloud Native Toolkit is a software stack to enable FuriosaAI’s NPU product in Kubernetes and Container ecosystem.

previous

AsyncLLMEngine class

next

Kubernetes Support

By FuriosaAI, Inc.

© Copyright 2025, FuriosaAI, Inc..