Skip to main content

Ctrl+K

Overview

FuriosaAI RNGD
FuriosaAI’s Software Stack
What’s New
Roadmap

Get Started

Installing Prerequisites
Quick Start with Furiosa-LLM
Upgrading FuriosaAI’s Software

Furiosa-LLM

Furiosa-LLM
Supported Models
OpenAI-Compatible Server
Responses API
Tool Calling
Structured Output
Vision-Language Models
Performance Optimization
Prefix Caching
Hierarchical Prefix Caching
Overlap Scheduling
Hybrid KV Cache Management
Data-Parallel Routing
Furiosa Executable Bundles (FXB)
Model Parallelism
API Reference
Examples
Deploying Furiosa-LLM on Kubernetes
Using Mooncake with Furiosa-LLM

Cloud Native Toolkit

Cloud Native Toolkit
Container Support
Kubernetes Plugins
Deploying Furiosa-LLM with llm-d

Device Management

Furiosa SMI
- Furiosa SMI CLI
- Furiosa SMI Library
Host PCI Optimization Tuning

Tutorials and Examples

FuriosaAI SDK CookBook

Customer Support

Forums
Customer Support

Other Links

FuriosaAI Homepage
Furiosa Gen 1 NPU SDK Doc

© Copyright 2026 FuriosaAI Inc.

What’s New

What’s New#

Release Notes

Furiosa SDK Release 2026.5.0b3
Furiosa SDK Release 2026.5.0b2
Furiosa SDK Release 2026.5.0b1
Furiosa SDK Release 2026.5.0b0
Furiosa SDK Release 2026.4.0
Furiosa SDK Release 2026.3.0
Furiosa SDK Release 2026.2
Furiosa SDK Release 2026.1
Release Notes for Furiosa SDK Release 2025.X

previous

FuriosaAI’s Software Stack

next

Furiosa SDK Release 2026.5.0b3

By FuriosaAI, Inc.

© Copyright 2026 FuriosaAI Inc.