Skip to main content

Ctrl+K

Overview

FuriosaAI RNGD
FuriosaAI’s Software Stack
Supported Models
What’s New
Roadmap

Get Started

Installing Prerequisites
Quick Start with Furiosa-LLM
Upgrading FuriosaAI’s Software

Furiosa-LLM

Furiosa-LLM
OpenAI-Compatible Server
Model Preparation
Building Model Artifacts By Examples
Model Parallelism
API Reference
Examples
- Chat
- Chat with tools
Deploying Furiosa-LLM on Kubernetes

Cloud Native Toolkit

Cloud Native Toolkit
Container Support
Kubernetes Plugins

Device Management

Furiosa SMI
- Furiosa SMI CLI
- Furiosa SMI Library

Tutorials and Examples

FuriosaAI SDK CookBook

Customer Support

Forums
Customer Support

Other Links

FuriosaAI Homepage
Furiosa Gen 1 NPU SDK Doc

© Copyright 2025 FuriosaAI Inc.

API Reference

API Reference#

API Reference

LLM class
SamplingParams class
ArtifactBuilder
Artifact
ArtifactMetadata
LLMEngine class
AsyncLLMEngine class

previous

Model Parallelism

next

LLM class

By FuriosaAI, Inc.

© Copyright 2025 FuriosaAI Inc.