Skip to main content

Ctrl+K

SDK 2025.1.0 has been released on Feb 24, 2025. Please checkout SDK Release Announcement of 2025.1.0.

Overview

FuriosaAI RNGD
FuriosaAI’s Software Stack
Supported Models
What’s New
Roadmap

Getting Started

Installing Prerequisites
Quick Start with Furiosa LLM
Running MLPerf™ Inference Benchmark
Upgrading FuriosaAI’s Software

Furiosa LLM

Furiosa LLM
Model Preparation Workflow
OpenAI-Compatible Server
Model Parallelism
API Reference

Cloud Native Toolkit

Cloud Native Toolkit
Kubernetes Support

Device Management

Furiosa SMI
- Furiosa SMI CLI
- Furiosa SMI Library

Customer Support

FuriosaAI Forum
FuriosaAI Customer Portal

Other Links

FuriosaAI Homepage
FuriosaAI Warboy SDK Document

.rst

API Reference

API Reference#

API Reference

LLM class
SamplingParams class
ArtifactBuilder
Artifact
ArtifactMetadata
ArtifactVersion
LLMEngine class
AsyncLLMEngine class

previous

Model Parallelism

next

LLM class

By FuriosaAI, Inc.

© Copyright 2025, FuriosaAI, Inc..