Skip to main content

Ctrl+K

SDK 2024.2.1 has been released on Jan 10, 2025. Please checkout SDK Release Announcement of 2024.2.1.

Overview

FuriosaAI RNGD
FuriosaAI’s Software Stack
Supported Models
What’s New
Roadmap

Getting Started

Installing Prerequisites
Quick Start with Furiosa LLM
Running MLPerf™ Inference Benchmark
Upgrading Furiosa Software Stack

Furiosa LLM

Furiosa LLM
OpenAI Compatible Server
Model Preparation Workflow
Model Parallelism
References

Cloud Native Toolkit

Cloud Native Toolkit
Kubernetes Support

Device Management

Furiosa SMI
- Furiosa SMI CLI
- Furiosa SMI Library

Customer Support

FuriosaAI Forum
FuriosaAI Customer Portal

Other Links

FuriosaAI Homepage
FuriosaAI Warboy SDK Document

.rst

References

References#

References

LLM class
SamplingParams class
ArtifactBuilder
Artifact
ArtifactMetadata
ArtifactVersion
LLMEngine class
AsyncLLMEngine class

previous

Model Parallelism

next

LLM class

By FuriosaAI, Inc.

© Copyright 2025, FuriosaAI, Inc..