Skip to main content

Ctrl+K

Overview

FuriosaAI RNGD
FuriosaAI’s Software Stack
Supported Models
What’s New
Roadmap

Getting Started

Installing Prerequisites
Quick Start with Furiosa LLM
Running MLPerf™ Inference Benchmark

Furiosa LLM

Furiosa LLM
OpenAI Compatible Server
References
- LLM class
- SamplingParams

Cloud Native Toolkit

Cloud Native Toolkit
Kubernetes Support

Device Management

furiosa-smi

Customer Support

FuriosaAI Homepage
FuriosaAI Forum
FuriosaAI Customer Portal
FuriosaAI Warboy SDK Document

.rst

References

References#

References

LLM class
SamplingParams

previous

OpenAI Compatible Server

next

LLM class

By FuriosaAI, Inc.

© Copyright 2024, FuriosaAI, Inc..