Skip to main content
Ctrl+K
FuriosaAI Developer Center 2024.1.dev0 documentation - Home FuriosaAI Developer Center 2024.1.dev0 documentation - Home

Overview

  • FuriosaAI RNGD
  • FuriosaAI’s Software Stack
  • Supported Models
  • What’s New
  • Roadmap

Getting Started

  • Installing Prerequisites
  • Quick Start with Furiosa LLM
  • Running MLPerf™ Inference Benchmark

Furiosa LLM

  • Furiosa LLM
  • OpenAI Compatible Server
  • References
    • LLM class
    • SamplingParams

Cloud Native Toolkit

  • Cloud Native Toolkit
  • Kubernetes Support
    • Installing Furiosa Feature Discovery
    • Installing Furiosa Device Plugin
    • Installing Furiosa Metrics Exporter
    • Scheduling NPUs

Device Management

  • furiosa-smi

Customer Support

  • FuriosaAI Homepage
  • FuriosaAI Forum
  • FuriosaAI Customer Portal
  • FuriosaAI Warboy SDK Document

Index

F | G | L | S

F

  • from_artifacts() (furiosa_llm.LLM class method)

G

  • generate() (furiosa_llm.LLM method)

L

  • LLM (class in furiosa_llm)

S

  • SamplingParams (class in furiosa_llm)
  • stream_generate() (furiosa_llm.LLM method)

By FuriosaAI, Inc.

© Copyright 2024, FuriosaAI, Inc..