Skip to main content
Ctrl+K
FuriosaAI Developer Center 2024.2.dev0 documentation - Home FuriosaAI Developer Center 2024.2.dev0 documentation - Home

Overview

  • FuriosaAI RNGD
  • FuriosaAI’s Software Stack
  • Supported Models
  • What’s New
  • Roadmap

Getting Started

  • Installing Prerequisites
  • Quick Start with Furiosa LLM
  • Running MLPerf™ Inference Benchmark

Furiosa LLM

  • Furiosa LLM
  • OpenAI Compatible Server
  • Model Preparation Workflow
  • Model Parallelism
  • References
    • LLM class
    • SamplingParams class
    • ArtifactBuilder
    • LLMEngine class
    • AsyncLLMEngine class

Cloud Native Toolkit

  • Cloud Native Toolkit
  • Kubernetes Support
    • Installing Furiosa Feature Discovery
    • Installing Furiosa Device Plugin
    • Installing Furiosa Metrics Exporter
    • Scheduling NPUs

Device Management

  • Furiosa SMI
    • Furiosa SMI CLI
    • Furiosa SMI Library

Customer Support

  • FuriosaAI Homepage
  • FuriosaAI Forum
  • FuriosaAI Customer Portal
  • FuriosaAI Warboy SDK Document

Index

A | B | F | G | L | M | S

A

  • Artifact (class in furiosa_llm.artifact)
  • ArtifactBuilder (class in furiosa_llm.artifact)
  • ArtifactMetadata (class in furiosa_llm.artifact)
  • ArtifactVersion (class in furiosa_llm.artifact)
  • AsyncLLMEngine (class in furiosa_llm)

B

  • build() (furiosa_llm.artifact.ArtifactBuilder method)

F

  • from_artifacts() (furiosa_llm.LLM class method)

G

  • generate() (furiosa_llm.LLM method)

L

  • LLM (class in furiosa_llm)
  • LLMEngine (class in furiosa_llm)
  • load_artifacts() (furiosa_llm.LLM class method)

M

  • model_computed_fields (furiosa_llm.artifact.Artifact attribute)
    • (furiosa_llm.artifact.ArtifactMetadata attribute)
    • (furiosa_llm.artifact.ArtifactVersion attribute)
  • model_config (furiosa_llm.artifact.Artifact attribute)
    • (furiosa_llm.artifact.ArtifactMetadata attribute)
    • (furiosa_llm.artifact.ArtifactVersion attribute)
  • model_fields (furiosa_llm.artifact.Artifact attribute)
    • (furiosa_llm.artifact.ArtifactMetadata attribute)
    • (furiosa_llm.artifact.ArtifactVersion attribute)

S

  • SamplingParams (class in furiosa_llm)
  • stream_generate() (furiosa_llm.LLM method)

By FuriosaAI, Inc.

© Copyright 2024, FuriosaAI, Inc..