Furiosa SDK Documentation

FuriosaAI NPU

  • FuriosaAI NPU
  • FuriosaAI Warboy
  • List of Supported Operators for NPU Acceleration

FuriosaAI Software

  • FuriosaAI SW Stack Introduction
  • Driver, Firmware, and Runtime Installation
  • Python SDK Installation & User Guide
  • Installation and User Guide of C SDK
  • Command Line Tools
  • Compiler
  • Model Quantization
  • Kubernetes Support
  • Model Server (Serving Framework)
  • Tutorial and Code Examples
  • References

Release Notes

  • Release Notes - 0.6.0
  • Release Notes - 0.5.0

Customer Support

  • FuriosaAI Customer Center
  • Bug Report

Previous Documents

  • v0.5.0
  • v0.2.0
Furiosa SDK Documentation
  • »
  • furiosa.server package
  • View page source

furiosa.server package

Subpackages

  • furiosa.server.api package
    • Subpackages
      • furiosa.server.api.cli package
        • Submodules
        • furiosa.server.api.cli.main module
        • Module contents
      • furiosa.server.api.grpc package
        • Subpackages
        • Submodules
        • furiosa.server.api.grpc.converters module
        • furiosa.server.api.grpc.server module
        • furiosa.server.api.grpc.servicers module
        • Module contents
      • furiosa.server.api.rest package
        • Submodules
        • furiosa.server.api.rest.app module
        • furiosa.server.api.rest.endpoints module
        • furiosa.server.api.rest.server module
        • Module contents
    • Module contents
  • furiosa.server.handlers package
    • Submodules
    • furiosa.server.handlers.predict module
    • furiosa.server.handlers.repository module
    • Module contents
  • furiosa.server.types package
    • Submodules
    • furiosa.server.types.model_repository module
    • furiosa.server.types.predict module
    • Module contents
  • furiosa.server.utils namespace
    • Submodules
    • furiosa.server.utils.loader module
    • furiosa.server.utils.thread module

Submodules

furiosa.server.errors module

exception furiosa.server.errors.ModelNotFound(name: str, version: Optional[str] = None)

Bases: furiosa.server.errors.ModelServerError

exception furiosa.server.errors.ModelServerError(msg)

Bases: Exception

furiosa.server.model module

furiosa.server.registry module

furiosa.server.repository module

furiosa.server.server module

furiosa.server.settings module

Module contents


© Copyright 2022 FuriosaAI, Inc..

Built with Sphinx using a theme provided by Read the Docs.