Installing Furiosa Device Plugin#

Furiosa Device Plugin#

The Furiosa device plugin implements the Kubernetes Device Plugin interface for FuriosaAI NPU devices, and its features are as follows:

  • Discovering the Furiosa NPU devices and registering to a Kubernetes cluster.

  • Tracking the health of the devices and reporting to a Kubernetes cluster.

  • Running AI workload on the top of the Furiosa NPU devices within a Kubernetes cluster.

Deploying Furiosa Device Plugin with Helm#

The Furiosa device plugin helm chart is available at furiosa-ai/helm-charts.

You can deploy the Furiosa Device Plugin by running the following commands:

helm repo add furiosa https://furiosa-ai.github.io/helm-charts
helm repo update
helm install furiosa-device-plugin furiosa/furiosa-device-plugin -n furiosa-system

Request Furiosa NPU Resource in Pod#

Furiosa NPU devices can be integrated into a Kubernetes cluster. Each NPU card is exposed as a single resource.

The following table shows the expected resource names:

Resource Name

Resource Count Per Card

furiosa.ai/rngd

1