Furiosa System Management Interface Library

Overview

Furiosa System Management Interface Library, is a C-based programmatic interface for managing and monitoring FuriosaAI NPUs.

The library provides the following API modules, each designed to offer distinct functionalities for managing and monitoring NPU devices. These modules enable developers to access essential hardware information, topology details, system-wide information, and performance metrics.

Each module provides the following features:

• Initialize module handles initialization of the Furiosa SMI library.
• Device module provides NPU device discovery and information including device specification and liveness.
• Topology module provides the topology status within a system including device-to-device link type and p2p accessibility.
• System module provides system-wide information of each NPU device, including firmware version and driver version.
• Performance module provides the device performance metrics including power consumption, temperature, and utilization.

Example

The following example demonstrates how to use the Furiosa System Management Interface Library to access and monitor NPU device information.

Start by including the necessary header file.

#include <furiosa/furiosa_smi.h>

You must initialize the library.

FuriosaSmiReturnCode ret;
ret = furiosa_smi_init();

To manage or monitor NPU devices, you need to retrieve the device handles.

FuriosaSmiDeviceHandles handles;
ret = furiosa_smi_get_device_handles(&handles);
int handle = handles.device_handles[0];

With device handles, you can access the device information.

FuriosaSmiDeviceInfo device_info;
ret = furiosa_smi_get_device_info(handle, &device_info);

You can also monitor the device status.

FuriosaSmiCoreStatuses core_status;
ret = furiosa_smi_get_device_core_status(handle, &core_status);
 
bool liveness;
ret = furiosa_smi_get_device_liveness(handle, &liveness);
 
FuriosaSmiDeviceTemperature temperature;
ret = furiosa_smi_get_device_temperature(handle, &temperature);
 
FuriosaSmiDevicePowerConsumption power_consumption;
ret = furiosa_smi_get_device_power_consumption(handle, &power_consumption)