Struct HbmTensor 

pub struct HbmTensor<D: Scalar, Chip: M, Element: M> { /* private fields */ }

Tensor stored in HBM memory.

Implementations

impl<D: Scalar, Chip: M, Element: M> HbmTensor<D, Chip, Element>

pub type Mapping = Pair<Chip, Element>

Mapping type alias.

pub fn address(&self) -> Address

Returns the HBM address of this tensor.

pub fn size() -> usize

Size in bytes.

pub unsafe fn from_addr(address: Address) -> Self

Creates an HBM tensor handle at the given raw address.

Safety

The caller must ensure that the underlying data layout is compatible with the tensor mapping.

pub async fn to_host<Element2: M>( &self, _dma: &mut DmaContext<{ Dma::Pcie }>, ) -> HostTensor<D, Element2>

Converts to host tensor.

TODO: we should optionally receive the intermediate stream’s mapping expression.

pub fn to_hbm<const DMA: Dma, Element2: M>( &self, _dma: &mut DmaContext<DMA>, address: Address, ) -> HbmTensor<D, Chip, Element2>

Converts to HBM tensor.

pub fn dma_gather<Cluster2: M, Slice2: M, Element2: M, Element3: M>( &self, _index_tensor: &HbmTensor<i32, Chip, Element3>, _address: Address, ) -> DmTensor<D, Chip, Cluster2, Slice2, Element2>

Gather DRAM rows into SRAM at positions given by index tensor.

Implements index_select along dim 0: output[i] = self[index[i]]. Inverse of DmTensor::dma_scatter.

TODO: implement CPU reference and LIR translation (same pattern as dma_scatter).

pub fn view<'l>(&'l self) -> HbmTensorView<'l, D, Chip, Element>

Creates mutable views by splitting along a tile expression.

pub fn view_mut<'l>(&'l mut self) -> HbmTensorViewMut<'l, D, Chip, Element>

Creates mutable views by splitting along a tile expression.

impl<D: Scalar, Chip: M, Element: M> HbmTensor<D, Chip, Element>

pub fn to_dm<Cluster: M, Slice: M, Element2: M>( &self, _dma: &mut DmaContext<{ Dma::Tensor }>, address: Address, ) -> DmTensor<D, Chip, Cluster, Slice, Element2>

Converts to data memory tensor.

Trait Implementations

impl<D: Debug + Scalar, Chip: Debug + M, Element: Debug + M> Debug for HbmTensor<D, Chip, Element>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<D: Scalar, Chip: M, Element: M> From<&HbmTensor<D, Chip, Element>> for Buffer

fn from(tensor: &HbmTensor<D, Chip, Element>) -> Buffer

Converts to this type from the input type.

impl<D: Scalar, Chip: M, Element: M> From<Buffer> for HbmTensor<D, Chip, Element>

fn from(buf: Buffer) -> Self

Converts to this type from the input type.