Enum CpuVendorBatch 

#[non_exhaustive]
pub enum CpuVendorBatch {
    Allowed {
        max_item_dim: usize,
    },
    Required,
    Forbidden,
}

Whether a provider may, must, or must not execute a batch of GEMMs with one vendor batch call (cblas_?gemm_batch).

The engine resolves this from the effective crate::CpuBatchPolicy before any output write. A provider without a vendor batch routine treats Self::Allowed and Self::Forbidden alike and reports CpuProviderUnsupported::RuntimeUnavailable for Self::Required.

Examples

use tenferro_cpu::provider::CpuVendorBatch;

let allowed = CpuVendorBatch::Allowed { max_item_dim: 16 };
assert!(allowed.permits([[4, 4, 4], [8, 8, 8]]));
assert!(!allowed.permits([[4, 4, 32], [8, 8, 8]]));
assert!(!CpuVendorBatch::Forbidden.permits([[1, 1, 1], [1, 1, 1]]));

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Allowed

Use a vendor batch call when there is more than one item and every item’s m, n and k are at most max_item_dim.

Fields

max_item_dim: usize

Largest per-item dimension for which a vendor batch call is used.

Required

Execute the whole batch with one vendor batch call.

Forbidden

Never use a vendor batch call.

Implementations

impl CpuVendorBatch

pub fn permits(self, dims: impl IntoIterator<Item = [usize; 3]>) -> bool

Whether this control selects a vendor batch call for GEMMs of the given [m, n, k] dimensions; Self::Required always does.

Examples

use tenferro_cpu::provider::CpuVendorBatch;
assert!(CpuVendorBatch::Required.permits([[64, 64, 64]]));

Trait Implementations

impl Clone for CpuVendorBatch

fn clone(&self) -> CpuVendorBatch

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CpuVendorBatch

impl Debug for CpuVendorBatch

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CpuVendorBatch

fn default() -> Self

Returns the “default value” for a type.

impl Eq for CpuVendorBatch

impl PartialEq for CpuVendorBatch

fn eq(&self, other: &CpuVendorBatch) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CpuVendorBatch