Enum ActivationOp 

pub enum ActivationOp {
    Sigmoid,
    Silu,
    Softplus,
    Gelu,
    GeluTanh,
}

Fused real-float activation applied in one elementwise pass.

The variants name the same functions the composite activation vocabulary exposes; a backend that supports the fused form computes the whole expression in one traversal instead of materializing every intermediate.

Examples

use tenferro_tensor::ActivationOp;
assert_eq!(ActivationOp::Sigmoid.label(), "sigmoid");

Variants

Sigmoid

Logistic sigmoid 1 / (1 + exp(-x)), overflow-free.

Silu

SiLU / swish x * sigmoid(x).

Softplus

Softplus max(x, 0) + log1p(exp(-|x|)).

Gelu

Exact GELU x/2 * (1 + erf(x / sqrt(2))).

GeluTanh

GELU tanh approximation x/2 * (1 + tanh(sqrt(2/pi) * (x + 0.044715 x^3))).

Trait Implementations

impl Clone for ActivationOp

fn clone(&self) -> ActivationOp

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ActivationOp

impl Debug for ActivationOp

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ActivationOp

impl PartialEq for ActivationOp

fn eq(&self, other: &ActivationOp) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ActivationOp