giagrad.nn.SiLU

class giagrad.nn.SiLU(*args, **kwargs)

Applies the Sigmoid Linear Unit (SiLU) function, element-wise.

See also

giagrad.Tensor.silu()

Variables:

beta (float) – Hyperparameter for SiLU formulation.