giagrad.nn.Mish

class giagrad.nn.Mish(*args, **kwargs)

Applies Mish activation function element-wise.

See also

giagrad.Tensor.mish()

Variables:

• beta (float) – The \(\beta\) value for the Softplus formulation.

• limit (float) – Data times beta above limit reverts to a linear function in Softplus formulation.