giagrad.nn.GELU

class giagrad.nn.GELU(*args, **kwargs)

Applies element-wise the function \(\text{GELU}(x) = x \times \Phi(x)\).

See also

giagrad.Tensor.gelu()