giagrad.nn.LeakyReLU

class giagrad.nn.LeakyReLU(*args, **kwargs)

Applies element-wise \(\text{LeakyReLU}(x) = \max(0, x) + \text{negative_slope} * \min(0, x)\).

See also

giagrad.Tensor.leakyrelu()

Variables:

neg_slope (float) – Controls de angle of the negative slope (which only affects negative input values).