oneflow.nn.functional.square_relu¶
-
oneflow.nn.functional.square_relu(x: Tensor) → Tensor¶ Applies the relu^2 activation introduced in https://arxiv.org/abs/2109.08668v2
\[\begin{split}\\text{ReLU}(x) = \\max(0, x) * \\max(0, x)\end{split}\]- Parameters
input (oneflow.Tensor) – Input Tensor
- Returns
A Tensor has same shape as the input.
- Return type
See
SquareReLUfor more details.