NN_silu()

void NN_silu	(	Tensor *	y,
		const Tensor *	x
	)

Applies the Sigmoid Linear Unit (SiLU) function, element-wise.

The SiLU function is also known as the swish function.

y = silu(x) = x * theta(x), where theta(x) is the logistic sigmoid.

Parameters

y	the output tensor
x	the input tensor