Deep.Net


ActivationFunc

Namespace: Models

Activation function expressions.

Functions and values

Function or valueDescription
apply af x
Signature: af:ActivationFunc -> x:ExprT -> ExprT

applies the specified activation function

id x
Signature: x:ExprT -> ExprT

identity activation function

logSoftmax x
Signature: x:ExprT -> ExprT

Natural logarithm of soft-max activation function. The second dimension enumerates the possible classes.

relu x
Signature: x:ExprT -> ExprT

Rectifier Unit function: max(x, 0)

sigmoid x
Signature: x:ExprT -> ExprT

sigmoid activation function

softmax x
Signature: x:ExprT -> ExprT

Soft-max activation function. The second dimension enumerates the possible classes.

tanh x
Signature: x:ExprT -> ExprT

tanh activation function

Fork me on GitHub