Skip to content
Milchchan edited this page Apr 15, 2020 · 2 revisions

Weight Initializers

Activation function Initializer
Sigmoid Glorot (Xavier Initialization)
Hyperbolic tangent Glorot (Xavier Initialization)
ReLU He

Loss Functions and Activation Functions

Binary classification Multiclass classification Regression
Loss functions Binary cross-entropy Categorical cross-entropy Mean squared error
Activation functions Sigmoid Softmax Identity
Clone this wiki locally