the activation function applies to the input matrix.
the activation function applies to the input matrix.
derivative of the activation function
derivative of the activation function
The derivative of the softmax function is a jacobian and has a 2-d matrix form.