au.id.cxd.math.model.network.initialisation
RandomWeightInitialisation
Related Docs:
object RandomWeightInitialisation
| package initialisation
simple weight initialisation choosing a random double between 0 and 1.0
Some suggested initialisations are:
$$ W_{i,j} = U(-1/\sqrt{m}, 1/\sqrt{m}) $$
Where $m$ is the number of columns in the input layer.
$$ W_{i,j} = U(-\sqrt{6/(m+n), \sqrt{6/(m+n)}) $$
Where $m$ is the number of columns in the input layer and $n$ the number of rows in the data.