Training and recurrent

A Class of Normalised Algorithms for Online Training of Recurrent Neural Networks A normalised version of the real-time recurrent learning (RTRL) algorithm is introduced. This has been achieved via local linearisation of the RTRL around the current point in the state space of the network. Such an algorithm provides an adaptive learning rate normalised by the L2 norm of the gradient vector at the output neuron. The analysis is general and also covers simpler cases of feedforward networks and linear FIR filters...

12p doroxon 12-08-2010 91 16   Download