Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Backpropagation Through Time - What is backpropagation through time chain rule?

Answer

Recurrent Neural Networks (RNNs) handle sequences in an incremental fashion. The term "backpropagation through time" describes the process of reversing the direction of the gradients throughout these time steps. At the copy node, the values of the gradient with regard to the hidden state and the gradient from the prior time step are mixed.