LSTM There are mainly two different types of units used to build a recurrent neural network: LSTMs (Long Short Term Memory) and GRUs (Gated Recurrent Unit).
what troubled me most was going through the BPTT calculations and its implementation. RNNs are called recurrent because they perform the same task for every element of a sequence, with the output being depended on the previous computations.