TensorFlow RNN models

LSTM

Modified from source 1 & 2

GRU

return_state

initial_state

Cross-batch statefulness

Source

Bidirectional RNNs

Example

Source

CuDNN performance

  • Change from the tanh activation function.
  • Change the recurrent_activation function from sigmoid.
  • Change recurrent_dropout from 0.
  • Change unroll form False.
  • Change use_bias from True.
  • If masking is used, change from right padding (discussed later).

Variable Size RNN/LSTM/GRU Time Sequence

Credits and References

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store