TensorFlow BERT & Transformer Examples

  • IMDB files: Sentimental analysis with pre-trained TF Hub BERT model and AdamW,
  • GLUE/MRPC BERT finetuning,
  • Transformer for language translation.

IMDB files: Sentimental analysis with pre-trained TF Hub BERT model and AdamW

GLUE/MRPC BERT finetuning

Source
Source (Our model will have an extra [SEP] at the end of sentence B)
  • input_word_ids: the integer sequences, one integer per token,
  • input_mask: indicates whether an input token contains a padded value 0 (details later), and
  • input_type_ids: indicates whether the token i belongs to sentence 1 (value 0) or 2 (value 1).
Source
Source
Source
Source

Transformer for language translation

Source
Source
input: este é um problema que temos que resolverprediction: so this is a problem that we have to solve the global challenges

Credits and References

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store