Three Out-Of-The-Box Transformer Models

> Text Summaries with T5> Sentiment Analysis with BERT> Language Generation with GPT-2

Summarization with T5

In-Full

  • Tokenization of text to input IDs
  • Processing by the T5 model
  • Decoding of the model outputs back to text

Text Classification with BERT

  • Preprocessing (including tokenization) of the data
  • Training of the model
  • Classification of test/real data using the model

Model

Pre-Processing

Train and Predict

Language Generation with GPT-2

Model

  • Tokenization of text to input IDs
  • Generation of language by the GPT-2 model
  • Decoding of the model output back to text

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store