Train a GPT2 text generating model for English


Codes for training a GPT2 text generating model for English

Published by Haerim Hwang

GPT2 text generation natural language processing google colab python

0 min READ

  • This script creates a GPT2 text generating model. We use Google Colab for the script, which allows us to use GPU instead of CPU.


  • Click HERE for the Python script in Google Colab.

  • These codes were revised based on the following references.
    https://colab.research.google.com/github/sarthakmalik/GPT2.Training.Google.Colaboratory/blob/master/Train_a_GPT_2_Text_Generating_Model_w_GPU.ipynb#scrollTo=6OFnPCLADfll