Generating rap lyrics from using artist name and song title
GPT2 finetuned on over 10000 songs from multiple artists using google cloud TPU-VM using JAX
The model has been deployed as a demo on huggingface spaces . Checkout the demo - click here
The dataset used for training can be found here
You can even use this google colab notebook for making predictions click here
For the entire code with model file also available checkout the huggingface repository here
- run_clm_flax.py contains the training script
- run.sh can be used to run the training script and the hyperparameters can be directly specified there
- genius.py contains the file to download songs from genius.com