README.md

---
license: mit
datasets:
- chloeliu/reddit_nosleep_posts
language:
- en
tags:
- fun
- horror
- writing
widget:
- text: "[WP] We don't go to ravenholm anymore [RESPONSE] "
  example_title: "Ravenholm"
- text: "[WP] The man in the corner of my window [RESPONSE] "
  example_title: "The man in the corner"
co2_eq_emissions:
  emissions: 70
  source: "https://mlco2.github.io/impact/#compute"
  training_type: "fine-tuning"
  geographical_location: "Oregon, USA"
  hardware_used: "1x T4, Google Colab"
---

# GPT-NoSleep-1.5b
This is the largest release of GPT-NoSleep; a finetuned version of [GPT2-XL](https://huggingface.co/gpt2-xl) on the 'reddit-nosleep-posts' dataset.
Smaller releases include:
 * [GPT-NoSleep-355m](https://huggingface.co/DarwinAnim8or/GPT-NoSleep-355m)

And the accompanying prompt generator can be found here:
 * [Space for prompt generation](https://huggingface.co/spaces/DarwinAnim8or/NoSleepWritingPromptGenerator)
 * [The model](https://huggingface.co/DarwinAnim8or/NoSleepPromptGen)

# Training Procedure
This was trained on the 'reddt-nosleep-posts' dataset, on Google Colab.
This model was trained for 2 epochs with learning rate 1e-2.
Special thanks for Skyler for helping to train this large of a model!

# Biases & Limitations
This likely contains the same biases and limitations as the original GPT2 that it is based on, and additionally heavy biases from the dataset.
It can generate output that is not meant for all audiences, seeing as it's purpose is to generate horror stories. 

# Intended Use
This model is meant for fun, nothing else.