| license: apache-2.0 | |
| datasets: | |
| - EleutherAI/pile | |
| This model is part of an intervention study done in the paper [Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling](https://arxiv.org/abs/2304.01373) where we replaced all masculine pronouns with femanine ones and retrained the model for the last 21 billion tokens. The regular model can be found [here](https://huggingface.co/EleutherAI/pythia-410m-deduped). | |
| **We do not recommend using this model for any purpose other than to study the influence of gender pronouns on language model behavior.** |