Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ezelikman
/
quietstar-8-ahead
like
87
Text Generation
Transformers
Safetensors
open-web-math/open-web-math
mistral
text-generation-inference
Inference Endpoints
arxiv:
2403.09629
Model card
Files
Files and versions
Community
4
Train
Deploy
Use this model
ezelikman
commited on
Mar 23
Commit
f86e33e
•
1 Parent(s):
fdd9b3e
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+6
-0
README.md
ADDED
Viewed
@@ -0,0 +1,6 @@
1
+
---
2
+
datasets:
3
+
- open-web-math/open-web-math
4
+
---
5
+
6
+
Mistral-7b with continued pretraining using Quiet-STaR (https://arxiv.org/abs/2403.09629) for generating 8 thought tokens before each output token.