BEE-spoke-data/smol_llama-101M-GQA
Text Generation
•
Updated
•
4.34k
•
26
LLM training
small-scale pretraining experiments of mine
-
-
BEE-spoke-data/smol_llama-220M-GQA
Text Generation • Updated • 2.53k • 12
BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu
Text Generation • Updated • 57 • 1Note smol_llama-220M-GQA CPT on fineweb-edu for 10 billion tokens
-
BEE-spoke-data/smol_llama-81M-tied
Text Generation • Updated • 1.56k • 6 -
BEE-spoke-data/mega-ar-126m-4k
Text Generation • Updated • 3.54k • 4 -
BEE-spoke-data/verysmol_llama-v11-KIx2
Text Generation • Updated • 1.45k • 4 -
pszemraj/pythia-31m-KI_v1-2048-scratch
Text Generation • Updated • 1.45k -
BEE-spoke-data/bert-plus-L8-4096-v1.0
Fill-Mask • Updated • 3 -
BEE-spoke-data/mega-encoder-small-16k-v1
Fill-Mask • Updated • 4 • 4
BEE-spoke-data/NanoLlama-GQA-L10-A32_KV8-v13-KI
Text Generation • Updated • 10 • 1Note this is a mid-training checkpoint of what is now smol_llama-220M
-
pszemraj/jamba-900M-v0.13-KIx2
Text Generation • Updated • 78 • 4