Bonsai Reasoning - a vashistht Collection

vashistht 's Collections

Bonsai Reasoning

Wanda Sweeps (Unstructured Sparsity 0.1 to 0.9 + 2:4 0.5)

Bonsai Reasoning

updated Apr 25

Working on improving reasoning of Bonsai Paper.

Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes

Paper • 2402.05406 • Published Feb 8
luciodery/Bonsai-PrunedPhi-1.8B

Updated Feb 12 • 78 • 1

Note Original Model with 10 iterations to get 50% sparsity
vashistht/bonsai-reasoning-adapter_prune_c4_ft_wiki

Updated Apr 24

Note Finetuned Bonsai (pruned on C4) on Wikitext