RWKV-GGUF - a RachidAR Collection

RachidAR 's Collections

Fine-Tuned or Trained models

Ternary LLMs & Knowledge distillation & SOTA

Papers

SOTA architecture

RWKV-GGUF

updated 29 days ago

RachidAR/RWKV-v6-Finch-1B6-HF-Q5_K_M-GGUF

Updated Sep 4 • 28 • 2

Note Works with CUDA and CPU backend
RachidAR/RWKV-v6-Finch-14B-HF-Q5_K_M-GGUF

Updated Sep 4 • 35 • 1

Note Works only with "--no-warmup" parameter.
RachidAR/RWKV-v6-Finch-7B-HF-Q5_K_M-GGUF

Updated Sep 4 • 61 • 1

Note Works only with "--no-warmup" parameter.