Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

8,926

Full-text search

Active filters: gguf-my-repo

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 4.98k • 18

Karsh-CAI/Qwen2.5-32B-AGI-Q4_K_M-GGUF

Updated Sep 21 • 4.73k • 22

Orion-zhen/Meissa-Qwen2.5-14B-Instruct-Q6_K-GGUF

Updated 27 days ago • 366 • 2

VongolaChouko/Starcannon-Unleashed-12B-v1.0-GGUF

Updated 19 days ago • 4.02k • 10

HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated 16 days ago • 5.5k • 28

CronoBJS/LLaMA-Mesh-Q6_K-GGUF

Text Generation • Updated 2 days ago • 104 • 2

fuzzy-mittenz/Sakura_Warding-Qw2.5-7B-Q4_K_M-GGUF

Updated about 11 hours ago • 25 • 2

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

Updated Apr 5 • 1.28k • 1

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5 • 797 • 2

DavidAU/HelpingAI-Lite-4x1b-Q6_K-GGUF

Updated Apr 9 • 7 • 1

gate369/Bitnet-M7-70m-Q8_0-GGUF

Updated Apr 15 • 44 • 1

noxinc/phi-3-portuguese-tom-cat-4k-instruct-Q4_K_M-GGUF-PTBR

Text Generation • Updated May 1 • 12 • 1

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated Jul 3 • 2.8k • 50

TouchNight/Yi-9B-200K-AEZAKMI-RAW-TOXIC-1-Q6_K-GGUF

Updated May 21 • 5 • 1

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated Jun 12 • 85 • 4

HDiffusion/Llama3-8b-CunnyGPT-16bit-Q4_K_M-GGUF

Updated Jun 13 • 126 • 2

mobeetle/Saul-7B-Instruct-v1-Q4_K_M-GGUF

Updated Jun 20 • 24 • 1

huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF

Updated Jul 3 • 65 • 3

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8 • 32 • 1

xiaoshuai111/llama3-8b-Lawyer-v2-Q4_0-GGUF

Text Generation • Updated Jul 15 • 803 • 2

xiaoshuai111/lawyer-llama-13b-v2-Q4_0-GGUF

Updated Aug 28 • 640 • 3

ooff123/lawyer-llama-13b-v2-Q4_K_M-GGUF

Updated Jul 26 • 65 • 3

iG8R/t5_translate_en_ru_zh_large_1024_v2-Q8_0-GGUF

Translation • Updated Jul 26 • 102 • 3

ooff123/DISC-LawLLM-Q4_K_M-GGUF

Updated Jul 27 • 12 • 2

ooff123/lawyer-llama-13b-v2-Q4_K_S-GGUF

Updated Jul 28 • 10 • 1

PabloSuaLap/llama-3.1-8b-instruct-reglamentacion-V1-Q4_K_M-GGUF

Text Generation • Updated Jul 30 • 12 • 1

kpranav22/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 1 • 39 • 1

cyanic-selkie/flan-t5-small-Q4_K_M-GGUF

Text2Text Generation • Updated Aug 5 • 33 • 1

ysn-rfd/gpt2-Q8_0-GGUF

Updated 27 days ago • 53 • 1

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 2 • 1.21k • 9