Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,634

Full-text search

Active filters: imatrix

bartowski/SuperNova-Medius-GGUF

Text Generation • Updated 27 days ago • 19.5k • 35

bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • Updated 15 days ago • 24.3k • 14

bartowski/gemma-2-9b-it-abliterated-GGUF

Text Generation • Updated Oct 7 • 5.85k • 19

Lewdiculous/MN-12B-Lyra-v4-GGUF-IQ-Imatrix

Updated Sep 10 • 8.01k • 16

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 37.3k • 36

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 124k • 69

bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated 25 days ago • 188k • 77

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Sep 3 • 15.3k • 116

Lewdiculous/Llama-3.1-8B-Stheno-v3.4-GGUF-IQ-Imatrix

Updated Sep 3 • 3.31k • 19

Epiculous/Violet_Twilight-v0.2-GGUF

Text Generation • Updated 27 days ago • 74.8k • 12

bartowski/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 23.9k • 29

bartowski/Qwen2.5-14B_Uncensored_Instruct-GGUF

Text Generation • Updated Sep 22 • 27.3k • 22

Lewdiculous/Llama-3.1-8B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

Updated 16 days ago • 27k • 5

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated Jun 5 • 649 • 10

Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 21 • 8.16k • 167

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

Updated 20 days ago • 1.06k • 2

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3 • 44.6k • 117

mradermacher/Chronos-Gold-12B-1.0-i1-GGUF

Updated Sep 16 • 51.1k • 8

bartowski/c4ai-command-r-plus-08-2024-GGUF

Text Generation • Updated Aug 30 • 3.44k • 15

Epiculous/Azure_Dusk-v0.2-GGUF

Text Generation • Updated Sep 11 • 635 • 7

bartowski/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • Updated Sep 13 • 8.2k • 8

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 15.4k • 21

mradermacher/Llama-3.1-8B-Lexi-Uncensored-V2-i1-GGUF

Updated Sep 27 • 1.28k • 4

grapevine-AI/EZO-Qwen2.5-72B-Instruct-GGUF

Updated Sep 29 • 294 • 4

bartowski/Llama-3.1-8B-Stheno-v3.4-GGUF

Text Generation • Updated Sep 30 • 2.01k • 2

bartowski/MSM-MS-Cydrion-22B-GGUF

Text Generation • Updated Oct 4 • 2.18k • 4

grapevine-AI/gemma-2-9b-it-SimPO-GGUF

Updated 28 days ago • 455 • 4

mradermacher/writing-roleplay-20k-context-nemo-12b-v1.0-i1-GGUF

Updated 26 days ago • 2.03k • 4

bartowski/NuExtract-v1.5-GGUF

Text Generation • Updated 26 days ago • 17.9k • 7

bartowski/G2-DA-Nyxora-27b-V2-GGUF

Text Generation • Updated 17 days ago • 911 • 2