Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

845

Full-text search

Active filters: imatrix

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 12 • 1.59k • 20

lmstudio-community/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 13 • 345 • 9

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • Updated May 15 • 188 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 1.97M • 63

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 8.27k • 25

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 3.08k • 42

lmstudio-community/aya-23-8B-GGUF

Text Generation • Updated May 23 • 1.94k • 6

cognitivecomputations/dolphin-2.9.2-qwen2-72b-gguf

Updated May 29 • 2.52k • 17

mradermacher/quill-72b-instruct-i1-GGUF

Updated Aug 2 • 427 • 4

mradermacher/L3-8B-Stheno-v3.2-i1-GGUF

Updated Aug 2 • 1.82k • 10

bartowski/Codestral-22B-v0.1-abliterated-v3-GGUF

Text Generation • Updated Jun 5 • 630 • 10

mradermacher/JailbrokeAI-i1-GGUF

Updated Aug 2 • 454 • 1

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Aug 21 • 14.4k • 60

Qwen/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 21 • 8.52k • 167

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.13M • 9

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.12M • 8

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 7 • 313 • 13

bartowski/dolphin-2.9.2-qwen2-72b-GGUF

Text Generation • Updated Jun 11 • 363 • 3

duyntnet/pygmalion-2-7b-imatrix-GGUF

Text Generation • Updated Jun 13 • 139 • 1

mradermacher/L3-70B-Euryale-v2.1-i1-GGUF

Updated Aug 2 • 2.23k • 21

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • Updated Jun 17 • 1.44k • 4

dreamgen/opus-v1.4-70b-llama3-gguf

Text Generation • Updated Jun 19 • 4.43k • 4

mradermacher/DeepSeek-Coder-V2-Instruct-i1-GGUF

Updated Aug 2 • 50 • 6

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

Updated Aug 2 • 414 • 1

lmstudio-community/Qwen2-500M-Instruct-GGUF

Text Generation • Updated Jun 24 • 181 • 6

bartowski/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Text Generation • Updated Jun 24 • 1.15k • 23

bartowski/Replete-Coder-Llama3-8B-GGUF

Text Generation • Updated Jun 24 • 854 • 15

mradermacher/L-MChat-7b-i1-GGUF

Updated Aug 2 • 115 • 1

grapevine-AI/gemma-2-27b-it-gguf

Updated 26 days ago • 1.26k • 12

duyntnet/Silicon-Maid-7B-imatrix-GGUF

Text Generation • Updated Jul 2 • 4.35k • 4