Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

845

Full-text search

Active filters: imatrix

bartowski/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Aug 3 • 13.4k • 29

dahara1/gemma-2-27b-it-gguf-japanese-imatrix

Updated Sep 24 • 496 • 13

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

Updated Oct 20 • 1.15k • 3

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

Updated Aug 2 • 805 • 2

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

Updated Aug 2 • 664 • 3

THUDM/codegeex4-all-9b-GGUF

Text Generation • Updated Jul 15 • 721 • 9

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14 • 1.36k • 11

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 2.92k • 8

arcee-ai/Arcee-Scribe-GGUF

Updated Jul 17 • 213 • 11

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.83M • 5

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.85M • 32

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated 17 days ago • 20.6k • 48

bartowski/Arcee-Nova-GGUF

Text Generation • Updated Jul 19 • 437 • 4

bartowski/turbcat-instruct-72b-GGUF

Text Generation • Updated Jul 22 • 176 • 2

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2 • 1.17k • 6

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 824 • 5

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.85M • 37

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 1.08k • 11

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • Updated Jul 25 • 1.58k • 28

lmstudio-community/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Aug 29 • 703 • 13

bartowski/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Text Generation • Updated Jul 28 • 16.9k • 6

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25 • 4.19k • 3

Reiterate3680/Sekhmet_Bet-L3.1-8B-v0.2-GGUF

Text Generation • Updated Aug 6 • 34 • 1

mradermacher/Meta-Llama-3.1-8B-Instruct-i1-GGUF

Updated Aug 2 • 550 • 3

mradermacher/Meta-Llama-3.1-Chat-Uncensored-i1-GGUF

Updated Aug 2 • 924 • 2

mradermacher/Meta-Llama-3.1-70B-Instruct-i1-GGUF

Updated Aug 2 • 870 • 2

mradermacher/Nemomix-v4.0-12B-i1-GGUF

Updated Jul 31 • 270 • 6

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • Updated Jul 31 • 12.5k • 17

ThomasBaruzier/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 17 • 475 • 1

legraphista/Palmyra-Fin-70B-32K-IMat-GGUF

Text Generation • Updated Aug 2 • 1.59k • 7