Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

4,068

Full-text search

Active filters: pt

mradermacher/Crimson_Dawn-V0.1-i1-GGUF

Updated Aug 17 • 546 • 2

rktmeister/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 17 • 10

bartowski/Crimson_Dawn-V0.1-GGUF

Text Generation • Updated Aug 17 • 198 • 3

aftersoft/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 17 • 59

ek826/Meta-Llama-3.1-405B-Instruct-4.25bpw-gqa-exl2

Text Generation • Updated Aug 17 • 9 • 1

AvantgardaQalbuPernada/Equinox

irresistiblegrace97/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 18 • 12

ghost-x/ghost-8b-beta-1608-awq

Text Generation • Updated Aug 23 • 25

Triangle104/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

Updated 1 day ago • 8

Triangle104/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

Updated 1 day ago • 40

Triangle104/Mistral-Nemo-Instruct-2407-Q6_K-GGUF

Updated 1 day ago • 35

Triangle104/Mistral-Nemo-Instruct-2407-Q8_0-GGUF

Updated 1 day ago • 33

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • Updated Aug 26 • 388 • 4

teddylee777/ghost-8b-beta-1608-gguf

Text Generation • Updated Aug 18 • 181 • 1

Epiculous/Azure_Dusk-v0.1

Text Generation • Updated Aug 24 • 13 • 5

Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 18 • 18 • 1

lanok/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 19 • 31

antoste/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Aug 19 • 24

mudler/Llama-3.1-Storm-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 121

Mozilla/Mistral-Nemo-Instruct-2407-llamafile

Updated Aug 20 • 932 • 6

mbuali/Llama-3.1-8B-DALv0.1

Text Generation • Updated Aug 19 • 5

Cran-May/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 15

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated 30 days ago • 478 • 2

wgtcarlos/gmalogo

anthracite-org/magnum-v2-72b-gguf

Text Generation • Updated Sep 26 • 1.32k • 2

Proverbial1/magnum-v2-123b_exl2_5.0bpw_h8

Text Generation • Updated Aug 20 • 10

realsaturnapp/testplanner3-llama3.1

Text Generation • Updated Aug 22 • 10

voxmenthe/Llama-3.1-Storm-8B

Text Generation • Updated Aug 20 • 13

goodasdgood/Mistral-Nemo-Base-2407-Q4_K_M-GGUF

Updated Aug 20 • 4

fsaudm/Meta-Llama-3.1-8B-Instruct-INT8

Text Generation • Updated Aug 21 • 8