Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,460

Full-text search

Active filters: chat

mradermacher/Llama3.1-70B-PlumChat-i1-GGUF

Updated 2 days ago • 612

Volko76/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • Updated 3 days ago • 157

sizhkhy/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 3 days ago • 10

mradermacher/Qwen1.5-14B-Chat-GGUF

Updated 3 days ago • 263

Volko76/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated 3 days ago • 121

mradermacher/Qwen1.5-14B-Chat-i1-GGUF

Updated 3 days ago • 567

Apel-sin/qwen2.5-coder-14b-instruct-abliterated-exl2

Text Generation • Updated 3 days ago • 2

Apel-sin/qwen2.5-14b-instruct-abliterated-v2-exl2

Text Generation • Updated 3 days ago • 4

mradermacher/Qwen1.5-22B-Chat-Merge-GGUF

Updated 3 days ago • 254

Triangle104/Qwen2.5-14B-Instruct-abliterated-v2-Q4_K_S-GGUF

Text Generation • Updated 3 days ago • 24

Triangle104/Qwen2.5-14B-Instruct-abliterated-v2-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 27

Triangle104/Qwen2.5-14B-Instruct-abliterated-v2-Q5_K_S-GGUF

Text Generation • Updated 3 days ago • 24

Triangle104/Qwen2.5-14B-Instruct-abliterated-v2-Q5_K_M-GGUF

Text Generation • Updated 3 days ago • 50

Triangle104/Qwen2.5-14B-Instruct-abliterated-v2-Q6_K-GGUF

Text Generation • Updated 3 days ago • 28

Triangle104/Qwen2.5-14B-Instruct-abliterated-v2-Q8_0-GGUF

Text Generation • Updated 3 days ago • 27

Shamil12/Qwen2.5-Math-1.5B-Instruct-Q2_K-GGUF

Text Generation • Updated 3 days ago • 23

mav23/Qwen2.5-3B-Instruct-abliterated-GGUF

Text Generation • Updated 3 days ago • 376

Model-SafeTensors/Qwen2.5-Coder-32B-Instruct

Text Generation • Updated 3 days ago

Model-SafeTensors/magnum-v2-72b

Text Generation • Updated Oct 12

eligapris/Qwen2.5-Coder-32B-Instruct-Q2_K-GGUF

Text Generation • Updated 2 days ago • 23

billatsectorflow/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4-128K

Text Generation • Updated 2 days ago • 18

Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated 1 day ago • 40

Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 1 day ago • 24

Triangle104/Qwen2.5-Coder-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 22

Triangle104/Qwen2.5-Coder-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 2 days ago • 22

Triangle104/Qwen2.5-Coder-3B-Instruct-Q6_K-GGUF

Text Generation • Updated 2 days ago • 23

Triangle104/Qwen2.5-Coder-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 2 days ago • 26

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated 2 days ago • 25

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated 2 days ago • 24

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated 2 days ago • 27