Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,463

Full-text search

Active filters: chat

wordslab-org/Qwen2.5-Coder-3B-Instruct-FP8-Dynamic

Text Generation • Updated 4 days ago • 7

mradermacher/Qwen2.5-72B-0.6x-Instruct-i1-GGUF

Updated 4 days ago • 497

tensorblock/SkkuDataScience-DPO-v2-440-ckpt-GGUF

Text Generation • Updated 4 days ago • 170

mradermacher/CodeQwen1.5-7B-Chat-i1-GGUF

Updated 4 days ago • 461

mav23/Llama3.1-70B-ShiningValiant2-GGUF

Text Generation • Updated 4 days ago • 315

mradermacher/Qwen1.5-7B-Chat-i1-GGUF

Updated 4 days ago • 532

mradermacher/Qwen2-Math-1.5B-Instruct-i1-GGUF

Updated 4 days ago • 518

Triangle104/magnum-v4-27b-Q4_K_S-GGUF

Text Generation • Updated 4 days ago • 23

Triangle104/magnum-v4-27b-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 25

Triangle104/magnum-v4-27b-Q5_K_S-GGUF

Text Generation • Updated 4 days ago • 26

Triangle104/magnum-v4-27b-Q5_K_M-GGUF

Text Generation • Updated 4 days ago • 21

Triangle104/magnum-v4-27b-Q6_K-GGUF

Text Generation • Updated 4 days ago • 26

Triangle104/magnum-v4-27b-Q8_0-GGUF

Text Generation • Updated 4 days ago • 30

mradermacher/Qwen2-Math-7B-Instruct-GGUF

Updated 4 days ago • 272

mradermacher/Qwen2-Math-7B-Instruct-i1-GGUF

Updated 4 days ago • 493

mlx-community/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-8bit

Text Generation • Updated 4 days ago • 7

mlx-community/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-4bit

Text Generation • Updated 4 days ago • 5

mlx-community/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-float16

Text Generation • Updated 4 days ago • 11

mlx-community/Josiefied-Qwen2.5-0.5B-Instruct-abliterated-v1-float32

Text Generation • Updated 4 days ago • 5

DongfuJiang/Qwen2.5-0.5B-Instruct

Text Generation • Updated 4 days ago • 151

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q5_K_M-GGUF

Text Generation • Updated 4 days ago • 24

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q5_K_S-GGUF

Text Generation • Updated 4 days ago • 21

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q5_0-GGUF

Text Generation • Updated 4 days ago • 21

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 38

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q4_K_S-GGUF

Text Generation • Updated 4 days ago • 22

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q4_0-GGUF

Text Generation • Updated 4 days ago • 37

BenevolenceMessiah/Qwen2.5-Coder-32B-Instruct-abliterated-Q3_K_L-GGUF

Text Generation • Updated 4 days ago • 21

DrNicefellow/Qwen2.5-Coder-32B-Instruct-4.25bpw-exl2

Text Generation • Updated 4 days ago • 2

MarsupialAI/Monstral-123B_3.5bpw_EXL2

Text Generation • Updated 4 days ago • 5

mradermacher/Qwen2.5-1.5B-ultrachat200k-GGUF

Updated 3 days ago • 287