Edit Models filters

Model Tree

Qwen/Qwen2.5-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

90

Full-text search

Active filters: Qwen/Qwen2.5-7B-Instruct

Triangle104/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 19 • 6

DrNicefellow/Qwen2.5-7B-Instruct-4.0bpw-exl2

Updated Sep 20 • 4

DrNicefellow/Qwen2.5-7B-Instruct-8.0bpw-h8-exl2

Updated Sep 20 • 5 • 1

DrNicefellow/Qwen2.5-7B-Instruct-7.0bpw-exl2

Updated Sep 20 • 6

DrNicefellow/Qwen2.5-7B-Instruct-6.0bpw-exl2

Updated Sep 20 • 4

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20 • 3

DrNicefellow/Qwen2.5-7B-Instruct-2.0bpw-exl2

Updated Sep 20 • 10

DrNicefellow/Qwen2.5-7B-Instruct-1.0bpw-exl2

Updated Sep 20 • 5

DrNicefellow/Qwen2.5-7B-Instruct-5.5bpw-exl2

Updated Sep 20 • 5

DrNicefellow/Qwen2.5-7B-Instruct-4.5bpw-exl2

Updated Sep 20 • 7

raaedk/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 5

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21 • 17 • 1

mukel/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 27 • 30

idasummer/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 24 • 4

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

Updated 3 days ago • 10

QuantFactory/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Sep 25 • 283 • 1

mradermacher/Qwen2.5-7B-Instruct-GGUF

Updated Oct 11 • 326 • 2

mradermacher/Qwen2.5-7B-Instruct-i1-GGUF

Updated Oct 11 • 331 • 1

aswqazx/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 27 • 5

Kondara/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27 • 6

Kondara/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28 • 12

VPTQ-community/Qwen2.5-7B-Instruct-v16-k65536-65536-woft

Updated 3 days ago • 57 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

Updated 3 days ago • 13

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

Updated 3 days ago • 20

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

Updated 3 days ago • 127

mashima/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 1 • 7

QuantFactory/Replete-LLM-V2.5-Qwen-7b-GGUF

Updated Oct 2 • 106 • 1

Kotokin/Replete-LLM-V2.5-Qwen-7b-exl2-4bpw

Text Generation • Updated Oct 1 • 13

jacobcarajo/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2 • 5

redhat6/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4 • 7