Edit Models filters

Model Tree

Qwen/Qwen2.5-72B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

50

Full-text search

Active filters: Qwen/Qwen2.5-72B-Instruct

VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-256-woft

Updated 3 days ago • 22 • 4

VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-65536-woft

Updated 3 days ago • 22 • 1

gghfez/Magnum-v1-72b-Qwen2.5-exl2-4.5bpw

Updated Oct 2 • 4

gghfez/Magnum-v1-72b-Qwen2.5-exl2-8.0bpw

Updated Oct 2 • 5

mlc-ai/Qwen2.5-72B-Instruct-q4f32_1-MLC

Updated Oct 3 • 5

Kotokin/Magnum-v1-72b-Qwen2.5-5bpw

Updated Oct 4 • 7

mav23/Rombos-LLM-V2.5-Qwen-72b-GGUF

Updated Oct 14 • 37

GGorman/Qwen2.5-72B-Instruct-Q8-mlx

Text Generation • Updated Oct 19 • 10

CED6688/magnum-v4-72b-AWQ

Text Generation • Updated 27 days ago • 53

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.5bpw

Text Generation • Updated 19 days ago • 5

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.25bpw

Text Generation • Updated 19 days ago • 4

async0x42/Magnum-v1-72b-Qwen2.5-exl2_3.50bpw

Updated 18 days ago • 11

async0x42/Magnum-v1-72b-Qwen2.5-exl2_3.25bpw

Updated 18 days ago • 7

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • Updated 18 days ago • 72

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • Updated 18 days ago • 147

XelotX/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated 15 days ago • 66

LatentWanderer/Rombos-LLM-V2.5-Qwen-72b-6.5bpw-h8-exl2

Text Generation • Updated 9 days ago • 2

bullerwins/Athene-V2-Chat-exl2_4.0bpw

Text Generation • Updated 5 days ago • 21

bullerwins/Athene-V2-Chat-exl2_5.0bpw

Text Generation • Updated 5 days ago • 10

bullerwins/Athene-V2-Chat-exl2_6.0bpw

Text Generation • Updated 4 days ago • 15