Edit Models filters

Model Tree

Qwen/Qwen2-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

71

Full-text search

Active filters: Qwen/Qwen2-7B-Instruct

CHE-72/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 21 • 6

CHE-72/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jun 21 • 3

CHE-72/Qwen2-7B-Instruct-Q5_0-GGUF

Text Generation • Updated Jun 21 • 10

CHE-72/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 21 • 2

CHE-72/Qwen2-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 21 • 9

CHE-72/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 21 • 8

CHE-72/Qwen2-7B-Instruct-Q3_K_L-GGUF

Text Generation • Updated Jun 21 • 8

CHE-72/Qwen2-7B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jun 21 • 12

CHE-72/Qwen2-7B-Instruct-Q3_K_S-GGUF

Text Generation • Updated Jun 21 • 5

CHE-72/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Jun 21 • 5

CHE-72-ZLab/Alibaba-Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 23 • 59

Minuano/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 10 • 6

martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 11 • 2

PrunaAI/Qwen-Qwen2-7B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 13 • 12

PrunaAI/Qwen-Qwen2-7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13 • 10

Kondara/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 26 • 4

TAYUCOKI/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 29

nguyenphuthien/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 30 • 9

TrentJohnsongtri/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 30 • 3

blogcncom/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 5 • 53

yashagra/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 8 • 16

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20 • 1.14k

ysn-rfd/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 17

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Sep 17 • 6

Junrui2021/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 11 • 1

noway-wf/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24

Triangle104/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24 • 12 • 1

Triangle104/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 24 • 1

Triangle104/Qwen2-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Aug 24 • 6

Triangle104/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Aug 24 • 6