Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,612

Full-text search

Active filters: gptq

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10 • 2.59k • 15

cookey39/Five_Phases_Mindset

Text Generation • Updated May 27 • 26 • 1

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 4.8k • 23

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 33.8k • 2

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 458 • 3

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3 • 10.5k • 3

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • Updated Jul 23 • 45 • 2

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation • Updated Jul 18 • 377 • 1

ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit

Text Generation • Updated Jul 23 • 4.74k • 4

rinna/llama-3-youko-8b-instruct-gptq

Text Generation • Updated Aug 31 • 56 • 1

ModelCloud/gemma-2-27b-it-gptq-4bit

Text Generation • Updated Jul 23 • 1.07k • 11

shuyuej/gemma-2-27b-it-GPTQ

Text Generation • Updated Sep 28 • 745 • 2

shuyuej/Meta-Llama-3.1-70B-Instruct-GPTQ

Text Generation • Updated Sep 28 • 121 • 3

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 57.4k • 18

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 22.7k • 20

TechxGenus/Mistral-Large-Instruct-2407-GPTQ

Text Generation • Updated Jul 27 • 641 • 2

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 29 days ago • 10.7k • 21

shuyuej/SFR-Embedding-2_R-GPTQ

Feature Extraction • Updated about 19 hours ago • 274 • 1

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 21k • 25

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8

Updated Aug 7 • 53 • 1

alpindale/Meta-Llama-3.1-70B-Instruct-GPTQ-INT8

Updated Aug 13 • 2.24k • 2

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 132k • 25

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 51.7k • 13

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 6.34k • 9

alexwww94/glm-4v-9b-gptq-4bit

Updated Sep 9 • 281 • 6

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 24 • 57k • 12

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24 • 3.19k • 7

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19 • 3.32k • 2

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.76k • 5

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18 • 51.1k • 9