-
-
-
-
-
-
Inference status
Active filters:
gptq
AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
126
•
5
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
73.5k
•
9
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
12.2k
•
17
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
•
173
•
104
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
23.3k
•
8
AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
82
•
3
TheBloke/WizardLM-7B-uncensored-GPTQ
Text Generation
•
Updated
•
671
•
189
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
Updated
•
139k
•
261
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
7.84k
•
8
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
29.2k
•
22
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8
Text Generation
•
Updated
•
7.13k
•
6
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5
Text Generation
•
Updated
•
6
•
2
TheBloke/stable-vicuna-13B-GPTQ
Text Generation
•
Updated
•
80
•
219
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
8.43k
•
319
TheBloke/WizardLM-30B-Uncensored-GPTQ
Text Generation
•
Updated
•
94
•
118
TheBloke/guanaco-7B-GPTQ
Text Generation
•
Updated
•
68
•
28
TheBloke/gorilla-7B-GPTQ
Text Generation
•
Updated
•
74
•
26
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
Updated
•
935
•
563
TheBloke/WizardLM-Uncensored-Falcon-40B-GPTQ
Text Generation
•
Updated
•
41
•
59
TheBloke/Nous-Hermes-13B-GPTQ
Text Generation
•
Updated
•
284
•
175
TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
389
•
142
TheBloke/Wizard-Vicuna-7B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
90
•
16
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation
•
Updated
•
15.5k
•
362
TheBloke/Llama-2-70B-Chat-GPTQ
Text Generation
•
Updated
•
9.26k
•
260
TheBloke/airoboros-l2-13b-gpt4-m2.0-GPTQ
Text Generation
•
Updated
•
51
•
29
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
Updated
•
6.41k
•
185
TheBloke/CodeLlama-7B-Instruct-GPTQ
Text Generation
•
Updated
•
34.1k
•
46
TheBloke/Mythalion-13B-GPTQ
Text Generation
•
Updated
•
330
•
53
TheBloke/Chronos-70B-v2-GPTQ
Text Generation
•
Updated
•
30
•
11
TheBloke/Falcon-180B-Chat-GPTQ
Text Generation
•
Updated
•
2.48k
•
69