Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,035

Full-text search

Active filters: 8-bit

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 3 days ago • 6.74k • 7

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Jul 1 • 612 • 16

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated 2 days ago • 886 • 3

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated 5 days ago • 51 • 2

ParasiticRogue/Instant-RP-Noodles-12B-v1.4-exl2-8.0

Text Generation • Updated 3 days ago • 33 • 2

Doctor-Shotgun/limarpv3-yi-llama-34b-lora

Text Generation • Updated Jan 8 • 8 • 10

alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit

Text Generation • Updated Apr 2 • 19 • 2

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 1.66k • 114

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 2.98k • 161

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 11.6k • 25

study-hjt/Qwen1.5-32B-Chat-GPTQ-Int8

Text Generation • Updated Apr 26 • 11 • 1

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3 • 472 • 8

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 303k • 58

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29 • 246 • 6

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated 26 days ago • 740 • 3

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated 26 days ago • 3.77k • 17

zgce/Yi-1.5-34B-Chat-GPTQ-Int8

Text Generation • Updated Jun 11 • 192 • 1

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 560 • 1

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 237 • 2

AI-MO/NuminaMath-7B-TIR-GPTQ

Text Generation • Updated Jul 9 • 311 • 4

cognitivecomputations/dolphin-2.9.2-qwen2-72b-eetq

Text Generation • Updated Jul 15 • 10 • 1

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 568 • 28

bigstorm/Llama-3-Groq-70B-Tool-Use-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 4 • 1

jiangchengchengNLP/huatuo-7b-sns8bits

Updated Aug 5 • 7 • 1

marcinbrzezanski/gemma-2-2b-it-gptq-8bit

Text Generation • Updated Aug 2 • 153 • 1

radlab/pLLama3-8B-chat

Text Generation • Updated 16 days ago • 46 • 1

MaziyarPanahi/calme-2.3-legalkit-8b-GGUF

Text Generation • Updated Aug 7 • 692 • 8

SicariusSicariiStuff/Dusk_Rainbow-EXL2-8.0-bpw

Updated 6 days ago • 34 • 1

ktoprakucar/Llama-Guard-3-8B-Q8-GPTQ

Text Generation • Updated 13 days ago • 47 • 1

gghfez/ArliAI-RPMax-12B-v1.1-exl2-8.0bpw

Updated 15 days ago • 19 • 1