Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,062

Full-text search

Active filters: 8-bit

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated 5 days ago • 964 • 3

radlab/pLLama3-8B-chat

Text Generation • Updated 19 days ago • 26 • 1

MaziyarPanahi/calme-2.3-legalkit-8b-GGUF

Text Generation • Updated Aug 7 • 684 • 8

SicariusSicariiStuff/Dusk_Rainbow-EXL2-8.0-bpw

Updated 8 days ago • 26 • 1

ktoprakucar/Llama-Guard-3-8B-Q8-GPTQ

Text Generation • Updated 16 days ago • 47 • 1

gghfez/ArliAI-RPMax-12B-v1.1-exl2-8.0bpw

Updated 18 days ago • 19 • 1

nejumi/c4ai-command-r-08-2024-GPTQ-Int8-calib-ja-1k

Updated 12 days ago • 7 • 1

abdo-Mansour/Meta-Llama-3.1-8B-Instruct-GPTQ-8bit

Text Generation • Updated 16 days ago • 80 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated 14 days ago • 485 • 4

LoneStriker/Yi-Coder-9B-8.0bpw-h8-exl2

Updated 14 days ago • 12 • 1

altomek/Yi-Coder-9B-Chat-8bpw-EXL2

Text Generation • Updated 8 days ago • 41 • 1

nejumi/c4ai-command-r-plus-08-2024-GPTQ-Int8-calib-ja-1k

Updated 12 days ago • 24 • 1

ktoprakucar/Hermes-3-Llama-3.1-8B-Q8-GPTQ

Updated 13 days ago • 16 • 1

MikeRoz/mattshumer_Reflection-Llama-3.1-70B-8.0bpw-h8-exl2

Text Generation • Updated 10 days ago • 76 • 1

ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GPTQ_Q8

Updated 9 days ago • 32 • 2

ArliAI/Llama-3.1-8B-ArliAI-RPMax-v1.1-GPTQ_Q8

Updated 9 days ago • 11 • 1

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated 7 days ago • 239 • 2

ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.1-GPTQ_Q8

Updated 9 days ago • 35 • 1

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated 7 days ago • 97 • 2

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated 7 days ago • 102 • 1

DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max

Text Generation • Updated 6 days ago • 14 • 1

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated about 11 hours ago • 2 • 1

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated about 11 hours ago • 2 • 1

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated about 11 hours ago • 1

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated about 10 hours ago • 2 • 1

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated about 11 hours ago • 9 • 1

MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated about 6 hours ago • 1

DewEfresh/pixtral-12b-8bit

Updated about 6 hours ago • 1

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated about 5 hours ago • 1

MaziyarPanahi/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated about 5 hours ago • 1