Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

144

Full-text search

Active filters: llama-3.1

AstroMLab/AstroSage-8B

Text Generation • Updated 5 days ago • 293 • 4

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 123k • 37

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 407k • 60

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 250k • 90

vicgalle/Configurable-Llama-3.1-8B-Instruct

Text Generation • Updated Jul 24 • 3.51k • 11

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 57.4k • 18

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 22.7k • 20

kingabzpro/Llama-3.1-8B-Instruct-Mental-Health-Classification

Question Answering • Updated Jul 29 • 506 • 5

ValiantLabs/Llama3.1-8B-ShiningValiant2

Text Generation • Updated 17 days ago • 3.53k • 16

akjindal53244/Llama-3.1-Storm-8B

Text Generation • Updated Aug 29 • 10.8k • 164

akjindal53244/Llama-3.1-Storm-8B-GGUF

Text Generation • Updated Aug 21 • 1.66k • 41

OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k

Text Generation • Updated Aug 17 • 2.78k • 2

NCSOFT/Llama-VARCO-8B-Instruct

Text Generation • Updated Oct 4 • 4.45k • 48

ValiantLabs/Llama3.1-8B-Esper2

Text Generation • Updated Oct 3 • 126 • 2

OpenBuddy/openbuddy-nemotron-70b-v23.1-131k

Text Generation • Updated 28 days ago • 130 • 3

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated 22 days ago • 1.58k • 1

OpenBuddy/openbuddy-nemotron-70b-v23.2-131k

Text Generation • Updated 28 days ago • 88 • 1

OpenBuddy/openbuddy-nemotron-70b-v23.2-131k-gguf

Text Generation • Updated 26 days ago • 164 • 1

mukaj/Llama-3.1-Hawkish-8B

Text Generation • Updated 26 days ago • 415 • 40

NikolayKozloff/Llama-3.1-Hawkish-8B-Q8_0-GGUF

Text Generation • Updated 26 days ago • 258 • 4

bartowski/Llama-3.1-Hawkish-8B-GGUF

Text Generation • Updated 26 days ago • 5.02k • 8

ValiantLabs/Llama3.1-70B-ShiningValiant2

Text Generation • Updated 4 days ago • 73 • 3

bartowski/Llama3.1-70B-ShiningValiant2-GGUF

Text Generation • Updated 21 days ago • 2.58k • 3

OpenBuddy/openbuddy-nemotron-70b-v23.2q-131k

Text Generation • Updated 10 days ago • 52 • 1

mradermacher/AstroSage-8B-GGUF

Updated 4 days ago • 512 • 1

bartowski/openbuddy-nemotron-70b-v23.2q-131k-GGUF

Text Generation • Updated 5 days ago • 810 • 1

mradermacher/AstroSage-8B-i1-GGUF

Updated 4 days ago • 675 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 17.4k • 16

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • Updated Sep 16 • 39 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16 • 1.08k • 5