Edit Models filters

Model Tree

meta-llama/Meta-Llama-3.1-70B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

53

Full-text search

Active filters: meta-llama/Meta-Llama-3.1-70B-Instruct

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • Updated 1 day ago • 1.43k • 31

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 17.2k • 34

shenzhi-wang/Llama3.1-70B-Chinese-Chat

Text Generation • Updated Jul 29 • 8.68k • 37

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 13 • 92.4k • 17

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 16 days ago • 13.7k • 16

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 2.25k • 9

backyardai/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 24 • 673 • 3

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 28 • 11.4k • 35

mlabonne/Llama-3.1-70B-Instruct-lorablated-GGUF

Updated Aug 16 • 11.9k • 34

MikeRoz/mattshumer_Reflection-Llama-3.1-70B-8.0bpw-h8-exl2

Text Generation • Updated 10 days ago • 76 • 1

bullerwins/Reflection-70B-exl2_5.0bpw

Text Generation • Updated 12 days ago • 10 • 1

bullerwins/Reflection-70B-exl2_6.0bpw

Text Generation • Updated 12 days ago • 7 • 1

LoneStriker/Reflection-Llama-3.1-70B-6.0bpw-h6-exl2

Text Generation • Updated 12 days ago • 35 • 1

bigstorm/Reflections-Llama-3.1-70B-6.0bpw-8hb-exl2

Text Generation • Updated 12 days ago • 10 • 1

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 5.07k • 34

mlc-ai/Llama-3.1-70B-Instruct-q4f16_1-MLC

Updated Aug 4 • 4 • 1

mlc-ai/Llama-3.1-70B-Instruct-q3f16_1-MLC

Updated Aug 4 • 87 • 1

mlc-ai/Llama-3.1-70B-Instruct-q0f16-MLC

Updated Aug 4 • 1

second-state/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 24 • 941 • 1

gaianet/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 24 • 359

qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF

Text Generation • Updated Aug 6 • 1.55k • 7

Orion-zhen/Llama3.1-70B-Chinese-Chat-4.0bpw-exl2

Text Generation • Updated Jul 26 • 5

mradermacher/Meta-Llama-3.1-70B-Instruct-GGUF

Updated Aug 2 • 301 • 1

mradermacher/Meta-Llama-3.1-70B-Instruct-i1-GGUF

Updated Aug 2 • 1.63k • 1

NobodySpecial/Llama-3.1-70B-Instruct-lorablated-exl2-6.0bpw

Text Generation • Updated Aug 8 • 9

Alias1964/Llama-3.1-70B-Instruct-lorablated-Q4-EXL2

Text Generation • Updated Aug 8 • 12 • 1

fsaudm/Meta-Llama-3.1-70B-Instruct-INT8

Text Generation • Updated 28 days ago • 99

fsaudm/Meta-Llama-3.1-70B-Instruct-NF4

Text Generation • Updated 28 days ago • 57

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 28 days ago • 185

bartowski/Meta-Llama-3.1-70B-Instruct-exl2

Text Generation • Updated 25 days ago • 44