Edit Models filters

Model Tree

meta-llama/Meta-Llama-3-70B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

45

Full-text search

Active filters: meta-llama/Meta-Llama-3-70B-Instruct

QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2

Text Generation • Updated May 6 • 1.17k • 16

PawanKrd/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Apr 18 • 285 • 3

mlc-ai/Llama-3-70B-Instruct-q3f16_1-MLC

Updated Jul 11 • 116 • 1

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 1.08k • 17

QuantFactory/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Apr 20 • 2.61k • 45

lmstudio-community/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 3 • 800 • 109

qwp4w3hyb/Meta-Llama-3-70B-Instruct-iMat-GGUF

Text Generation • Updated May 8 • 626 • 3

screevoai/llama3-70b-instruct-4bit

Text Generation • Updated Apr 23 • 47 • 1

LoneStriker/OpenBioLLM-Llama3-70B-GGUF

Updated Apr 26 • 15 • 1

LoneStriker/OpenBioLLM-Llama3-70B-2.4bpw-h6-exl2

Text Generation • Updated Apr 27 • 9

LoneStriker/OpenBioLLM-Llama3-70B-3.5bpw-h6-exl2

Text Generation • Updated Apr 27 • 2

LoneStriker/OpenBioLLM-Llama3-70B-4.0bpw-h6-exl2

Text Generation • Updated Apr 27 • 6

LoneStriker/OpenBioLLM-Llama3-70B-4.65bpw-h6-exl2

Text Generation • Updated Apr 27 • 8

LoneStriker/OpenBioLLM-Llama3-70B-5.0bpw-h6-exl2

Text Generation • Updated Apr 27 • 14

LoneStriker/OpenBioLLM-Llama3-70B-6.0bpw-h6-exl2

Text Generation • Updated Apr 27 • 7

second-state/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 6 • 325 • 4

LiteLLMs/Llama3-OpenBioLLM-70B-GGUF

Updated May 28 • 629 • 4

lmstudio-community/Meta-Llama-3-70B-Instruct-BPE-fix-GGUF

Text Generation • Updated May 3 • 193 • 4

blockblockblock/Llama-3-70B-Instruct-DPO-v0.4-bpw2.25-exl2

Text Generation • Updated May 3 • 2

blockblockblock/Llama-3-70B-Instruct-DPO-v0.4-bpw2.5-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama-3-70B-Instruct-DPO-v0.4-bpw3-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama3-OpenBioLLM-70B-bpw4-exl2

Text Generation • Updated May 4 • 12

LiteLLMs/Meta-Llama-3-120B-Instruct-GGUF

Updated May 30 • 59 • 1

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-3.5bpw-h6-exl2

Text Generation • Updated May 6 • 10

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-2.4bpw-h6-exl2

Text Generation • Updated May 6 • 9

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-4.65bpw-h6-exl2

Text Generation • Updated May 6 • 3

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-4.0bpw-h6-exl2

Text Generation • Updated May 6 • 2

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-5.0bpw-h6-exl2

Text Generation • Updated May 6 • 2

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-6.0bpw-h6-exl2

Text Generation • Updated May 6 • 8

LoneStriker/Meta-Llama-3-120B-Instruct-2.65bpw-h6-exl2

Text Generation • Updated May 7 • 4