Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

199

Full-text search

Active filters: nvidia

blockblockblock/Llama3-ChatQA-1.5-8B-bpw3.7-exl2

Text Generation • Updated May 3 • 1

MoMonir/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 3 • 13

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.2-exl2

Text Generation • Updated May 3 • 1

LoneStriker/Llama3-ChatQA-1.5-70B-2.4bpw-h6-exl2

Text Generation • Updated May 3 • 5

LoneStriker/Llama3-ChatQA-1.5-70B-3.5bpw-h6-exl2

Text Generation • Updated May 3 • 7

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.4-exl2

Text Generation • Updated May 3 • 3

LoneStriker/Llama3-ChatQA-1.5-70B-4.0bpw-h6-exl2

Text Generation • Updated May 3 • 5

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.6-exl2

Text Generation • Updated May 3 • 3

LoneStriker/Llama3-ChatQA-1.5-70B-4.65bpw-h6-exl2

Text Generation • Updated May 3 • 5

blockblockblock/Llama3-ChatQA-1.5-8B-bpw4.8-exl2

Text Generation • Updated May 3 • 3

LoneStriker/Llama3-ChatQA-1.5-70B-5.0bpw-h6-exl2

Text Generation • Updated May 3 • 4

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5-exl2

Text Generation • Updated May 3 • 1

LoneStriker/Llama3-ChatQA-1.5-70B-6.0bpw-h6-exl2

Text Generation • Updated May 4 • 2

blockblockblock/Llama3-ChatQA-1.5-8B-bpw5.5-exl2

Text Generation • Updated May 3 • 6

blockblockblock/Llama3-ChatQA-1.5-8B-bpw6-exl2

Text Generation • Updated May 3 • 5

bartowski/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4 • 190 • 9

alexcovo/Llama3-ChatQA-1.5-8B-256K-Q4_K_M-GGUF

Text Generation • Updated May 4 • 1

lmstudio-community/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated May 4 • 168 • 6

lmstudio-community/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 4 • 220 • 6

QuantFactory/NVIDIA-Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 6 • 2.8k • 1

LiteLLMs/Llama3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 28 • 54

ivanzou/fdsfsdf24e34e

Kameshr/Nvidia-Llama3-ChatQA-1.5-4bit

Text Generation • Updated May 11 • 9

Kameshr/Nvidia-Llama3Q-A-8bit

Text Generation • Updated May 11 • 7 • 1

rollend/Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

Text Generation • Updated May 31 • 3

narainp/Llama3-ChatQA-1.5-8B-Q4_K_M-GGUF

Text Generation • Updated May 31 • 19

lyonsn4/Llama3-ChatQA-1.5-8B-Q3_K_M-GGUF

Text Generation • Updated Jun 7 • 3

nvidia/Llama3-70B-PPO-Chat

Updated Jun 14 • 34

nvidia/mamba2-hybrid-8b-3t-128k

Text Generation • Updated Jun 13 • 42