Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
like
3
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
2
Use this model
08861ce
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
08861ce
verified
28 days ago
.gitattributes
3.35 kB
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_M.gguf
16.8 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_S.gguf
15.3 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ2_XS.gguf
21.1 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_XS.gguf
29.3 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ4_XS.gguf
37.9 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q2_K.gguf
26.4 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_L.gguf
37.1 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_M.gguf
34.3 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_S.gguf
30.9 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q4_K_M.gguf
42.5 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q4_K_S.gguf
40.3 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q5_K_M.gguf
49.9 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q5_K_S.gguf
48.7 GB
LFS
[WIP] Upload folder using huggingface_hub (multi-commit b54a82fab5266c8a35a9c3a129d469db5193b8c155e4353e08fe5b0036c1cfb8) (#1)
28 days ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
5.27 GB
LFS
d97ea4a1d42c3368b208cf06cec623e9f5fb03938a279c38612d1acde7244a27
28 days ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
4.83 GB
LFS
07314d8a2b5323b9d045348b779f0f5c93de26113e9320c6a2c92a80725521ac
28 days ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
6.65 GB
LFS
4325ec2cd0579937e24513e09138db858b55a686e157f87f163f9ec0797ebefe
28 days ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
9.18 GB
LFS
c27c599ce30688e70283a911239259359932f5e4c2bfce54c4267fb92906764b
28 days ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
11.9 GB
LFS
038dbb9704e27e05422b0e62878c4cba5cc4bcf528c1c3ef6e2170de97836f79
28 days ago
Mistral-Small-Instruct-2409.Q2_K.gguf
8.27 GB
LFS
09c69d43845de7bc4d3f1bbb8910d69b03b2444e206c2a086ca7b8b28e406038
28 days ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
11.7 GB
LFS
d59c868477712071137f1d10f3aeac4411d8bdc386437159bffb1e377c8b2402
28 days ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
10.8 GB
LFS
f2de7ffd39aec8dddf94b1b9c86f45f93b738fff04db543ca05c64ce4ef1af44
28 days ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
9.64 GB
LFS
72058eebd438f4bc08ee3197c32530097a37e5db2fe8eb29dd3e0b283ed81117
28 days ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
13.3 GB
LFS
8690d7a32304278be77265f5e545764276b5ea5e42338cef35ae46bb1808d0ac
28 days ago
