GGUF
Inference Endpoints
imatrix

Commit History

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_0_8_8.gguf
cf64c33
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_8.gguf
a8b6592
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_4.gguf
1894899
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q8_0.gguf
6585cfd
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q5_1.gguf
c3d64a8
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q5_0.gguf
47147ed
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_1.gguf
4a85c6a
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_0.gguf
b351f35
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-F16.gguf
12e2a19
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q6_K.gguf
6391b75
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q5_K_S.gguf
aea49df
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q5_K_M.gguf
e24a300
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ4_XS.gguf
290fd6c
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_K_M.gguf
f1a7171
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q4_K_S.gguf
e142c56
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ4_NL.gguf
7600cbb
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q3_K_M.gguf
755f25b
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ3_XS.gguf
48f3f39
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q3_K_L.gguf
cd880fb
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ3_M.gguf
0b8339f
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q3_K_S.gguf
2e66c0b
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ3_XXS.gguf
bfc98e0
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ3_S.gguf
67e7392
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ2_M.gguf
cbba92f
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ2_S.gguf
217a4b5
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q2_K_S.gguf
e735694
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ2_XS.gguf
3a8eea0
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-Q2_K.gguf
12132ac
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ2_XXS.gguf
dd6d82d
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ1_S.gguf
7a881e3
verified

ThomasBaruzier commited on

Upload Llama-3.1-Minitron-4B-Width-Base-IQ1_M.gguf
1e7170f
verified

ThomasBaruzier commited on