GGUF
Inference Endpoints

Commit History

Upload Llama-3.1-Minitron-4B-Width-Base.Q4_K_S.gguf with huggingface_hub
3d99350
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q3_K_S.gguf with huggingface_hub
39ccdfc
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q3_K_M.gguf with huggingface_hub
74ea7e6
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q3_K_L.gguf with huggingface_hub
31bfd90
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q2_K.gguf with huggingface_hub
f265c11
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q5_1.gguf with huggingface_hub
4f314c4
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q5_0.gguf with huggingface_hub
a69df7e
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q5_K_S.gguf with huggingface_hub
628d932
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q5_K_M.gguf with huggingface_hub
7b89c22
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q6_K.gguf with huggingface_hub
3b9f7db
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q8_0.gguf with huggingface_hub
1c1eda5
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q4_0.gguf with huggingface_hub
0b73990
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q4_1.gguf with huggingface_hub
8dbd08c
verified

aashish1904 commited on

Upload Llama-3.1-Minitron-4B-Width-Base.Q4_K_M.gguf with huggingface_hub
572b02b
verified

aashish1904 commited on

initial commit
b50713a
verified

aashish1904 commited on