GGUF model commit (made with llama.cpp commit edd1ab7)

cebfc6a 9 months ago

.gitattributes

2.28 kB

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q2_K.gguf

12.9 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q3_K_L.gguf

16.1 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q3_K_M.gguf

14.8 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q3_K_S.gguf

13.3 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q4_0.gguf

17.3 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q4_K_M.gguf

18.2 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q4_K_S.gguf

17.3 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q5_0.gguf

21 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q5_K_M.gguf

21.5 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q5_K_S.gguf

21 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q6_K.gguf

24.9 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago
yayi2-30b-llama.Q8_0.gguf

32.3 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 9 months ago