1 contributor

History: 27 commits

TheBloke

GGUF model commit (made with llama.cpp commit 9912b9e)

766bd2d about 1 year ago

.gitattributes

2.31 kB

Add q6_K and q8_0 as split files due to 50GB limit about 1 year ago
LICENSE.txt

7.02 kB

Add Llama 2 license files about 1 year ago
Notice

112 Bytes

Add Llama 2 license files about 1 year ago
README.md

17.8 kB

Update README.md about 1 year ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files about 1 year ago
config.json

29 Bytes

Initial GGUF model commit about 1 year ago
nous-puffin-70b.Q2_K.gguf

29.3 GB
LFS

GGUF model commit (made with llama.cpp commit 9912b9e) about 1 year ago
nous-puffin-70b.Q3_K_L.gguf

36.1 GB
LFS

GGUF model commit (made with llama.cpp commit 9912b9e) about 1 year ago
nous-puffin-70b.Q3_K_M.gguf

33.2 GB
LFS

GGUF model commit (made with llama.cpp commit 9912b9e) about 1 year ago
nous-puffin-70b.Q3_K_S.gguf

29.9 GB
LFS

GGUF model commit (made with llama.cpp commit 9912b9e) about 1 year ago
nous-puffin-70b.Q4_K_M.gguf

41.4 GB
LFS

Initial GGUF model commit about 1 year ago
nous-puffin-70b.Q4_K_S.gguf

39 GB
LFS

Initial GGUF model commit about 1 year ago
nous-puffin-70b.Q5_K_M.gguf

48.8 GB
LFS

Initial GGUF model commit about 1 year ago
nous-puffin-70b.Q5_K_S.gguf

47.5 GB
LFS

Initial GGUF model commit about 1 year ago
nous-puffin-70b.Q6_K.gguf-split-a

36.7 GB
LFS

Add q6_K and q8_0 as split files due to 50GB limit about 1 year ago
nous-puffin-70b.Q6_K.gguf-split-b

19.9 GB
LFS

Add q6_K and q8_0 as split files due to 50GB limit about 1 year ago
nous-puffin-70b.Q8_0.gguf-split-a

36.7 GB
LFS

Add q6_K and q8_0 as split files due to 50GB limit about 1 year ago
nous-puffin-70b.Q8_0.gguf-split-b

36.5 GB
LFS

Add q6_K and q8_0 as split files due to 50GB limit about 1 year ago