dranger003
/

gemma-7b-it-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

gemma-7b-it-iMat.GGUF

1 contributor

History: 23 commits

dranger003's picture

Update README.md

cf722c1 verified 9 months ago

.gitattributes

2.1 kB

Upload ggml-gemma-7b-it-q3_k_xs.gguf 9 months ago
README.md

4.3 kB

Update README.md 9 months ago
ggml-gemma-7b-it-f16-imatrix.dat

4.94 MB
LFS

Upload ggml-gemma-7b-it-f16-imatrix.dat 9 months ago
ggml-gemma-7b-it-f16.gguf

17.1 GB
LFS

Upload 2 files 9 months ago
ggml-gemma-7b-it-iq3_m.gguf

4.11 GB
LFS

Upload ggml-gemma-7b-it-iq3_m.gguf 9 months ago
ggml-gemma-7b-it-iq3_s.gguf

3.98 GB
LFS

Upload ggml-gemma-7b-it-iq3_s.gguf 9 months ago
ggml-gemma-7b-it-iq3_xxs.gguf

3.64 GB
LFS

Upload ggml-gemma-7b-it-iq3_xxs.gguf 9 months ago
ggml-gemma-7b-it-q3_k_xs.gguf

3.8 GB
LFS

Upload ggml-gemma-7b-it-q3_k_xs.gguf 9 months ago
ggml-gemma-7b-it-q4_k_m.gguf

5.33 GB
LFS

Upload ggml-gemma-7b-it-q4_k_m.gguf 9 months ago
ggml-gemma-7b-it-q6_k.gguf

7.01 GB
LFS

Upload ggml-gemma-7b-it-q6_k.gguf 9 months ago
ggml-gemma-7b-it-q8_0.gguf

9.08 GB
LFS

Upload 2 files 9 months ago