Hugging Face's logo

dahara1
/
gemma-2-9b-it-gguf-japanese-imatrix

GGUF
gemma2
llm
Inference Endpoints
imatrix
conversational
Model card Files Community
dahara1 commited on
Commit
f01e27d
•
1 Parent(s): 31a24bb

Upload 2 files

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. gemma-2-9b-it-Q4_K_M-fp16.gguf +3 -0
  3. gemma-2-9b-it-Q5_K_M-fp16.gguf +3 -0
.gitattributes CHANGED
@@ -45,3 +45,5 @@ gemma-2-9b-it.f16.Q6_k.gguf filter=lfs diff=lfs merge=lfs -text
45
  gemma-2-9b-it.f16.Q8.gguf filter=lfs diff=lfs merge=lfs -text
46
  gemma-2-9b-it-IQ3_XXS-fp16.gguf filter=lfs diff=lfs merge=lfs -text
47
  gemma-2-9b-it-Q3_K_M-fp16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
45
  gemma-2-9b-it.f16.Q8.gguf filter=lfs diff=lfs merge=lfs -text
46
  gemma-2-9b-it-IQ3_XXS-fp16.gguf filter=lfs diff=lfs merge=lfs -text
47
  gemma-2-9b-it-Q3_K_M-fp16.gguf filter=lfs diff=lfs merge=lfs -text
48
+ gemma-2-9b-it-Q4_K_M-fp16.gguf filter=lfs diff=lfs merge=lfs -text
49
+ gemma-2-9b-it-Q5_K_M-fp16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-Q4_K_M-fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:40de42dfe28a49bc4090ec1b8b82cef65f02b6241c61da653be49c83c6ebd899
3
+ size 6843426176
gemma-2-9b-it-Q5_K_M-fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edc9c90c2214f437cdfc4c99e9008d0fc4f6438b390952c9d7ca74b5d07a3388
3
+ size 7729735040