Hugging Face's logo

NousResearch
/
Hermes-2-Theta-Llama-3-70B-GGUF

Text Generation
GGUF
English
distillation
synthetic data
function calling
structured outputs
json mode
Inference Endpoints
conversational
Model card Files Community
2
emozilla commited on
Commit
a99aeef
•
1 Parent(s): ac3203b

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Hermes-2-Theta-Llama-3-70B-Q3_K_L.gguf +3 -0
  3. Hermes-2-Theta-Llama-3-70B-Q3_K_M.gguf +3 -0
  4. Hermes-2-Theta-Llama-3-70B-Q3_K_S.gguf +3 -0
  5. Hermes-2-Theta-Llama-3-70B-Q4_K_M.gguf +3 -0
  6. Hermes-2-Theta-Llama-3-70B-Q4_K_S.gguf +3 -0
  7. Hermes-2-Theta-Llama-3-70B-Q5_K_M.gguf +3 -0
  8. Hermes-2-Theta-Llama-3-70B-Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Hermes-2-Theta-Llama-3-70B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Hermes-2-Theta-Llama-3-70B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Hermes-2-Theta-Llama-3-70B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Hermes-2-Theta-Llama-3-70B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Hermes-2-Theta-Llama-3-70B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Hermes-2-Theta-Llama-3-70B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Hermes-2-Theta-Llama-3-70B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Hermes-2-Theta-Llama-3-70B-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a48bebb258e473f756002ea1d125630026dae3463b1d94c2d2cfbebcb0d69296
3
+ size 37140591872
Hermes-2-Theta-Llama-3-70B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:790e774630d3bff958a4d7fa3962e0da3cc63e3f7eca04f5b2d11cd7de7da201
3
+ size 34267493632
Hermes-2-Theta-Llama-3-70B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b212aac93d5d2085c1ed44dc650cd1f874b0adf75a965e6857bbf13fb0f20ba
3
+ size 30912050432
Hermes-2-Theta-Llama-3-70B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3965f671c35d09da8b903218f5bbaac94efdd9000e4fe4a2bac87fcac9f664e
3
+ size 42520392960
Hermes-2-Theta-Llama-3-70B-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72285a83e3f0c0159cf524024714da0491ead0ff56012f4b177d53871d02743a
3
+ size 40347219200
Hermes-2-Theta-Llama-3-70B-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:805ba6ecffc17cf2e27bc96703f0d35108843fa3620a8bc0ffc382efe0800bca
3
+ size 49949816064
Hermes-2-Theta-Llama-3-70B-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:593d9d041d71a4df2dde48ee893db4ca3a07117af50c9f23e90e16e81e0b4873
3
+ size 48657446144