Hugging Face's logo

backyardai
/
Senku-70B-Full-GGUF

PEFT
GGUF
Generated from Trainer
Inference Endpoints
conversational
Model card Files Community
brooketh commited on
Commit
e47ac6a
•
1 Parent(s): 5f67382

Upload Senku-70B-Full-GGUF

Browse files
Files changed (30) hide show
  1. .gitattributes +7 -0
  2. README.md +11 -13
  3. Senku-70B-Full.F32-split-00001-of-00006.gguf +3 -0
  4. Senku-70B-Full.F32-split-00002-of-00006.gguf +3 -0
  5. Senku-70B-Full.F32-split-00003-of-00006.gguf +3 -0
  6. Senku-70B-Full.F32-split-00004-of-00006.gguf +3 -0
  7. Senku-70B-Full.F32-split-00005-of-00006.gguf +3 -0
  8. Senku-70B-Full.F32-split-00006-of-00006.gguf +3 -0
  9. Senku-70B-Full.IQ1_M.gguf +3 -0
  10. Senku-70B-Full.IQ1_S.gguf +2 -2
  11. Senku-70B-Full.IQ2_M.gguf +2 -2
  12. Senku-70B-Full.IQ2_S.gguf +2 -2
  13. Senku-70B-Full.IQ2_XS.gguf +2 -2
  14. Senku-70B-Full.IQ2_XXS.gguf +2 -2
  15. Senku-70B-Full.IQ3_M.gguf +2 -2
  16. Senku-70B-Full.IQ3_S.gguf +2 -2
  17. Senku-70B-Full.IQ3_XS.gguf +2 -2
  18. Senku-70B-Full.IQ3_XXS.gguf +2 -2
  19. Senku-70B-Full.IQ4_XS.gguf +2 -2
  20. Senku-70B-Full.Q3_K_L.gguf +2 -2
  21. Senku-70B-Full.Q3_K_M.gguf +2 -2
  22. Senku-70B-Full.Q3_K_S.gguf +2 -2
  23. Senku-70B-Full.Q4_K_M.gguf +2 -2
  24. Senku-70B-Full.Q4_K_S.gguf +2 -2
  25. Senku-70B-Full.Q5_K_M.gguf +2 -2
  26. Senku-70B-Full.Q5_K_S.gguf +2 -2
  27. Senku-70B-Full.Q6_K-split-00001-of-00002.gguf +2 -2
  28. Senku-70B-Full.Q6_K-split-00002-of-00002.gguf +1 -1
  29. Senku-70B-Full.Q8_0-split-00001-of-00002.gguf +2 -2
  30. Senku-70B-Full.imatrix +2 -2
.gitattributes CHANGED
@@ -60,3 +60,10 @@ Senku-70B-Full.Q6_K-split-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -tex
60
  Senku-70B-Full.Q6_K-split-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
61
  Senku-70B-Full.Q8_0-split-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
  Senku-70B-Full.Q8_0-split-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
60
  Senku-70B-Full.Q6_K-split-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
61
  Senku-70B-Full.Q8_0-split-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
  Senku-70B-Full.Q8_0-split-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Senku-70B-Full.F32-split-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Senku-70B-Full.F32-split-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Senku-70B-Full.F32-split-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Senku-70B-Full.F32-split-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Senku-70B-Full.F32-split-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Senku-70B-Full.F32-split-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Senku-70B-Full.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,16 +1,14 @@
1
  ---
2
- base_model: ShinojiResearch/Senku-70B-Full
3
  license: cc0-1.0
4
- language:
5
- - en
6
  library_name: peft
7
- pipeline_tag: text-generation
8
- quantized_by: brooketh
9
  tags:
10
  - generated_from_trainer
11
- - roleplay
12
- - text-generation-inference
13
-
 
 
 
14
  ---
15
  <img src="BackyardAI_Banner.png" alt="Backyard.ai" style="height: 90px; min-width: 32px; display: block; margin: auto;">
16
 
@@ -21,12 +19,12 @@ tags:
21
  <p style="text-align: center;"><a href="https://www.reddit.com/r/LLM_Quants/">Request Additional models at r/LLM_Quants.</a></p>
22
 
23
  ***
24
- # Senku 70B Full
25
- - **Creator:** [Shinoji Research](https://huggingface.co/Shinoji Research/)
26
- - **Original:** [Senku 70B Full](https://huggingface.co/ShinojiResearch/Senku-70B-Full)
27
  - **Date Created:** 2024-02-06
28
- - **Trained Context:** 8192 tokens
29
- - **Description:** Finetune of Mistral-70B on the Slimorca dataset. Exceptional at roleplay with the highest EQ Bench scores to date. Recommended for use with the ChatML prompt format.
30
  ***
31
  ## What is a GGUF?
32
  GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
 
1
  ---
 
2
  license: cc0-1.0
 
 
3
  library_name: peft
 
 
4
  tags:
5
  - generated_from_trainer
6
+ base_model: ShinojiResearch/Senku-70B-Full
7
+ datasets:
8
+ - Open-Orca/SlimOrca
9
+ model_name: Senku-70B-Full-GGUF
10
+ quantized_by: brooketh
11
+ parameter_count: 68976648192
12
  ---
13
  <img src="BackyardAI_Banner.png" alt="Backyard.ai" style="height: 90px; min-width: 32px; display: block; margin: auto;">
14
 
 
19
  <p style="text-align: center;"><a href="https://www.reddit.com/r/LLM_Quants/">Request Additional models at r/LLM_Quants.</a></p>
20
 
21
  ***
22
+ # Senku Full 70B
23
+ - **Creator:** [ShinojiResearch](https://huggingface.co/ShinojiResearch/)
24
+ - **Original:** [Senku Full 70B](https://huggingface.co/ShinojiResearch/Senku-70B-Full)
25
  - **Date Created:** 2024-02-06
26
+ - **Trained Context:** 32764 tokens
27
+ - **Description:** Finetune of miqu-70b-sf dequant of miqudev's leak of Mistral-70B (allegedly an early mistral medium). This version, using the ChatML prompt template, achieved an EQ-Bench score of 85.09.
28
  ***
29
  ## What is a GGUF?
30
  GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
Senku-70B-Full.F32-split-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e196777c1c8da3dd52f58c8fcfc128a3dc0b7462091b48c5db49e2682d1f7d1f
3
+ size 49905511456
Senku-70B-Full.F32-split-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8d2a977f9a848c911dcfa3a28fbd8ae28c81efdca0c75a89e6540a682bdba49
3
+ size 49829289696
Senku-70B-Full.F32-split-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b33a993e9d04ee4a0297e0ed8a2f2201d95149e57bae9525e43544fdf3faf82f
3
+ size 49426636576
Senku-70B-Full.F32-split-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eea62cefab5b7b5a195ed1f806f977fd597cd2b210345035b0ce92d5832ccc50
3
+ size 49829289696
Senku-70B-Full.F32-split-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bfd9d809078e87bff8546be4c0e5a453b71aaf47e1fdfad9381b85b086d5316
3
+ size 49997029280
Senku-70B-Full.F32-split-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:604012723824c05564974ee9dfccb4571c70a352a5c410b7f4662dbc53d1e6a7
3
+ size 26919604416
Senku-70B-Full.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e28ef9241043ff310d178ef5a95442a45971ac173ba146b14b2add0e5584d712
3
+ size 15943251776
Senku-70B-Full.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21ea82b5592d78faac549550de5293920c989d20fcdde69d0fa91337709b9950
3
- size 14535538240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8948d3e15080eac784153681b7bc2d324d66c1d06e09cb37b45e57348676692e
3
+ size 14535538496
Senku-70B-Full.IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf5b939dd5b35b4dc1128f782afa1d0ac9ea268f9dd805a5f842d30ba36137e3
3
- size 23231264320
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5e35740d201f743d838955b7dbbe4734ab09ef9fd9ed0e107fbac025109f8ac
3
+ size 23231264576
Senku-70B-Full.IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a052a204587b0d907f8874baedf8efb04ebcbd6742ff3fb76095ee8143260f7
3
- size 21354313280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:613af4c43f955f0673d7df5dc5d0a22abba0e9eefa2c36f56cf627292d947153
3
+ size 21354313536
Senku-70B-Full.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5e23a3158cef32db850ad6ea05f2e82ef2621b5e9c4fb48bf4f34105545ecfcf
3
- size 20334163520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dac0add5c8b0aaf6fe56406929cc843ebea73c6e996747a1a8fe1dec7b7605c9
3
+ size 20334163776
Senku-70B-Full.IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eaad5135beebc2e8c9fc7f98010e79dc9b9c297c656d71ca1c3f683647213f00
3
- size 18289440320
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d513165b9adccd907df4c7c6620035905a6b8bc65d869d2fd838a7f1764a3fb
3
+ size 18289440576
Senku-70B-Full.IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50a3c06e3159c8e39f926fcae0e9543c48a8b22606aaf453379a6e5ac09fa135
3
- size 30944278080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:952212bff21892fe88977847156feed314a70f3e64119d7586c379c199ccf036
3
+ size 30944278336
Senku-70B-Full.IQ3_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fc363978b6377f4f3ac5c21e4d42fa5e53389c71d8b9c0180f0b5cb61ab39567
3
- size 29919295040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad840a7170c1fe1c28cc4652b78963d1a9d992b97722ddfef603d1e234a29816
3
+ size 29919295296
Senku-70B-Full.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5adabd1dba5119269b496098658f35088b018c055ef8d0d570632752fe8bbd3f
3
- size 28314973760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b11b7b58cc81f7c88d6137901d1f88b79f7efbe76744390b3d0ff41002afc3d
3
+ size 28314974016
Senku-70B-Full.IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0464fd90a3c886979a553a2ed812848f9652f5f4d5c8ad73dcef60c6ea104a2b
3
- size 26581464640
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac38cca8f9ea14b33f91c1eb3d26f93212f600b06aa5e4245be04abd3a27220e
3
+ size 26581464896
Senku-70B-Full.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e5211532c12d44b7d6889ccc2668ac5f263c1cb508dfab795603e6c4684d8b0c
3
- size 36829820480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5853b51805aee5ee6bc42a53cc6b98669374763a4e27503ba69b657f5b3e3c9
3
+ size 36829820736
Senku-70B-Full.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec1b07a7f9b6c2842eeb3ed80b2ea2323520251d7142bae8c29168395b70f490
3
- size 36147836480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4f9ca5f47fc6cf8decdd0f72f717725c41b8193b339fc0a618c954e9dbacf13
3
+ size 36147836512
Senku-70B-Full.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f980c87272b419534fa1d9360a46fcb6b0e9474eaefd8e141f58256ffd4dff0b
3
- size 33274738240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2db0058fcb1819b9c01edc110d1885d32f9d87e6b95f817cfe6fe1f6d8fdb956
3
+ size 33274738272
Senku-70B-Full.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8cd914fe6e2d971486c64dab3c8d26e2bb12eaf0dca247b3e34a2f1f072f342f
3
- size 29919295040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5280d29c40275353396126a938b924d0eee2676cdef9da6e3f02b9afc44ce90
3
+ size 29919295072
Senku-70B-Full.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23a0ed1c77658e0670d2e88f0e5f6f19b67abd475780dce92335c7240d7bd0f1
3
- size 41422911040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:788624c956a45efe33c7273b640b1fefb7030c55ae820ca60a085dab8f2854b5
3
+ size 41422911072
Senku-70B-Full.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61aeb4329b3d7768eae41b6814d4b7db7fff971300ccd7cd77aea14f51190ece
3
- size 39249737280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:020ddb5e30921edf13d02673933d2ae370a0ce8a3428209e7c2386d1f0d132f6
3
+ size 39249737312
Senku-70B-Full.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:58f684bfa0c7f96223b6e727fcd27d78f6282d99ab643925947eb278d08d54a3
3
- size 48753768000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:daeb6ff1c2deadad7a83aa7de49304d8f2399e8a92d23d61c6a3601cd849e71c
3
+ size 48753768032
Senku-70B-Full.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1ac4bd827891742d40b5ab7b82033763dc81a19d9ea9127c45be1f0d407c71f
3
- size 47461398080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bd7d9f61fbca7f36af95185af789249a12fafefe493f4e8795c49d871d9e31d
3
+ size 47461398112
Senku-70B-Full.Q6_K-split-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02d3532a7f8b321a8dc8460e8fb6f0b4920869ca3841f4e1fd8f468ffefccd86
3
- size 49992753856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eda015432070296dd8d5eb0011bd09e6d650f3645fc554ae142a51d899272c48
3
+ size 49992753920
Senku-70B-Full.Q6_K-split-00002-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4c2d77a2195313569c964522b4e08e8e7264e56acf4e561c035e58b38001b396
3
  size 6594614336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b3721cd3ce7d2efc1ef3f94b96a8a4500e101a66a4989f7ca8e4d0bb74f0e6c
3
  size 6594614336
Senku-70B-Full.Q8_0-split-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a5e322d9317ad55ed6b9e3a9b9df3019953f7c4f3c537491ff5e7d83014fc05
3
- size 49874206752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3184e686230394aff5de586e301582887430b9ed2713db94610f66118b7cbb16
3
+ size 49874206816
Senku-70B-Full.imatrix CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e722beb9027460e50a1baf264c16a5d4f9c43c6be2e02d2df152c2e6b0873c23
3
- size 24922254
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7221c582f750df725936a20b1b81766fe7b711cb21cbd52e1bb94cad89c02124
3
+ size 24922281